Three-dimensional (3D) human-computer interaction system using computer mouse as a 3D pointing device and an operation method thereof
First Claim
1. A three-dimensional user interface system, comprising:
- at least one pointing/input device including a plurality of visible indicia on a surface thereof;
a multi-view imaging device configured for capturing a plurality of sequential image frames, each of the captured image frames providing at least two different views of a scene comprising the at least one pointing/input device; and
at least one computer program product operable on a computing device having at least one processor, at least one memory, and at least one graphical user interface;
wherein the at least one computer program product includes executable instructions for calculating from the plurality of sequential image frames at least a spatial and a velocity parameter of the at least one pointing/input device when moved through a three-dimensional space, and for rendering, on the graphical user interface, a visual marker corresponding to the spatial and velocity parameters of the at least one pointing/input device in three-dimensional space.
2 Assignments
0 Petitions
Accused Products
Abstract
A three-dimensional user interface system includes at least one pointing/input device and an imaging device configured for capturing one or more image frames each providing at least two different views of a scene including the at least one pointing/input device. The imaging device is a multi-view imaging device which provides at least two different views of the scene per each of the one or more image frames captured. One or more software programs calculate from reference points in the image frames at least a spatial and a velocity parameter of the at least one pointing/input device when moved through a three-dimensional space and for rendering on a graphical user interface of a computing device a visual marker corresponding to the spatial and velocity parameters of the at least one pointing/input device in three-dimensional space. Methods for three-dimensional pointing and/or data input incorporating the described system are also provided.
20 Citations
22 Claims
-
1. A three-dimensional user interface system, comprising:
-
at least one pointing/input device including a plurality of visible indicia on a surface thereof; a multi-view imaging device configured for capturing a plurality of sequential image frames, each of the captured image frames providing at least two different views of a scene comprising the at least one pointing/input device; and at least one computer program product operable on a computing device having at least one processor, at least one memory, and at least one graphical user interface; wherein the at least one computer program product includes executable instructions for calculating from the plurality of sequential image frames at least a spatial and a velocity parameter of the at least one pointing/input device when moved through a three-dimensional space, and for rendering, on the graphical user interface, a visual marker corresponding to the spatial and velocity parameters of the at least one pointing/input device in three-dimensional space. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. In a computing system environment, a method for three-dimensional pointing and/or data input, comprising:
-
moving at least one pointing/input device in a three-dimensional space within a field of view of a multi-view imaging device operably connected to a computing device having at least one processor, at least one memory, and at least one graphical user interface; by the multi-view imaging device, capturing a plurality of sequential image frames with each image frame providing at least two views of a scene including the at least one pointing/input device; from the captured image frames, calculating at least a spatial and a velocity parameter of the at least one pointing/input device when moved through the three-dimensional space; and rendering, on the graphical user interface, a visual marker corresponding to the spatial and velocity parameters of the at least one pointing/input device in three-dimensional space; wherein the at least one pointing device includes a plurality of visible indicia on a surface thereof. - View Dependent Claims (14, 15, 16, 17, 18, 19, 20, 21)
-
-
22. A three-dimensional user interface system, comprising:
-
at least one pointing/input device including a plurality of actuable visible indicia on a surface thereof; a multi-view imaging device configured for capturing a plurality of sequential image frames, the multi-view imaging device comprising a single lens video recording device operably linked to a reflector for providing at least two different views of a scene comprising the at least one pointing/input device per each image frame captured and an image sensor for converting the captured image frames into digital data; and at least one computer program product operable on a computing device having at least one processor, at least one memory, and at least one graphical user interface; wherein the at least one computer program product includes executable instructions for calculating from the plurality of captured sequential image frames at least a spatial and a velocity parameter of the at least one pointing/input device when moved through a three-dimensional space, and for rendering, on the graphical user interface, a visual marker corresponding to the spatial and velocity parameters of the at least one pointing/input device in three-dimensional space; further wherein the plurality of visible indicia provide a reference point for the multi-view imaging device.
-
Specification