Three-Dimensional User Interaction
First Claim
1. A computer-implemented method of user interaction, comprising:
- generating, on a processor, a virtual environment comprising one or more virtual objects and a virtual representation of a user'"'"'s hand having virtual digits formed from a plurality of jointed portions, and displaying, on a display device, the one or more virtual objects;
tracking a point on each digit of the user'"'"'s hand to obtain a set of point locations;
controlling the virtual representation such that each of the virtual digits have corresponding point locations to the user'"'"'s hand, and using an algorithm to calculate positions for the plurality of jointed portions from the point locations; and
updating the one or more virtual objects displayed on the display device by simulating physical forces acting between the virtual representation and the one or more virtual objects in the virtual environment.
2 Assignments
0 Petitions
Accused Products
Abstract
Three-dimensional user interaction is described. In one example, a virtual environment having virtual objects and a virtual representation of a user'"'"'s hand with digits formed from jointed portions is generated, a point on each digit of the user'"'"'s hand is tracked, and the virtual representation'"'"'s digits controlled to correspond to those of the user. An algorithm is used to calculate positions for the jointed portions, and the physical forces acting between the virtual representation and objects are simulated. In another example, an interactive computer graphics system comprises a processor that generates the virtual environment, a display device that displays the virtual objects, and a camera that capture images of the user'"'"'s hand. The processor uses the images to track the user'"'"'s digits, computes the algorithm, and controls the display device to update the virtual objects on the display device by simulating the physical forces.
-
Citations
20 Claims
-
1. A computer-implemented method of user interaction, comprising:
-
generating, on a processor, a virtual environment comprising one or more virtual objects and a virtual representation of a user'"'"'s hand having virtual digits formed from a plurality of jointed portions, and displaying, on a display device, the one or more virtual objects; tracking a point on each digit of the user'"'"'s hand to obtain a set of point locations; controlling the virtual representation such that each of the virtual digits have corresponding point locations to the user'"'"'s hand, and using an algorithm to calculate positions for the plurality of jointed portions from the point locations; and updating the one or more virtual objects displayed on the display device by simulating physical forces acting between the virtual representation and the one or more virtual objects in the virtual environment. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)
-
-
15. An interactive computer graphics system, comprising:
-
a processor arranged to generate a virtual environment comprising one or more virtual objects and a virtual representation of a user'"'"'s hand having virtual digits formed from a plurality of jointed portions; a display device arranged to display the one or more virtual objects; and a camera arranged to capture images of the user'"'"'s hand, wherein the processor is further arranged to use the images of the user'"'"'s hand to track a point on each digit of the user'"'"'s hand to obtain a plurality of point locations, control the virtual representation such that each of the virtual digits have corresponding point locations to the user'"'"'s hand, use an inverse kinematics algorithm to calculate positions for the plurality of jointed portions from the point locations, and control the display device to update the one or more virtual objects displayed on the display device by simulating physical forces acting between the virtual representation and the one or more virtual objects in the virtual environment. - View Dependent Claims (16, 17, 18, 19)
-
-
20. One or more tangible device-readable media with device-executable instructions that, when executed by a computing device, direct the computing device to perform steps comprising:
-
generating a 3D virtual environment comprising one or more virtual objects and a virtual representation of a user'"'"'s hand having virtual digits formed from a plurality of jointed portions; controlling a display device to display the one or more virtual objects and the virtual representation of the user'"'"'s hand; receiving a sequence of images from a depth camera; analyzing the sequence of images using a computer vision algorithm to track a fingertip of each digit of the user'"'"'s hand and a point on the wrist of the user'"'"'s hand to obtain a set of point locations; controlling the virtual representation such that each of the virtual digits have corresponding point locations to the user'"'"'s hand, and using an inverse kinematics algorithm to calculate positions for the plurality of jointed portions from the point locations; and updating the one or more virtual objects displayed on the display device by simulating collision and friction forces acting between the virtual representation and the one or more virtual objects in the 3D virtual environment.
-
Specification