Method and system for vision-based interaction in a virtual environment
First Claim
1. A computer-implemented method for tracking movement of motion features of a subject, comprising:
- receiving data from a plurality of fixed position sensors comprising a distributed network of time of flight camera sensors to generate a volumetric three-dimensional representation of the subject;
identifying a plurality of clusters within the volumetric three-dimensional representation that correspond to motion features indicative of movement of the motion features of the subject relative to the fixed position sensors and one or more other portions of the subject, the motion features including one or more of hands, feet, knees, elbows, head and shoulders;
presenting one or more objects on one or more three dimensional display screens; and
using the plurality of fixed position sensors to track motion of the motion features of the subject and track manipulation of the motion features of the meshed volumetric three-dimensional representation to determine interaction of one or more of the motion features of the subject and one or more of the one or more objects on the three dimensional display.
2 Assignments
0 Petitions
Accused Products
Abstract
A method and system for vision-based interaction in a virtual environment is disclosed. According to one embodiment, a computer-implemented method comprises receiving data from a plurality of sensors to generate a meshed volumetric three-dimensional representation of a subject. A plurality of clusters is identified within the meshed volumetric three-dimensional representation that corresponds to motion features. The motion features include hands, feet, knees, elbows, head, and shoulders. The plurality of sensors is used to track motion of the subject and manipulate the motion features of the meshed volumetric three-dimensional representation.
-
Citations
18 Claims
-
1. A computer-implemented method for tracking movement of motion features of a subject, comprising:
-
receiving data from a plurality of fixed position sensors comprising a distributed network of time of flight camera sensors to generate a volumetric three-dimensional representation of the subject; identifying a plurality of clusters within the volumetric three-dimensional representation that correspond to motion features indicative of movement of the motion features of the subject relative to the fixed position sensors and one or more other portions of the subject, the motion features including one or more of hands, feet, knees, elbows, head and shoulders; presenting one or more objects on one or more three dimensional display screens; and using the plurality of fixed position sensors to track motion of the motion features of the subject and track manipulation of the motion features of the meshed volumetric three-dimensional representation to determine interaction of one or more of the motion features of the subject and one or more of the one or more objects on the three dimensional display. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A non-transitory computer-readable medium having stored thereon a plurality of instructions, the plurality of instructions when executed by a computer, cause the computer to perform:
-
receiving data from a plurality of fixed position sensors comprising a distributed network of time of flight camera sensors to generate a volumetric three-dimensional representation of the subject; identifying a plurality of clusters within the volumetric three-dimensional representation that correspond to motion features indicative of movement of the motion features of the subject relative to the fixed position sensors and one or more other portions of the subject, the motion features including one or more of hands, feet, knees, elbows, head and shoulders; presenting one or more objects on one or more three dimensional display screens; and using the plurality of fixed position sensors to track motion of the motion features of the subject and track manipulation of the motion features of the volumetric three-dimensional representation to determine interaction of one or more of the motion features of the subject and one or more of the one or more objects on the three dimensional display. - View Dependent Claims (13, 14, 15, 16, 17, 18)
-
Specification