Method and system for vision-based interaction in a virtual environment
First Claim
1. A computer-implemented method for tracking movement of a subject, comprising:
- receiving data from a plurality of fixed position sensors comprising a distributed network of time of flight camera sensors to generate a volumetric three-dimensional representation of the subject;
identifying a plurality of clusters within the volumetric three-dimensional representation that correspond to features indicative of motion of the subject relative to the fixed position sensors and one or more other portions of the subject;
presenting one or more objects on one or more three dimensional display screens; and
using the plurality of fixed position sensors to track motion of the features of the subject to manipulate the volumetric three-dimensional representation to determine interaction of one or more of the features of the subject and one or more of the one or more objects on one or more of the one or more three dimensional display screens.
2 Assignments
0 Petitions
Accused Products
Abstract
Method, computer program and system for tracking movement of a subject. The method includes receiving data from a plurality of fixed position sensors comprising a distributed network of time of flight camera sensors to generate a volumetric three-dimensional representation of the subject, identifying a plurality of clusters within the volumetric three-dimensional representation that correspond to features indicative of motion of the subject relative to the fixed position sensors and one or more other portions of the subject, and presenting one or more objects on one or more three dimensional display screens. The plurality of fixed position sensors are used to track motion of the features of the subject to manipulate the volumetric three-dimensional representation to determine interaction of one or more of the features of the subject and one or more of the one or more objects on one or more of the one or more three dimensional display screens.
-
Citations
26 Claims
-
1. A computer-implemented method for tracking movement of a subject, comprising:
-
receiving data from a plurality of fixed position sensors comprising a distributed network of time of flight camera sensors to generate a volumetric three-dimensional representation of the subject; identifying a plurality of clusters within the volumetric three-dimensional representation that correspond to features indicative of motion of the subject relative to the fixed position sensors and one or more other portions of the subject; presenting one or more objects on one or more three dimensional display screens; and using the plurality of fixed position sensors to track motion of the features of the subject to manipulate the volumetric three-dimensional representation to determine interaction of one or more of the features of the subject and one or more of the one or more objects on one or more of the one or more three dimensional display screens. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A computer-implemented method for tracking movement of a subject, comprising:
-
receiving data from a plurality of fixed position sensors comprising a distributed network of time of flight camera sensors to identify a plurality of clusters corresponding to features indicative of motion of the subject relative to the fixed position sensors and one or more other clusters; presenting one or more objects on one or more three dimensional display screens; and using the plurality of fixed position sensors to track motion of the features of the subject to determine interaction of one or more of the features of the subject and one or more of the one or more objects on one or more of the one or more three dimensional display screens. - View Dependent Claims (11, 12, 13, 14, 15)
-
-
16. A non-transitory computer-readable medium having stored thereon a plurality of instructions, the plurality of instructions when executed by a computer, cause the computer to perform:
-
receiving data from a plurality of fixed position sensors comprising a distributed network of time of flight camera sensors to generate a volumetric three-dimensional representation of the subject; identifying a plurality of clusters within the volumetric three-dimensional representation that correspond to features indicative of motion of the subject relative to the fixed position sensors and one or more other portions of the subject; presenting one or more objects on one or more three dimensional display screens; and using the plurality of fixed position sensors to track motion of the features of the subject to manipulate the volumetric three-dimensional representation to determine interaction of one or more of the features of the subject and one or more of the one or more objects on one or more of the one or more three dimensional display screens.
-
-
17. A system for tracking motion of a subject, comprising:
-
a plurality of fixed position sensors comprising a distributed network of time of flight camera sensors, at least data received from the plurality of fixed position sensors being used to generate a volumetric three-dimensional representation of the subject; a processor for identifying a plurality of clusters within the volumetric three-dimensional representation that correspond to features indicative of motion of the subject relative to the fixed position sensors and one or more other portions of the subject; and one or more three dimensional display screens for presenting one or more objects thereon; and wherein the plurality of fixed position sensors is used to track motion of the features of the subject to manipulate the volumetric three-dimensional representation, and the processor is used to determine interaction of one or more of the features of the subject and one or more of the one or more objects on the one or more three dimensional display screens. - View Dependent Claims (18, 19, 20, 21, 22, 23, 24, 25, 26)
-
Specification