Robust user detection and tracking
First Claim
1. A computer-implemented method, comprising:
- determining a portion of image data to initiate detection of one or more representations of an object in the image data based at least in part upon first motion data from at least one inertial sensor;
determining, at a first rate, first position data associated with the object relative to at least one display screen by initiating detection of one or more representations of the object in the portion of the image data;
determining, at a second rate greater than the first rate, second position data associated with the object relative to a latest determined position of the first position data based at least in part upon second motion data from the at least one inertial sensor; and
adjusting content displayed on the at least one display screen in response to determining that a change between a latest determined position of the second position data and a previously determined position of the second position data satisfies a threshold.
1 Assignment
0 Petitions
Accused Products
Abstract
Systems and approaches are provided for robustly detecting and tracking a user. Image data can be captured and processed to provide an estimated position and/or orientation of the user. Other sensor data, such as from an accelerometer and/or gyroscope, can be determined for a more robust estimation of the user'"'"'s position and/or orientation. Multiple user detection processes and/or motion estimation approaches and their corresponding confidence levels can also be combined to determine a final estimated position and orientation of the user. The multiple user pose estimations and/or motion estimations can be combined via an approach such as probabilistic system modeling and maximum likelihood estimation.
-
Citations
21 Claims
-
1. A computer-implemented method, comprising:
-
determining a portion of image data to initiate detection of one or more representations of an object in the image data based at least in part upon first motion data from at least one inertial sensor; determining, at a first rate, first position data associated with the object relative to at least one display screen by initiating detection of one or more representations of the object in the portion of the image data; determining, at a second rate greater than the first rate, second position data associated with the object relative to a latest determined position of the first position data based at least in part upon second motion data from the at least one inertial sensor; and adjusting content displayed on the at least one display screen in response to determining that a change between a latest determined position of the second position data and a previously determined position of the second position data satisfies a threshold. - View Dependent Claims (2, 7, 8, 9, 10, 11)
-
-
3. A non-transitory computer-readable storage medium storing instructions, the instructions, upon being executed by a processor, causing a computing system to:
-
determine a first portion of image data that excludes a representation of an object based at least in part upon first motion data from at least one inertial sensor; determine, at a first rate, first position data associated with the object relative to at least one display screen by analyzing a second portion of the image data that excludes the first portion of the image data; determine, at a second rate, second position data associated with the object relative to a latest determined position of the first position data based at least in part upon second motion data from the at least one inertial sensor; and adjust content displayed on the at least one display screen in response to determining that a change between a latest determined position of the second position data and a previously determined position of the second position data satisfies a threshold. - View Dependent Claims (4, 12, 13, 14, 15, 16)
-
-
5. A computing system, comprising:
-
at least one processor; at least one camera; at least one sensor; at least one display screen; and memory including instructions that, upon being executed by the at least one processor, cause the computing system to; determine a portion of image data, captured by the at least one camera, to initiate detection of one or more representations of an object in the image data based at least in part upon first motion data from the at least one sensor; determine, at a first rate, first position data associated with the object relative to the at least one display screen by initiating detection of one or more representations of the object in the portion of the image data; determine, at a second rate, second position data associated with the object relative to a latest determined position of the first position data based at least in part upon second sensor data from the at least one sensor; and adjust content displayed on the at least one display screen in response to determining that a change between a latest determined position of the second position data and a previously determined position of the second position data satisfies a threshold. - View Dependent Claims (6, 17, 18, 19, 20, 21)
-
Specification