Tracking head position for rendering content
First Claim
1. A computer-implemented method of rendering content on a display screen of a computing device, comprising:
- under control of a computing device configured with executable instructions,capturing video information using a camera of the computing device;
detecting at least one first feature in the video information indicative of a head of a user;
determining a first relative position of the at least one first feature with respect to the computing device;
rendering the content on the display screen of the computing device to correspond to a viewpoint of the user at the first relative position;
at a first time, predicting that the at least one first feature will be outside a field of view of the camera at a second time based at least in part upon analyzing the video information;
storing to a buffer first motion information obtained from at least one sensor of the computing device from the first time to the second time based at least in part upon predicting that the at least one first feature will be outside the field of view of the camera at the second time;
at the second time, determining that the at least one first feature is outside the field of view of the camera based at least in part upon analyzing the video information;
estimating a second relative position of the at least one first feature with respect to the computing device based at least in part upon where the at least one first feature was last tracked in the video information with at least a minimum level of confidence and a motion of the computing device determined based at least in part upon the first motion information pulled from the buffer and second motion information obtained from the at least one sensor after the second time;
determining an updated viewpoint of the user based at least in part upon the second relative position; and
rendering the content on the display screen to correspond to the updated viewpoint.
1 Assignment
0 Petitions
Accused Products
Abstract
Content displayed on a display element of a computing device can be rendered from a viewpoint that updates with changes in the relative position of a user'"'"'s head, or other such feature, with respect to the device. At least one camera of the device can attempt to track the relative position in order to determine the proper viewpoint. When the user'"'"'s head can no longer be seen, or when confidence in the determined relative position drops below an acceptable value, for example, the device can utilize information from another source, such as a motion or rotation sensor, to attempt to estimate the current position of the user'"'"'s head. Physical limitations of the user with respect to the device also can be used to improve the accuracy of the determination.
-
Citations
19 Claims
-
1. A computer-implemented method of rendering content on a display screen of a computing device, comprising:
under control of a computing device configured with executable instructions, capturing video information using a camera of the computing device; detecting at least one first feature in the video information indicative of a head of a user; determining a first relative position of the at least one first feature with respect to the computing device; rendering the content on the display screen of the computing device to correspond to a viewpoint of the user at the first relative position; at a first time, predicting that the at least one first feature will be outside a field of view of the camera at a second time based at least in part upon analyzing the video information; storing to a buffer first motion information obtained from at least one sensor of the computing device from the first time to the second time based at least in part upon predicting that the at least one first feature will be outside the field of view of the camera at the second time; at the second time, determining that the at least one first feature is outside the field of view of the camera based at least in part upon analyzing the video information; estimating a second relative position of the at least one first feature with respect to the computing device based at least in part upon where the at least one first feature was last tracked in the video information with at least a minimum level of confidence and a motion of the computing device determined based at least in part upon the first motion information pulled from the buffer and second motion information obtained from the at least one sensor after the second time; determining an updated viewpoint of the user based at least in part upon the second relative position; and rendering the content on the display screen to correspond to the updated viewpoint. - View Dependent Claims (2, 3, 4)
-
5. A computer-implemented method of displaying content, comprising:
under control of one or more computing systems configured with executable instructions, capturing image information using a camera of a computing device; analyzing the image information to determine a first relative position of a first feature of a user with respect to the computing device; at a first time, predicting that the first feature of the user will be outside a field of view of the camera at a second time; buffering first motion information obtained from at least one sensor of the computing device from the first time to the second time; at the second time, estimating a second relative position of the first feature with respect to the computing device based at least in part upon where the first feature was last tracked in the image information with at least a minimum level of confidence and a motion of the computing device determined based at least in part upon the first motion information and second motion information obtained from the at least one sensor after the second time; and rendering content on a display element of the computing device to correspond to a viewpoint of the user, the viewpoint being determined based at least in part upon the second relative position of the first feature of the user. - View Dependent Claims (6, 7, 8, 9, 10, 11, 12)
-
13. A computing device, comprising:
-
a processor; a display screen; a camera; a motion sensor; and a memory device including instructions that, upon being executed by the processor, cause the computing device to; capture image information using the camera; analyze the image information to determine a first viewpoint of a user with respect to the computing device; at a first time, predict that a head of the user will be outside a field of view of the camera at a second time; buffer first motion information obtained from the motion sensor from the first time to the second time; at the second time, estimate a second viewpoint of the user with respect to the computing device based at least in part upon where the head of the user was last tracked in the image information with at least a minimum level of confidence and a motion of the computing device determined based at least in part upon the first motion information and second motion information obtained from the motion sensor after the second time; and render content on the display screen to correspond to the second viewpoint of the user. - View Dependent Claims (14, 15)
-
-
16. A non-transitory computer-readable storage medium storing instructions for rendering content for a user viewpoint, the instructions when executed by a processor of a computing system causing the computing system to:
-
capture video information using a camera of a computing device; analyze the video information to determine a first relative viewpoint of a user with respect to the computing device; at a first time, predict that a head of a user will be outside a field of view of the camera at a second time; buffer first motion information obtained from at least one motion sensor of the computing device from the first time to the second time; at the second time, estimate a second relative viewpoint of the user with respect to the computing device based at least in part upon where the head of the user was last tracked in the video information with at least a minimum level of confidence and a motion of the computing device determined based at least in part upon the first motion information and second motion information obtained from the at least one motion sensor after the second time; and render content on a display element of the computing device to correspond to the second relative viewpoint of the user. - View Dependent Claims (17, 18, 19)
-
Specification