Head pose assessment methods and systems
First Claim
1. A computing device operatively coupled to a display device and an image capturing device, the computing device comprising:
- display logic configured to output at least one signal suitable for causing the display device to display at least two different selectable regions;
interface logic configured to receive image data from the image capturing device; and
pose estimation logic configured to determine a first head pose based on a first image and a second head pose based on a second image temporally subsequent to the first image, switch an operative user input focus between the at least two selectable regions based on at least one difference between the first head pose and the second head pose, and refine the operative user input focus to a previous position of the operative user input focus in a selectable region when the operative user input focus switches to the selectable region.
2 Assignments
0 Petitions
Accused Products
Abstract
Improvements are provided to effectively assess a user'"'"'s face and head pose such that a computer or like device can track the user'"'"'s attention towards a display device(s). Then the region of the display or graphical user interface that the user is turned towards can be automatically selected without requiring the user to provide further inputs. A frontal face detector is applied to detect the user'"'"'s frontal face and then key facial points such as left/right eye center, left/right mouth corner, nose tip, etc., are detected by component detectors. The system then tracks the user'"'"'s head by an image tracker and determines yaw, tilt and roll angle and other pose information of the user'"'"'s head through a coarse to fine process according to key facial points and/or confidence outputs by pose estimator.
24 Citations
20 Claims
-
1. A computing device operatively coupled to a display device and an image capturing device, the computing device comprising:
-
display logic configured to output at least one signal suitable for causing the display device to display at least two different selectable regions; interface logic configured to receive image data from the image capturing device; and pose estimation logic configured to determine a first head pose based on a first image and a second head pose based on a second image temporally subsequent to the first image, switch an operative user input focus between the at least two selectable regions based on at least one difference between the first head pose and the second head pose, and refine the operative user input focus to a previous position of the operative user input focus in a selectable region when the operative user input focus switches to the selectable region. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. An apparatus for use with at least one display device and at least one image capturing device, the apparatus comprising:
-
one or more processing units; instructions integrated with or accessible by the one or more processing units that configure the apparatus to implement; display logic configurable to output at least one signal suitable for causing a display device to display at least two different selectable regions; interface logic configurable to receive image data from an image capturing device; pose estimation logic operatively coupled to the display logic and the interface logic and configured to determine a first head pose based on a first image and a second head pose based on a second image temporally subsequent to the first image, and switch an operative user input focus between the at least two selectable regions based on at least one difference between the first head pose and the second head pose; and programmable filter logic operatively coupled to the display logic and the interface logic and configured to filter the second image with respect to the first image based on a time delay before the switch of the operative user input focus is allowed to occur. - View Dependent Claims (9, 10, 11, 12, 13, 14, 15, 16, 17)
-
-
18. A method comprising:
-
receiving image data from an image capturing device; determining a first head pose based at least in part on a first image and a second head posed based at least in part on a second image temporally subsequent to the first image; storing the first image and the second image in memory, the first image capturing at least a portion of a face of a user at a first time and the second image capturing at least a second portion of the face of the user at a second subsequent time, the first image including a first tracking information associated with at least one point within the portion of the face of the user within the first image, the second image including a second tracking information associated with at least one point with the second portion of the face of the user within the second image; classifying, by one or more processing units, a plurality of portions of the first image based at least in part on a classifying parameter to determine at least one facial region associated with at least one of the plurality of portions of the first image; and switching a user input focus between at least two selectable regions for display on a display device, the switching based at least in part on at a difference between the first head pose and the second head pose. - View Dependent Claims (19, 20)
-
Specification