Automated video content display control using eye detection

• US 10,667,007 B2
• Filed: 01/22/2014
• Issued: 05/26/2020
• Est. Priority Date: 01/22/2014
• Status: Active Grant

• Current Assignee: Lenovo PC International Limited (Lenovo Group Ltd.)
• Original Assignee: Lenovo Singapore Pte Limited (Lenovo Group Ltd.)
• Inventors: Robinson, Douglas Warren
• Primary Examiner(s): Schnurr, John R
• Application Number:
  US14/161,214
• Publication Number:
  US 20150208125A1
• Time in Patent Office: 2,316 Days
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4333 Processing operations in response to a pause request
• CPC Class Codes: H04N 21/4334 Recording operations recording of a television signal H04N5/76; arrangements for recording or accumulating broadcast information or broadcast-related information H04H60/27
• CPC Class Codes: H04N 21/439 Processing of audio elementary streams
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/4436 Power management, e.g. shutting down unused components of the receiver power management in computer systems G06F1/3203; hibernate or awake process in computer systems G06F9/4418

Abstract

An embodiment provides a method, including: capturing, with an image sensor, an image of a user; detecting, using a processor, at least one open eye of the user within the image; and responsive to said detecting, maintaining display of video content for a predetermined time. Other aspects are described and claimed.

Claims

1. A method, comprising:

capturing, with an image sensor, an image of a plurality of users, wherein the capturing is performed according to a timing policy, wherein the timing policy is tuned by a user;

detecting, using a processor, at least one eye of more than one of the plurality of users within the image, wherein the detecting comprises estimating, using an eye tracking system, a focal point of the user, wherein a sensitivity of the detecting is tuned by the user;

performing a predetermined action based upon a current state of the at least one eye of the more than one of the plurality of users, wherein the predetermined action to be performed is selected from a plurality of predetermined actions, wherein the predetermined action to be performed is based upon a length of time that has elapsed between a previous state of the at least one eye and the current state of the at least one eye, wherein the current state is different than the previous state and wherein the predetermined action is selected by the user;

the performing a predetermined action comprising maintaining display of video content based upon the state of the at least one eye being open and marking, based upon the state of the at least one eye being not open, a position of the video content in cache and transferring contents of the cache to non-volatile memory, and performing an additional predetermined action selected from the group consisting of;

pausing the video content, stopping the video content, adjusting a volume of audio associated with the video content, powering off a device displaying the video content, and continuing the video content for a predetermined time; and

resuming the video content from the position upon detecting an active viewer.

2. The method of claim 1, wherein the predetermined action performed comprises initiating storage of video content.

3. The method of claim 1, wherein the predetermined action performed comprises at least one of pausing display of video content and stopping display of video content.

4. The method of claim 1, wherein said performing a predetermined action is selected from the group consisting of:

raising the volume of audio associated with display of video content, and lowering the volume of audio associated with display of video content.

5. The method of claim 1, wherein the predetermined action performed comprises marking a position of video content.

6. The method of claim 5, wherein the position marked is associated with a last successful detection of the state of the at least one eye of the user is open.

7. The method of claim 5, wherein the predetermined action performed comprises storing in memory video content associated with said position marked.

8. The method of claim 5, further comprising displaying video content at said marked position responsive to a detection selected from the group consisting of detecting at least one user eye and detecting a user override event.

9. The method of claim 1, wherein the predetermined action performed comprises transferring video content from volatile memory to non-volatile memory.

11. The method of claim 1, wherein the performing a predetermined action comprises performing a predetermined action a predetermined time after a last successful detection of at least one eye open of the user.

12. The method of claim 1, wherein the predetermined action performed is selected from the group consisting of:

powering off a device and adjusting a volume of audio associated with display of video content.

13. The method of claim 1, wherein the performed action is further based upon a length of time of not detecting that the state of the at least one eye of the user is open.

14. The method of claim 1, wherein the detecting occurs at a predetermined frequency selected by the user.

15. The method of claim 1, wherein a user provides input configuring at least one parameter selected from the group consisting of:

a performed predetermined action, a sensitivity of the detecting, and a length of time of not detecting that the state of the at least one eye of the user is open for performing a particular predetermined action.

10. The method of 9, wherein the predetermined action performed comprises marking a position of video content.

16. An information handling device, comprising:

an image sensor;

a processor operatively coupled to the image sensor; and

a memory device storing instructions executable by the processor to;

capture, with the image sensor, an image of a plurality of users, wherein the capturing is performed according to a timing policy, wherein the timing policy is tuned by a user;

detect at least one eye of more than one of the plurality of users within the image, wherein to detect comprises to estimate, using an eye tracking system, a focal point of the user, wherein a sensitivity of the detecting is tuned by the user;

perform a predetermined action based upon a current state of the at least one eye of the more than one of the plurality of users, wherein the predetermined action to be performed is selected from a plurality of predetermined actions, wherein the predetermined action to be performed is based upon a length of time that has elapsed between a previous state of the at least one eye and the current state of the at least one eye, wherein the current state is different than the previous state and wherein the predetermined action is selected by the user;

to perform a predetermined action comprising maintaining display of video content based upon the state of the at least one eye being open and marking, based upon the state of the at least one eye being not open, a position of the video content in cache and transferring contents of the cache to non-volatile memory, and performing an additional predetermined action selected from the group consisting of;

pausing the video content, stopping the video content, adjusting a volume of audio associated with the video content, powering off a device displaying the video content, and continuing the video content for a predetermined time; and

resume the video content from the position upon detecting an active viewer.

17. The information handling device of claim 16, wherein said performing a predetermined action is selected from the group of consisting of:

raising the volume of audio associated with display of video content, and lowering the volume of audio associated with display of video content.

18. The information handling device of claim 16, wherein the predetermined action performed comprises marking a position of video content.

19. The information handling device of claim 18, wherein the position marked is associated with a last successful detection of the state of the at least one eye of the user is open.

20. The information handling device of claim 18, wherein the instructions are further executable by the processor to display video content at said marked position responsive to a detection selected from the group consisting of:

detecting at least one user eye, and detecting a user override event.

21. The information handling device of claim 16, wherein the predetermined action performed comprises transferring video content from volatile memory to non-volatile memory, and further wherein the predetermined action performed comprises marking a position of video content.

22. The information handling device of claim 16, wherein the performing a predetermined action comprises performing a predetermined action a predetermined time after a last successful detection of at least one eye open of the user.

23. An information handling device, comprising:

a display device;

a processor operatively coupled to the display device; and

a memory device storing instructions executable by the processor to;

track a user gaze associated with each of a plurality of users, the user gaze indicating that at least one open eye of at least one of the plurality of users is viewing the display device, wherein to track comprises to estimate, using an eye tracking system, a focal point of the user, wherein the tracking is performed according to a timing policy, wherein both the timing policy and a sensitivity of the tracking are tuned by a user;

responsive to tracking the user gaze, maintain display of video content;

detect that none of the plurality of users are viewing the display device based upon tracking the user gaze of the plurality of users; and

perform a predetermined action based upon the plurality of users not viewing the display device, wherein the predetermined action to be performed is selected from a plurality of predetermined actions, wherein the predetermined action to be performed is based upon the length of time that has elapsed between at least one of the plurality of users viewing the display device and no user viewing the display device wherein the predetermined action comprises marking a position of the video content in cache and transferring contents of the cache to non-volatile memory and performing an additional predetermined action and wherein the additional predetermined action is selected by the user and wherein the additional predetermined action is selected from the group consisting of;

pausing the video content, stopping the video content, adjusting a volume of audio associated with the video content, powering off a device displaying the video content, and continuing the video content for a predetermined time; and

resume the video content from the position upon detecting an active viewer.

24. The information handling device of claim 23, wherein the instructions are further executable by the processor to perform a predetermined action a predetermined time after a last successful detection of at least one open eye of the user.

25. A method, comprising:

capturing, with an image sensor, an image of a plurality of users viewing a display device, wherein the capturing is performed according to a timing policy, wherein the timing policy is tuned by a user;

thereafter detecting, using a processor, that no user captured within the image is viewing the display device, wherein the detecting occurs at a predetermined frequency selected by the user, wherein the detecting comprises estimating, using an eye tracking system, a focal point of the user, wherein a sensitivity of the detecting is tuned by the user;

responsive to said detecting no user is viewing the display device, performing a predetermined action to be performed is selected from a plurality of predetermined actions, wherein the predetermined action to be performed is selected by the user and is based upon a length of time that has elapsed between at least one of the plurality of users viewing the display device and no user viewing the display device, wherein the predetermined action comprises marking a position of the video content in cache and transferring contents of the cache to non-volatile memory, and performing an additional predetermined action selected from the group consisting of;

pausing the video content, stopping the video content, adjusting a volume of audio associated with the video content, powering off a device displaying the video content, and continuing the video content for a predetermined time; and

resuming the video content from the position upon detecting an active viewer.