SYSTEMS AND METHODS FOR AUTOMATICALLY ADJUSTING AUDIO BASED ON GAZE POINT

• US 20140176813A1
• Filed: 12/21/2012
• Published: 06/26/2014
• Est. Priority Date: 12/21/2012
• Status: Active Grant

• Current Assignee: UV Corporation (Adeia Inc.)
• Original Assignee: United Video Properties Incorporated (Adeia Inc.)
• Inventors: Woods, Thomas, Bullwinkle, Richard, Oh, Minah, Conness, Jason W., Golyshko, Phil, Jambhekar, Shrirang Nilkanth, Grefalda, Melvin
• Granted Patent: US 8,854,447 B2
• Time in Patent Office: Days
• US Class Current: 348/738
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G06V 40/18 Eye characteristics, e.g. of the iris
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: H04N 21/422 Input-only peripherals , i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] input devices also receiving signals from specially adapted client devices H04N21/4104
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/439 Processing of audio elementary streams
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/485 End-user interface for client configuration
• CPC Class Codes: H04N 21/4884 for displaying subtitles
• CPC Class Codes: H04N 5/60 for the sound signals

Abstract

Embodiments provide methods and systems for adjusting audio output based on eye tracking input. In some embodiments, a memory stores data defining a boundary based on a coordinate system. The boundary corresponds to a display element of displayed content. An input receives data indicating coordinates of a gaze point location of a user viewing the displayed content. A processor compares the received coordinates of the gaze point location to the boundary corresponding to the display element to determine whether the gaze point location is inside the boundary corresponding to the display element. In response to determining that the gaze point location is inside the boundary corresponding to the display element, the processor adjusts an audio setting of the displayed content.

Claims

1. A system for adjusting audio output based on eye tracking input, the system comprising:

a memory storing data defining a boundary based on a coordinate system, the boundary corresponding to a first display element of displayed content;

an input configured to receive data indicating coordinates of a gaze point location of a user viewing the displayed content; and

a processor configured to;

compare the received coordinates of the gaze point location to the boundary corresponding to the first display element to determine whether the gaze point location is inside the boundary corresponding to the first display element; and

in response to determining that the gaze point location is outside the boundary corresponding to the first display element, present audio corresponding to a second display element of the displayed content more prominently than audio of the first display element.

2. The system of claim 1, wherein the processor is further configured to:

select a first audio track associated with the second display element from a plurality of audio tracks associated with the displayed content in response to determining that the gaze point location is outside the boundary corresponding to the first display element; and

present the selected first audio track instead of a second of the plurality of audio tracks that is associated with the first display element.

3. The system of claim 2, wherein the processor is further configured to:

adjust at least one additional audio track associated with the displayed content.

4. The system of claim 1, wherein the processor is further configured to simultaneously present the audio corresponding to the second display element and the audio corresponding to the first display element such that the audio corresponding to the first display element is at a volume level that is lower than a volume level of the audio corresponding to the second display element.

5. The system of claim 1, wherein the processor is further configured to:

select an audio track to accompany the content from a plurality of audio tracks associated with the displayed content.

6. The system of claim 1, the system further comprising an eye tracker configured to:

determine a gaze point of a user;

determine coordinates of a location on the display that the gaze point corresponds to; and

transmit data indicating the coordinates of the gaze point location on the display to the input.

7. The system of claim 1, wherein the processor is further configured to simultaneously adjust an image of the displayed content in response to determining that the gaze point location is outside the boundary corresponding to the first display element.

8. The system of claim 1, wherein the processor is further configured to:

bringing the second display element into focus; and

bringing at least one other display element out of focus.

9. The system of claim 1, wherein the processor is further configured to display closed captioning in response to determining that the gaze point location is outside the boundary corresponding to the first display element.

10. The system of claim 1, wherein the processor is further configured to adjust the audio setting associated with the displayed content based on a duration of the user'"'"'s gaze on the first display element.

11. A method for adjusting audio output based on eye tracking input, the method comprising:

storing data defining a boundary based on a coordinate system, the boundary corresponding to a first display element of displayed content;

receiving data indicating coordinates of a gaze point location of a user viewing the displayed content;

comparing, using control circuitry, the received coordinates of the gaze point location to the boundary corresponding to the first display element to determine whether the gaze point location is inside the boundary corresponding to the first display element; and

in response to determining that the gaze point location is outside the boundary corresponding to the first display element, presenting, using control circuitry, audio corresponding to a second display element of the displayed content more prominently than audio of the first display element.

12. The method of claim 11, wherein adjusting the audio setting of the displayed content comprises:

selecting a first audio track associated with the second display element from a plurality of audio tracks associated with the displayed content in response to determining that the gaze point location is outside the boundary corresponding to the first display element; and

presenting the selected first audio track instead of a second of the plurality of audio tracks that is associated with the first display element.

13. The method of claim 12, further comprising:

adjusting at least one additional audio track associated with the displayed content.

14. The method of claim 11 further comprising simultaneously presenting the audio corresponding to the second display element and the audio corresponding to the first display element such that the audio corresponding to the first display element is at a volume level that is lower than a volume level of the audio corresponding to the second display element.

15. The method of claim 11, wherein adjusting the audio setting of the displayed content comprises:

selecting an audio track to accompany the displayed content from a plurality of audio tracks associated with the displayed content.

16. The method of claim 11, further comprising:

determining a gaze point of a user;

determining coordinates of a location on the display that the gaze point corresponds to; and

transmitting data indicating the coordinates of the gaze point location on the display to the input.

17. The method of claim 11, further comprising:

simultaneously adjusting an image of the displayed content in response to determining that the gaze point location is outside the boundary corresponding to the first display element.

18. The method of claim 11, wherein adjusting the image comprises:

bringing the second display element into focus; and

bringing at least one other display element out of focus.

19. The method of claim 11, further comprising:

displaying closed captioning in response to determining that the gaze point location is outside the boundary corresponding to the first display element.

20. The method of claim 11, further comprising:

adjusting the audio setting associated with the content based on a duration of the user'"'"'s gaze on the first display element.

21-30. -30. (canceled)