Methods and systems for monitoring attentiveness of a user based on brain activity

• US 10,271,087 B2
• Filed: 09/26/2013
• Issued: 04/23/2019
• Est. Priority Date: 07/24/2013
• Status: Active Grant

• Current Assignee: ROVI Product Corporation (Xperi Inc.)
• Original Assignee: Rovi Guides, Inc. (Adeia Inc.)
• Inventors: Klappert, Walter R., Nichols, Michael R., Shimy, Camron, Wagner, William, Chen, Yinghsueh (Annie), Stathacopoulos, Paul T.
• Primary Examiner(s): Monshi, Samira
• Application Number:
  US14/038,171
• Publication Number:
  US 20150033245A1
• Time in Patent Office: 2,035 Days
• Field of Search: None
• CPC Class Codes: A61B 5/1103 Detecting eye twinkling
• CPC Class Codes: A61B 5/369 Electroencephalography [EEG] devices for psychotechnics A61B5/16
• CPC Class Codes: A61B 5/375 using biofeedback
• CPC Class Codes: A61B 5/389 Electromyography [EMG]
• CPC Class Codes: A61B 5/398 Electrooculography [EOG], e.g. detecting nystagmus; Electroretinography [ERG]
• CPC Class Codes: A61B 5/486 Bio-feedback A61B5/375 takes precedence
• CPC Class Codes: A61B 5/6803 Head-worn items, e.g. helmets, masks, headphones or goggles
• CPC Class Codes: A61B 5/7246 using correlation, e.g. template matching or determination of similarity
• CPC Class Codes: A61B 5/7264 Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems neural networks per se G06N3/00; expert systems per se G06N5/00
• CPC Class Codes: G06F 3/015 Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
• CPC Class Codes: H04N 21/41265 having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/42201 biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user input arrangements for interaction with the human body based on nervous system activity detection G06F3/015
• CPC Class Codes: H04N 21/42206 characterized by hardware details
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
• CPC Class Codes: H04N 21/4314 for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/4333 Processing operations in response to a pause request
• CPC Class Codes: H04N 21/4334 Recording operations recording of a television signal H04N5/76; arrangements for recording or accumulating broadcast information or broadcast-related information H04H60/27
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/443 OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
• CPC Class Codes: H04N 21/4436 : Power management, e.g. shutting down unused components of the receiver power management in computer systems G06F1/3203; hibernate or awake process in computer systems G06F9/4418
• CPC Class Codes: H04N 21/4668 : for recommending content, e.g. movies
• CPC Class Codes: H04N 21/482 : End-user interface for program selection broadcast systems using EPGs H04H60/72
• CPC Class Codes: H04N 21/4852 : for modifying audio parameters, e.g. switching between mono and stereo

Abstract

Methods and systems are disclosed herein for a media guidance application configured to monitor attentiveness of a user based on the brain activity of the user. For example, a media guidance application may monitor brain activity associated with an attentiveness level of the user and in response to determining the attentiveness level of the user does not correspond to the threshold attentiveness level, perform an operation associated with a low attentiveness level of the user (e.g., performing a scan operation through various content providers).

Claims

1. A method of performing an operation of a media guidance application in response to activity of a brain of a user, the method comprising:

monitoring brain activity in a first region of the brain of the user, wherein the first region is associated with controlling eye blinking;

detecting a first eye blink pattern of the user in the first region of the brain of the user, wherein the first eye blink pattern begins with an eye blink;

in response to detecting the first eye blink pattern, initiating monitoring of brain activity in a second region of the brain of the user, wherein the second region is associated with an attentiveness level of the user;

cross-referencing the brain activity associated with the attentiveness level of the user with a database associated with attentiveness levels and corresponding brain activity to determine the attentiveness level of the user;

comparing the attentiveness level of the user to a threshold attentiveness level;

determining, based on the comparing, that the user has a low attentiveness level when the attentiveness level of the user is below the threshold attentiveness level; and

in response to determining that the user has the low attentiveness level, performing an operation that simultaneously executes a media guidance function and generates for display an icon on a display screen that provides feedback to the user related to the brain activity of the user and instructs the user to increase the attentiveness level of the user in order to halt execution of the media guidance function.

2. The method of claim 1, further comprising halting performance of the operation in response to detecting a second eye blink pattern.

3. The method of claim 1, wherein the first eye blink pattern comprises at least one eye blink.

4. The method of claim 1, wherein monitoring the brain activity of the user further comprises receiving data from an electroencephalogram unit indicating a first frequency range of the brain activity of the user or receiving data from an electromyogram unit indicating first electrical activity of muscles near the brain of the user at rest and during contraction.

5. The method of claim 4, wherein the electroencephalogram unit or the electromyogram unit is incorporated into a mobile headset, wherein the mobile headset is battery powered.

6. The method of claim 4, further comprising:

cross-referencing the first frequency range of the brain activity of the user with a database associated with frequencies of brain states to determine the brain activity associated with an attentiveness level of the user or cross-referencing the first electrical activity of the muscles near the brain of the user with a database associated with electrical activity of brain states to determine the brain activity associated with an attentiveness level of the user.

7. The method of claim 1, wherein the operation further includes a navigation command, a fast-access playback command, a selection command, or a settings command.

8. The method of claim 1, further comprising generating for display a plurality of media listings in response to detecting the first eye blink pattern, wherein the operation includes navigating the plurality of media listings based on time or media provider.

9. The method of claim 8, further comprising selecting one of the plurality of media listings in response to determining the attentiveness level of the user satisfies the threshold attentiveness level while performing the operation.

10. A system of performing an operation of a media guidance application in response to activity of a brain of a user, the system comprising

user input circuitry;

and

control circuitry configured to;

monitor brain activity in a first region of the brain of the user, wherein the first region is associated with controlling eye blinking;

detect, using the user input circuitry, a first eye blink pattern of the user in the first region of the brain of the user, wherein the first eye blink pattern begins with an eye blink;

in response to detecting the first eye blink pattern, initiate monitoring of brain activity in a second region of the brain of the user, wherein the second region is associated with an attentiveness level of the user;

cross-reference the brain activity associated with the attentiveness level of the user with a database associated with attentiveness levels and corresponding brain activity to determine the attentiveness level of the user;

compare the attentiveness level of the user to a threshold attentiveness level;

determine, based on the comparing, that the user has a low attentiveness level when the attentiveness level of the user is below the threshold attentiveness level; and

in response to determining that the user has the low attentiveness level, perform an operation that simultaneously executes a media guidance function and generates for display an icon on a display screen that provides feedback to the user related to the brain activity of the user and instructs the user to increase the attentiveness level of the user in order to halt execution of the media guidance function.

11. The system of claim 10, wherein the control circuitry is further configured to halt performance of the operation in response to detecting a second eye blink pattern.

12. The system of claim 10, wherein the first eye blink pattern comprises at least one eye blink.

13. The system of claim 10, wherein the control circuitry configured to monitor the brain activity of the user is further configured to receive data from an electroencephalogram unit indicating a first frequency range of the brain activity of the user or receive data from an electromyogram unit indicating first electrical activity of muscles near the brain of the user at rest and during contraction.

14. The system of claim 13, wherein the electroencephalogram unit or the electromyogram unit is incorporated into a mobile headset, wherein the mobile headset is battery powered.

15. The system of claim 13, wherein the control circuitry is further configured to:

cross-reference the first frequency range of the brain activity of the user with a database associated with frequencies of brain states to determine the brain activity associated with an attentiveness level of the user or cross-reference the first electrical activity of the muscles near the brain of the user with a database associated with electrical activity of brain states to determine the brain activity associated with an attentiveness level of the user.

16. The system of claim 10, wherein the operation further includes a navigation command, a fast-access playback command, a selection command, or a settings command.

17. The system of claim 10, wherein the control circuitry is further configured to generate for display a plurality of media listings in response to detecting the first eye blink pattern, wherein the operation includes navigating the plurality of media listings based on time or media provider.

18. The system of claim 17, wherein the control circuitry is further configured to select one of the plurality of media listings in response to determining the attentiveness level of the user satisfies the threshold attentiveness level while performing the operation.