Method and device for processing content based on bio-signals

• US 10,366,778 B2
• Filed: 03/30/2016
• Issued: 07/30/2019
• Est. Priority Date: 09/30/2013
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Hwang, Tae-ho, Kim, Mi-young, Hwangbo, Min-su
• Primary Examiner(s): Arani, Taghi T
• Assistant Examiner(s): Champakesanatusptodotgov, Badriodot
• Application Number:
  US15/085,266
• Publication Number:
  US 20160210407A1
• Time in Patent Office: 1,217 Days
• Field of Search: 726 18
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 2218/00 Aspects of pattern recognition specially adapted for signal processing
• CPC Class Codes: G06F 2218/12 Classification; Matching
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: G06V 40/15 Biometric patterns based on physiological signals, e.g. heartbeat, blood flow
• CPC Class Codes: G16B 50/00 ICT programming tools or database systems specially adapted for bioinformatics
• CPC Class Codes: G16B 50/30 Data warehousing; Computing architectures
• CPC Class Codes: G16H 10/60 for patient-specific data, e.g. for electronic patient records
• CPC Class Codes: G16H 50/20 for computer-aided diagnosis, e.g. based on medical expert systems

Abstract

Provided is a method of processing content based on bio-signals, the method includes: acquiring bio-signals of a user; determining a parameter for altering the characteristics of content or determining a type of content to be output, based on the acquired bio-signals; processing the content or determining the type of content to be output, based on the determined parameter; and outputting the processed content or the determined type of content.

Claims

1. A method of processing content based on at least one bio-signal, the method comprising:

outputting a content including at least one from among audio content and image content;

acquiring information related to the at least one bio-signal of a user with respect to the content;

determining a parameter for processing of the content, based on the acquired information related to the at least one bio-signal;

processing the content, based on the determined parameter;

outputting the processed content;

determining a concentration level of the user based on the at least one bio-signal;

obtaining information related to the content while the determined concentration level of the user is less than a reference point; and

providing to the user the obtained information related to the content if the concentration level of the user is greater than or equal to the reference point, or according to a user'"'"'s input.

2. The method of claim 1, wherein the determining of the parameter comprises:

determining at least one selected from a group consisting of a user'"'"'s emotional state, sleep state, stress, workload, and concentration level, based on the acquired information related to at least one bio-signal; and

determining the parameter corresponding to the determined user'"'"'s state.

3. The method of claim 1, wherein the at least one bio-signal comprises a brainwave signal of the user, and

wherein the parameter is determined based on a user'"'"'s state corresponding to at least one property of the brainwave signal in a time or frequency domain.

4. The method of claim 1, wherein the parameter comprises at least one selected from a group consisting of a volume, pitch, playback speed, richness of sound, depth, reverberation, thickness, vibration, sensory effect, surround effect, spatial sense, harmony, chord and accompaniment of the content, a region on a display where the content is displayed, and colors, brightness, contrast, transparency, focus, power supply, and power consumption of the display.

5. The method of claim 1, further comprising:

outputting at least one object for providing a stimulus to the user;

acquiring information related to the at least one bio-signal of the user, which is generated while or after outputting the at least one object;

detecting an object corresponding to a response detected from the at least one bio-signal of the user, from among the at least one object; and

performing a task corresponding to the detected object.

6. The method of claim 1, wherein the information related to the content includes at least one of main details and summary information of the content at a time point when the concentration level of the user decreases to less than the reference point.

7. The method of claim 1, wherein the information related to the content is acquired based on at least one selected from a group consisting of big data, per-minute audience ratings, and basic information related to the content that are acquired from an external server.

8. A device for processing content based on at least one bio-signal, the device comprising:

an outputter configured to output a content including at least one audio content and image content;

a bio-sensor configured to acquire information related to the at least one bio-signal of a user with respect to the content; and

at least one processor configured to determine a parameter for processing of the content based on the acquired information related to the at least one bio-signal and process the content based on the determined parameter;

wherein the outputter is further configured to output the processed content,

wherein the at least one processor is further configured to determine a concentration level of the user based on the acquired information related to the at least one bio-signal and obtain information related to the content while the determined concentration level of the user is less than a reference point, and

wherein the outputter is further configured to provide to the user the obtained information related to the content if the concentration level of the user is greater than or equal to the reference point, or according to a user'"'"'s input.

9. The device of claim 8, wherein the bio-sensor acquires the information related to the at least one bio-signal of the user generated while or after outputting at least one object for providing a stimulus to the user, and

wherein the at least one processor detects an object corresponding to a response detected from the at least one bio-signal of the user, from among the at least one object and performs a task corresponding to the detected object.

10. The device of claim 8, wherein the at least one bio-signal of the user is at least one from among electroencephalogram (EEG), electrooculogram (EOG), electrocardiogram (ECG), electromyogram (EMG), and electrokardiogramm (EKG) signal.