Information processing apparatus, system, and method for displaying bio-information or kinetic information

• US 9,568,998 B2
• Filed: 06/25/2014
• Issued: 02/14/2017
• Est. Priority Date: 08/06/2007
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Sano, Akane, Asukai, Masamichi, Ito, Taiji, Sako, Yoichiro
• Primary Examiner(s): McDowell, Jr., Maurice L
• Assistant Examiner(s): Ricks, Donna J
• Application Number:
  US14/314,385
• Publication Number:
  US 20140306884A1
• Time in Patent Office: 965 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: A61B 5/0006 ECG or EEG signals
• CPC Class Codes: A61B 5/0008 Temperature signals
• CPC Class Codes: A61B 5/0022 Monitoring a patient using a global network, e.g. telephone networks, internet
• CPC Class Codes: A61B 5/01 Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue clinical contact thermometers G01K13/20
• CPC Class Codes: A61B 5/02055 Simultaneously evaluating both cardiovascular condition and temperature
• CPC Class Codes: A61B 5/021 Measuring pressure in heart or blood vessels A61B5/0205 takes precedence
• CPC Class Codes: A61B 5/024 Detecting, measuring or recording pulse rate or heart rate A61B5/0205, A61B5/021 take precedence
• CPC Class Codes: A61B 5/026 Measuring blood flow A61B3/1233, A61B3/1241 take precedence
• CPC Class Codes: A61B 5/0533 Measuring galvanic skin response
• CPC Class Codes: A61B 5/08 Detecting, measuring or recording devices for evaluating the respiratory organs A61B5/0205 takes precedence
• CPC Class Codes: A61B 5/1118 Determining activity level
• CPC Class Codes: A61B 5/1123 Discriminating type of movement, e.g. walking or running A61B5/1116, A61B5/112 take precedence
• CPC Class Codes: A61B 5/14551 for measuring blood gases
• CPC Class Codes: A61B 5/163 by tracking eye movement, gaze, or pupil change
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety
• CPC Class Codes: A61B 5/318 Heart-related electrical modalities, e.g. electrocardiography [ECG]
• CPC Class Codes: A61B 5/369 Electroencephalography [EEG] devices for psychotechnics A61B5/16
• CPC Class Codes: A61B 5/389 Electromyography [EMG]
• CPC Class Codes: A61B 5/4266 sweat secretion
• CPC Class Codes: A61B 5/742 : using visual displays A61B5/339 takes precedence
• CPC Class Codes: A61B 5/744 : Displaying an avatar, e.g. an animated cartoon character
• CPC Class Codes: G06F 3/015 : Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
• CPC Class Codes: G06T 13/40 : of characters, e.g. humans, animals or virtual beings
• CPC Class Codes: G06T 7/20 : Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06V 40/20 : Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G16H 50/50 : for simulation or modelling of medical disorders
• CPC Class Codes: Y10S 345/95 : Sprite processing

Abstract

An information processing apparatus includes a bio-information obtaining unit configured to obtain bio-information of a subject; a kinetic-information obtaining unit configured to obtain kinetic information of the subject; and a control unit configured to determine an expression or movement of an avatar on the basis of the bio-information obtained by the bio-information obtaining unit and the kinetic information obtained by the kinetic-information obtaining unit and to perform a control operation so that the avatar with the determined expression or movement is displayed.

Claims

1. An information processing method comprising:

obtaining bio-information of a subject from a bio-information obtaining sensor;

obtaining kinetic information of the subject from a kinetic information obtaining sensor;

determining a state of the subject based on at least one of the obtained bio-information or the obtained kinetic information; and

performing a control operation using a controller to determine a figure indicating the state of the subject,

wherein performing the control operation further comprises causing display, on a map, of the figure indicating the state of the subject at a position corresponding to a position of the subject, and further causing display, on the map, of a second figure representing a person other than the subject, and

wherein performing the control operation further comprises causing display, simultaneously, of a plurality of time and date information and a plurality of position information regarding the subject.

2. The information processing method according to claim 1, wherein performing the control operation further comprises causing display, on the map, of the second figure at a position corresponding to a position of the person other than the subject.

3. The information processing method according to claim 2, wherein the position corresponding to the position of the subject is obtained from a position information obtaining sensor.

4. The information processing method according to claim 1, wherein the state of the subject is determined based on both the obtained bio-information and the obtained kinetic information.

5. The information processing method according to claim 1, wherein the obtained bio-information includes information representing at least one of pulse rate, heart rate, electrocardiogram, electromyogram, breathing, perspiration, galvanic skin response, blood pressure, saturation of pulse oximetry oxygen, skin surface temperature, brain wave, blood flow change, temperature, or status of eyes.

6. The information processing method according to claim 1, wherein the state of the subject includes an emotion of the subject.

7. The information processing method according to claim 6, wherein the figure includes an avatar having an emotion matching the emotion of the subject.

8. The information processing method according to claim 1, wherein the kinetic information comprises information indicating at least one of a still state, a walking state, a running state, an exercising state, or movement of a body element.

9. An information processing apparatus comprising:

a bio-information obtaining sensor configured to obtain bio-information of a subject;

a kinetic information obtaining sensor configured to obtain kinetic information of the subject; and

circuitry configured to

determine a state of the subject based on at least one of the obtained bio-information or the obtained kinetic information,

perform a control operation to determine a figure indicating the state of the subject,

display, on a map, the figure indicating the state of the subject at a position corresponding to a position of the subject and a second figure representing a person other than the subject; and

display, simultaneously, a plurality of time and date information and a plurality of position information regarding the subject.

10. The information processing apparatus according to claim 9, wherein the circuitry is further configured to cause display, on the map, of the second figure at a position corresponding to a position of the person other than the subject.

11. The information processing apparatus according to claim 10, further comprising a position information obtaining sensor, wherein the position corresponding to the position of the subject is obtained from the position information obtaining sensor.

12. The information processing apparatus according to claim 9, wherein the circuitry is further configured to determine the state of the subject based on both the obtained bio-information and the obtained kinetic information.

13. The information processing apparatus according to claim 9, wherein the obtained bio-information includes information representing at least one of pulse rate, heart rate, electrocardiogram, electromyogram, breathing, perspiration, galvanic skin response, blood pressure, saturation of pulse oximetry oxygen, skin surface temperature, brain wave, blood flow change, temperature, or status of eyes.

14. The information processing apparatus according to claim 9, wherein the state of the subject includes an emotion of the subject.

15. The information processing apparatus according to claim 14, wherein the figure includes an avatar having an emotion matching the emotion of the subject.

16. The information processing apparatus according to claim 9, wherein the kinetic information comprises information indicating at least one of a still state, a walking state, a running state, an exercising state, or movement of a body element.

17. An information processing apparatus comprising:

circuitry configured to;

receive bio-information of a first subject from a bio-information sensor;

receive kinetic information of the first subject from a kinetic information sensor;

determine a state of the first subject based on at least one of the bio-information of the first subject and the kinetic information of the first subject;

perform a control operation to determine a figure indicating the state of the first subject;

display, on a map, the figure indicating the state of the first subject at a position corresponding to a position of the first subject and a second figure representing a second subject different from the first subject; and

display, simultaneously, a plurality of time and date information and a plurality of position information regarding the first subject.

18. A non-transitory computer readable medium having encoded thereon executable instructions that, when executed by at least one processor, perform a method comprising:

receiving bio-information of a first subject from a bio-information sensor;

receiving kinetic information of the first subject from a kinetic information sensor;

determining a state of the first subject based on at least one of the bio-information of the first subject and the kinetic information of the first subject;

performing a control operation to determine a figure indicating the state of the first subject;

displaying, on a map, the figure indicating the state of the first subject at a position corresponding to a position of the first subject and a second figure representing a second subject different from the first subject; and

displaying, simultaneously, a plurality of time and date information and a plurality of position information regarding the first subject.