Information processing apparatus, system, and method for displaying bio-information or kinetic information

• US 10,529,114 B2
• Filed: 03/04/2019
• Issued: 01/07/2020
• Est. Priority Date: 08/06/2007
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Sano, Akane, Asukai, Masamichi, Ito, Taiji, Sako, Yoichiro
• Primary Examiner(s): McDowell, Jr., Maurice L.
• Assistant Examiner(s): Ricks, Donna J.
• Application Number:
  US16/291,792
• Publication Number:
  US 20190197757A1
• Time in Patent Office: 309 Days
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: A61B 5/0006 ECG or EEG signals
• CPC Class Codes: A61B 5/0008 Temperature signals
• CPC Class Codes: A61B 5/0022 Monitoring a patient using a global network, e.g. telephone networks, internet
• CPC Class Codes: A61B 5/01 Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue clinical contact thermometers G01K13/20
• CPC Class Codes: A61B 5/02055 Simultaneously evaluating both cardiovascular condition and temperature
• CPC Class Codes: A61B 5/021 Measuring pressure in heart or blood vessels A61B5/0205 takes precedence
• CPC Class Codes: A61B 5/024 Detecting, measuring or recording pulse rate or heart rate A61B5/0205, A61B5/021 take precedence
• CPC Class Codes: A61B 5/026 Measuring blood flow A61B3/1233, A61B3/1241 take precedence
• CPC Class Codes: A61B 5/0533 Measuring galvanic skin response
• CPC Class Codes: A61B 5/08 Detecting, measuring or recording devices for evaluating the respiratory organs A61B5/0205 takes precedence
• CPC Class Codes: A61B 5/1118 Determining activity level
• CPC Class Codes: A61B 5/1123 Discriminating type of movement, e.g. walking or running A61B5/1116, A61B5/112 take precedence
• CPC Class Codes: A61B 5/14551 for measuring blood gases
• CPC Class Codes: A61B 5/163 by tracking eye movement, gaze, or pupil change
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety
• CPC Class Codes: A61B 5/318 Heart-related electrical modalities, e.g. electrocardiography [ECG]
• CPC Class Codes: A61B 5/369 Electroencephalography [EEG] devices for psychotechnics A61B5/16
• CPC Class Codes: A61B 5/389 Electromyography [EMG]
• CPC Class Codes: A61B 5/4266 sweat secretion
• CPC Class Codes: A61B 5/742 : using visual displays A61B5/339 takes precedence
• CPC Class Codes: A61B 5/744 : Displaying an avatar, e.g. an animated cartoon character
• CPC Class Codes: G06F 3/015 : Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
• CPC Class Codes: G06T 13/40 : of characters, e.g. humans, animals or virtual beings
• CPC Class Codes: G06T 7/20 : Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06V 40/20 : Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G16H 50/50 : for simulation or modelling of medical disorders
• CPC Class Codes: Y10S 345/95 : Sprite processing

Abstract

An information processing apparatus includes a bio-information obtaining unit configured to obtain bio-information of a subject; a kinetic-information obtaining unit configured to obtain kinetic information of the subject; and a control unit configured to determine an expression or movement of an avatar on the basis of the bio-information obtained by the bio-information obtaining unit and the kinetic information obtained by the kinetic-information obtaining unit and to perform a control operation so that the avatar with the determined expression or movement is displayed.

Claims

1. An information processing method, the method comprising:

determining an emotional state of a subject based on at least one of a kinetic information and a biometric information;

determining a figure of a person corresponding to the emotional state of the subject;

displaying the figure of a person to another person; and

displaying time information on a map.

2. The information processing method of claim 1, wherein the method further comprises controlling display of the figure of a person on the map.

3. The information processing method of claim 1, wherein the method further comprises controlling display, on the map, of the figure of a person at a position corresponding to a position of the subject.

4. The information processing method of claim 1, wherein the method further comprises displaying, on the map, a second figure of a person representing a second subject different than the subject, wherein the second figure of a person indicates an emotional state of the second subject.

5. The information processing method of claim 1, wherein the method further comprises displaying, on the map, the time information regarding the subject.

6. The information processing method of claim 1, wherein the method further comprises controlling provision of state history of the subject.

7. The information processing method of claim 1, wherein the method further comprises:

determining an updated emotional state of the subject based on at least one of an updated kinetic information and an updated biometric information;

determining a second figure of a person corresponding to the updated emotional state of the subject; and

displaying the second figure of a person to the another person.

8. An information processing apparatus comprising:

circuitry configured to;

determine an emotional state of a subject based on at least one of a kinetic information and a biometric information;

determine a figure of a person corresponding to the emotional state of the subject;

display the figure of a person to another person; and

display time information on a map.

9. The information processing apparatus of claim 8, wherein the circuitry is further configured to control display of the figure of a person on the map.

10. The information processing apparatus of claim 8, wherein the circuitry is further configured to control display, on the map, of the figure of a person at a position corresponding to a position of the subject.

11. The information processing apparatus of claim 8, wherein the circuitry is further configured to display, on the map, a second figure of a person representing a second subject different than the subject, wherein the second figure of a person indicates an emotional state of the second subject.

12. The information processing apparatus of claim 8, wherein the circuitry is further configured to display, on the map, the time information regarding the subject.

13. The information processing apparatus of claim 8, wherein the circuitry is further configured to control provision of state history of the subject.

14. The information processing apparatus of claim 8, wherein the circuitry is further configured to:

determine an updated emotional state of the subject based on at least one of an updated kinetic information and an updated biometric information;

determine a second figure of a person corresponding to the updated emotional state of the subject; and

display the second figure of a person to the another person.

15. A non-transitory computer readable medium having encoded thereon executable instructions that, when executed by at least one processor, perform a method comprising:

determining an emotional state of a subject based on at least one of a kinetic information and a biometric information;

determining a figure of a person corresponding to the emotional state of the subject;

displaying the figure of a person to another person; and

displaying time information on a map.

16. The non-transitory computer readable medium of claim 15, wherein the method further comprises controlling display of the figure of a person on the map.

17. The non-transitory computer readable medium of claim 15, wherein the method further comprises controlling display, on the map, of the figure of a person at a position corresponding to a position of the subject.

18. The non-transitory computer readable medium of claim 15, wherein the method further comprises displaying, on the map, a second figure of a person representing a second subject different than the subject, wherein the second figure of a person indicates an emotional state of the second subject.

19. The non-transitory computer readable medium of claim 15, wherein the method further comprises displaying, on the map, the time information regarding the subject.

20. The non-transitory computer readable medium of claim 15, wherein the method further comprises controlling provision of state history of the subject.