Information processing apparatus, system, and method for displaying bio-information or kinetic information

• US 9,972,116 B2
• Filed: 12/23/2016
• Issued: 05/15/2018
• Est. Priority Date: 08/06/2007
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Sano, Akane, Asukai, Masamichi, Ito, Taiji, Sako, Yoichiro
• Primary Examiner(s): McDowell, Jr., Maurice L
• Assistant Examiner(s): Ricks, Donna J
• Application Number:
  US15/389,979
• Publication Number:
  US 20170109919A1
• Time in Patent Office: 508 Days
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: A61B 5/0006 ECG or EEG signals
• CPC Class Codes: A61B 5/0008 Temperature signals
• CPC Class Codes: A61B 5/0022 Monitoring a patient using a global network, e.g. telephone networks, internet
• CPC Class Codes: A61B 5/01 Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue clinical contact thermometers G01K13/20
• CPC Class Codes: A61B 5/02055 Simultaneously evaluating both cardiovascular condition and temperature
• CPC Class Codes: A61B 5/021 Measuring pressure in heart or blood vessels A61B5/0205 takes precedence
• CPC Class Codes: A61B 5/024 Detecting, measuring or recording pulse rate or heart rate A61B5/0205, A61B5/021 take precedence
• CPC Class Codes: A61B 5/026 Measuring blood flow A61B3/1233, A61B3/1241 take precedence
• CPC Class Codes: A61B 5/0533 Measuring galvanic skin response
• CPC Class Codes: A61B 5/08 Detecting, measuring or recording devices for evaluating the respiratory organs A61B5/0205 takes precedence
• CPC Class Codes: A61B 5/1118 Determining activity level
• CPC Class Codes: A61B 5/1123 Discriminating type of movement, e.g. walking or running A61B5/1116, A61B5/112 take precedence
• CPC Class Codes: A61B 5/14551 for measuring blood gases
• CPC Class Codes: A61B 5/163 by tracking eye movement, gaze, or pupil change
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety
• CPC Class Codes: A61B 5/318 Heart-related electrical modalities, e.g. electrocardiography [ECG]
• CPC Class Codes: A61B 5/369 Electroencephalography [EEG] devices for psychotechnics A61B5/16
• CPC Class Codes: A61B 5/389 Electromyography [EMG]
• CPC Class Codes: A61B 5/4266 sweat secretion
• CPC Class Codes: A61B 5/742 : using visual displays A61B5/339 takes precedence
• CPC Class Codes: A61B 5/744 : Displaying an avatar, e.g. an animated cartoon character
• CPC Class Codes: G06F 3/015 : Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
• CPC Class Codes: G06T 13/40 : of characters, e.g. humans, animals or virtual beings
• CPC Class Codes: G06T 7/20 : Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06V 40/20 : Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G16H 50/50 : for simulation or modelling of medical disorders
• CPC Class Codes: Y10S 345/95 : Sprite processing

Abstract

An information processing apparatus includes a bio-information obtaining unit configured to obtain bio-information of a subject; a kinetic-information obtaining unit configured to obtain kinetic information of the subject; and a control unit configured to determine an expression or movement of an avatar on the basis of the bio-information obtained by the bio-information obtaining unit and the kinetic information obtained by the kinetic-information obtaining unit and to perform a control operation so that the avatar with the determined expression or movement is displayed.

Claims

1. An information processing apparatus comprising:

circuitry configured to;

receive bio-information of a first subject from a bio-information sensor and kinetic information of the first subject from a kinetic information sensor;

determine a state of the first subject based on at least one of the bio-information of the first subject or the kinetic information of the first subject;

determine a first figure indicating the state of the first subject;

control display, on a map, of the first figure at a position corresponding to a position of the first subject;

control provision of state history data of the first subject; and

simultaneously display time information and position information regarding the first subject.

2. The information processing apparatus according to claim 1, wherein the circuitry is further configured to control provision of position history data of the first subject.

3. The information processing apparatus according to claim 1, wherein the circuitry is further configured to display, on the map, a second figure representing a second subject different from the first subject.

4. The information processing apparatus according to claim 1, wherein simultaneously displaying time information and position information further comprises simultaneously displaying a plurality of time and date information and a plurality of position information regarding the first subject.

5. The information processing apparatus according to claim 1, wherein the state of the first subject includes an emotion of the first subject.

6. The information processing apparatus according to claim 5, wherein the first figure includes an avatar having an emotion matching an emotion of the first subject.

7. The information processing apparatus according to claim 1, wherein the kinetic information indicates at least one of a still state, a walking state, a running state, an exercising state, or movement of a body element.

8. The information processing apparatus according to claim 1, wherein the bio-information includes information representing at least one of pulse rate, heart rate, electrocardiogram, electromyogram, breathing, perspiration, galvanic skin response, blood pressure, saturation of pulse oximetry oxygen, skin surface temperature, brain wave, blood flow change, temperature, or status of eyes.

9. The information processing apparatus according to claim 1, further comprising the bio-information sensor and the kinetic information sensor.

10. The information processing apparatus according to claim 1, wherein the state of the first subject is determined based on both the bio-information and the kinetic information.

11. A non-transitory computer readable medium having encoded thereon executable instructions that, when executed by at least one processor, perform a method comprising:

receiving bio-information of a first subject from a bio-information sensor and kinetic information of the first subject from a kinetic information sensor;

determining a state of the first subject based on at least one of the bio-information of the first subject or the kinetic information of the first subject;

determining a first figure indicating the state of the first subject;

displaying, on a map, the first figure at a position corresponding to a position of the first subject;

controlling provision of state history data of the first subject; and

simultaneously displaying time information and position information regarding the first subject.

12. The non-transitory computer readable medium according to claim 11, wherein the method further comprises controlling provision of position history data of the first subject.

13. The non-transitory computer readable medium according to claim 11, wherein the method further comprises displaying, on the map, a second figure representing a second subject different from the first subject.

14. The non-transitory computer readable medium according to claim 11, wherein displaying time information and position information further comprises simultaneously displaying a plurality of time and date information and a plurality of position information regarding the first subject.

15. The non-transitory computer readable medium according to claim 11, wherein the state of the first subject includes an emotion of the first subject.

16. The non-transitory computer readable medium according to claim 15, wherein the first figure includes an avatar having an emotion matching an emotion of the first subject.

17. The non-transitory computer readable medium according to claim 11, wherein the kinetic information indicates at least one of a still state, a walking state, a running state, an exercising state, or movement of a body element.

18. The non-transitory computer readable medium according to claim 11, wherein the bio-information includes information representing at least one of pulse rate, heart rate, electrocardiogram, electromyogram, breathing, perspiration, galvanic skin response, blood pressure, saturation of pulse oximetry oxygen, skin surface temperature, brain wave, blood flow change, temperature, or status of eyes.

19. The non-transitory computer readable medium according to claim 11, wherein receiving the bio-information and the kinetic information further comprises receiving the bio-information and the kinetic information over a network from a server that stores the bio-information and the kinetic information in association with information identifying the first subject.

20. The non-transitory computer readable medium according to claim 11, wherein the state of the first subject is determined based on both the bio-information and the kinetic information.