Information processing apparatus, system, and method for displaying bio-information or kinetic information

• US 10,262,449 B2
• Filed: 04/06/2018
• Issued: 04/16/2019
• Est. Priority Date: 08/06/2007
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Sano, Akane, Asukai, Masamichi, Ito, Taiji, Sako, Yoichiro
• Primary Examiner(s): McDowell, Jr., Maurice L.
• Assistant Examiner(s): Ricks, Donna J.
• Application Number:
  US15/946,954
• Publication Number:
  US 20180232931A1
• Time in Patent Office: 375 Days
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: A61B 5/0006 ECG or EEG signals
• CPC Class Codes: A61B 5/0008 Temperature signals
• CPC Class Codes: A61B 5/0022 Monitoring a patient using a global network, e.g. telephone networks, internet
• CPC Class Codes: A61B 5/01 Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue clinical contact thermometers G01K13/20
• CPC Class Codes: A61B 5/02055 Simultaneously evaluating both cardiovascular condition and temperature
• CPC Class Codes: A61B 5/021 Measuring pressure in heart or blood vessels A61B5/0205 takes precedence
• CPC Class Codes: A61B 5/024 Detecting, measuring or recording pulse rate or heart rate A61B5/0205, A61B5/021 take precedence
• CPC Class Codes: A61B 5/026 Measuring blood flow A61B3/1233, A61B3/1241 take precedence
• CPC Class Codes: A61B 5/0533 Measuring galvanic skin response
• CPC Class Codes: A61B 5/08 Detecting, measuring or recording devices for evaluating the respiratory organs A61B5/0205 takes precedence
• CPC Class Codes: A61B 5/1118 Determining activity level
• CPC Class Codes: A61B 5/1123 Discriminating type of movement, e.g. walking or running A61B5/1116, A61B5/112 take precedence
• CPC Class Codes: A61B 5/14551 for measuring blood gases
• CPC Class Codes: A61B 5/163 by tracking eye movement, gaze, or pupil change
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety
• CPC Class Codes: A61B 5/318 Heart-related electrical modalities, e.g. electrocardiography [ECG]
• CPC Class Codes: A61B 5/369 Electroencephalography [EEG] devices for psychotechnics A61B5/16
• CPC Class Codes: A61B 5/389 Electromyography [EMG]
• CPC Class Codes: A61B 5/4266 sweat secretion
• CPC Class Codes: A61B 5/742 : using visual displays A61B5/339 takes precedence
• CPC Class Codes: A61B 5/744 : Displaying an avatar, e.g. an animated cartoon character
• CPC Class Codes: G06F 3/015 : Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
• CPC Class Codes: G06T 13/40 : of characters, e.g. humans, animals or virtual beings
• CPC Class Codes: G06T 7/20 : Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06V 40/20 : Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G16H 50/50 : for simulation or modelling of medical disorders
• CPC Class Codes: Y10S 345/95 : Sprite processing

Abstract

An information processing apparatus includes a bio-information obtaining unit configured to obtain bio-information of a subject; a kinetic-information obtaining unit configured to obtain kinetic information of the subject; and a control unit configured to determine an expression or movement of an avatar on the basis of the bio-information obtained by the bio-information obtaining unit and the kinetic information obtained by the kinetic-information obtaining unit and to perform a control operation so that the avatar with the determined expression or movement is displayed.

Claims

1. An information processing method, the method comprising:

receiving kinetic information of a subject;

determining a state of the subject based on the received kinetic information;

performing a control operation using a controller to determine a figure of the subject and subsequently change a representation of the figure to indicate the state of the subject; and

simultaneously displaying, on a map, the figure and position information regarding the subject to a person.

2. The information processing method of claim 1, wherein the method further comprises controlling display, on the map, of the figure at a position corresponding to a position of the subject.

3. The information processing method of claim 1, wherein the method further comprises displaying, on the map, a second figure representing a second subject different than the subject, wherein the second figure indicates a state of the second subject.

4. The information processing method of claim 1, wherein the method further comprises displaying, on the map, time information regarding the subject.

5. The information processing method of claim 1, wherein the method further comprises controlling provision of state history of the subject.

6. The information processing method of claim 1, wherein the method further comprises:

receiving updated kinetic information of the subject;

determining an updated state of the subject based on the updated kinetic information; and

performing a control operation using the controller to change the figure indicating the state of the subject to a figure indicating the updated state of the subject.

7. An information processing apparatus comprising:

circuitry configured to;

receive kinetic information of a subject;

determine a state of the subject based on the received kinetic information;

perform a control operation using a controller to determine a figure of the subject and subsequently change a representation of the figure to indicate the state of the subject; and

simultaneously display, on a map, the figure and position information regarding the subject to a person.

8. The information processing apparatus of claim 7, wherein the circuitry is further configured to control display, on the map, of the figure at a position corresponding to a position of the subject.

9. The information processing apparatus of claim 7, wherein the circuitry is further configured to display, on the map, a second figure representing a second subject different than the subject, wherein the second figure indicates a state of the second subject.

10. The information processing apparatus of claim 7, wherein the circuitry is further configured to display, on the map, time information regarding the subject.

11. The information processing apparatus of claim 7, wherein the circuitry is further configured to control provision of state history of the subject.

12. The information processing apparatus of claim 7, wherein the circuitry is further configured to:

receive updated kinetic information of the subject;

determine an updated state of the subject based on the updated kinetic information; and

perform a control operation using the controller to change the figure indicating the state of the subject to a figure indicating the updated state of the subject.

13. A non-transitory computer readable medium having encoded thereon executable instructions that, when executed by at least one processor, perform a method comprising:

receiving kinetic information of a subject;

determining a state of the subject based on the received kinetic information;

performing a control operation using a controller to determine a figure of the subject and subsequently change a representation of the figure to indicate the state of the subject; and

simultaneously displaying, on a map, the figure and position information regarding the subject to a person.

14. The non-transitory computer readable medium of claim 13, wherein the method further comprises controlling display, on the map, of the figure at a position corresponding to a position of the subject.

15. The non-transitory computer readable medium of claim 13, wherein the method further comprises displaying, on the map, a second figure representing a second subject different than the subject, wherein the second figure indicates a state of the second subject.

16. The non-transitory computer readable medium of claim 13, wherein the method further comprises displaying, on the map, time information regarding the subject.

17. The non-transitory computer readable medium of claim 13, wherein the method further comprises controlling provision of state history of the subject.