INFORMATION PROCESSING SYSTEM AND INFORMATION PROCESSING APPARATUS

• US 20160317074A1
• Filed: 07/15/2016
• Published: 11/03/2016
• Est. Priority Date: 01/17/2014
• Status: Abandoned Application

• Current Assignee: Nintendo Company Limited
• Original Assignee: Nintendo Company Limited
• Inventors: KAWAI, Eizi, KAMINOSONO, Takuya
• Application Number:
  US15/211,387
• Publication Number:
  US 20160317074A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: A47C 31/00 Details or accessories for chairs, beds, or the like, not provided for in other groups of this subclass, e.g. upholstery fasteners, mattress protectors, stretching devices for mattress nets
• CPC Class Codes: A61B 2560/0242 adapted to measure environmental factors, e.g. temperature, pollution
• CPC Class Codes: A61B 5/0022 Monitoring a patient using a global network, e.g. telephone networks, internet
• CPC Class Codes: A61B 5/0205 Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
• CPC Class Codes: A61B 5/024 Detecting, measuring or recording pulse rate or heart rate A61B5/0205, A61B5/021 take precedence
• CPC Class Codes: A61B 5/08 Detecting, measuring or recording devices for evaluating the respiratory organs A61B5/0205 takes precedence
• CPC Class Codes: A61B 5/11 Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb for measuring pulse A61B5/02 ;A61B5/1038 takes precedence; motion detection to correct for motion artifacts in physiological signals A61B5/721
• CPC Class Codes: A61B 5/1118 Determining activity level
• CPC Class Codes: A61B 5/16 Devices for psychotechnics using teaching or educational appliances G09B1/00 - G09B7/00; Testing reaction times ; Devices for evaluating the psychological state
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety
• CPC Class Codes: A61B 5/4806 Sleep evaluation A61B5/4821 takes precedence; devices for inducing sleep A61M21/02
• CPC Class Codes: A61B 5/4809 Sleep detection, i.e. determining whether a subject is asleep or not
• CPC Class Codes: A61B 5/4812 Detecting sleep stages or cycles
• CPC Class Codes: A61B 5/486 Bio-feedback A61B5/375 takes precedence
• CPC Class Codes: A61B 5/7271 Specific aspects of physiological measurement analysis A61B5/316, A61B5/349 and A61B5/374 take precedence
• CPC Class Codes: A61B 5/7405 using sound
• CPC Class Codes: A61B 5/742 using visual displays A61B5/339 takes precedence
• CPC Class Codes: A63F 13/212 using sensors worn by the player, e.g. for measuring heart beat or leg activity
• CPC Class Codes: G06F 16/2228 Indexing structures
• CPC Class Codes: G06Q 20/10 specially adapted for electronic funds transfer [EFT] systems; specially adapted for home banking systems
• CPC Class Codes: G06Q 30/02 : Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/0641 : Shopping interfaces
• CPC Class Codes: G06Q 50/22 : Social work or social welfare, e.g. community support activities or counselling services
• CPC Class Codes: G16H 10/20 : for electronic clinical trials or questionnaires
• CPC Class Codes: G16H 10/60 : for patient-specific data, e.g. for electronic patient records
• CPC Class Codes: G16H 20/30 : relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
• CPC Class Codes: G16H 40/63 : for local operation
• CPC Class Codes: G16H 40/67 : for remote operation
• CPC Class Codes: G16H 50/20 : for computer-aided diagnosis, e.g. based on medical expert systems
• CPC Class Codes: G16H 50/30 : for calculating health indices; for individual health risk assessment
• CPC Class Codes: G16H 50/70 : for mining of medical data, e.g. analysing previous cases of other patients
• CPC Class Codes: H04N 9/3179 : Video signal processing therefor
• CPC Class Codes: H04N 9/3182 : Colour adjustment, e.g. white balance, shading or gamut white balance per se H04N9/73; control of amplitude of colour signals H04N9/68; colour control circuits for displays in general G09G5/02, G09G3/2003, G09G3/3607
• CPC Class Codes: H04N 9/3194 : including sensor feedback

Abstract

An example of an information processing system includes a hand-held terminal. The hand-held terminal senses sensor information for determining an emotion of a user. The sensor information may be, for example, information of a sound sensed by a microphone, or information of an image captured by a camera. The information processing system determines the emotion of the user on the basis of the sensor information. The hand-held terminal senses the sensor information in a period during which the hand-held terminal is in a standby state. The standby state is, for example, a state in which a display of the hand-held terminal is turned off.

Claims

1. An information processing system comprising a hand-held terminal,

the hand-held terminal including sensing means for sensing sensor information for determining an emotion of a user,

the information processing system comprising emotion determining means for determining the emotion of the user on the basis of the sensor information, and

the sensing means sensing the sensor information in a period during which the hand-held terminal is in a standby state.

2. The information processing system according to claim 1, wherein

the hand-held terminal includes:

information acquisition means for acquiring user-related information different from the sensor information and related to the user; and

sensing control means for controlling, on the basis of the user-related information, whether or not to perform sensing of the sensor information.

3. The information processing system according to claim 2, wherein

the information acquisition means acquires, as the user-related information, information representing behavior and/or activity of the user.

4. The information processing system according to claim 2, wherein

the hand-held terminal further includes period judgment means for judging, on the basis of the user-related information, whether or not the current time is in a period during which a predetermined event related to the user is performed, and

the sensing means senses the sensor information in the period during which the predetermined event is performed.

5. The information processing system according to claim 1, wherein

the sensing means is operable in at least a first sensing mode for sensing the sensor information at a relatively long time interval, and a second sensing mode for sensing the sensor information at a relatively short time interval or continuously,

the hand-held terminal includes sensing control means for switching an operation mode of the sensing means to the second sensing mode when the sensor information sensed in the first sensing mode satisfies a predetermined condition, and

the emotion determining means determines the emotion of the user on the basis of the sensor information sensed in the second mode.

6. The information processing system according to claim 1, wherein

the hand-held terminal further includes operation judgment means for judging whether or not the user is operating the hand-held terminal, and

the sensing means senses the sensor information when the operation judgment means judges that the user is operating the hand-held terminal.

7. The information processing system according to claim 1, wherein

the emotion determining means successively determines the emotion of the user on the basis of the sensor information successively sensed by the sensing means, and

the information processing system further comprises presentation means for successively presenting the user with a determination result of the emotion.

23. The information processing system according to claim 1, wherein

the sensing means includes a microphone, and

the emotion determining means determines the emotion of the user on the basis of a sound sensed by the microphone.

24. The information processing system according to claim 23, wherein

the sensing means identifies voice of the user included in the sound sensed by the microphone, and

the emotion determining means determines the emotion of the user on the basis of the voice of the user.

25. The information processing system according to claim 23, wherein

the sensing means identifies voice of a person other than the user, which voice is included in the sound sensed by the microphone, and

the emotion determining means determines the emotion of the user on the basis of the voice of the other person.

26. The information processing system according to claim 23, wherein

the emotion determining means determines the emotion of the user in accordance with surrounding atmosphere of the user, on the basis of the sound sensed by the microphone.

27. The information processing system according to claim 1, wherein

the sensing means includes a camera, and

the emotion determining means determines the emotion of the user on the basis of an image of a face of the user captured by the camera.

8. An information processing system, comprising:

sensing means for sensing sensor information for determining an emotion of a user;

emotion determining means for determining the emotion of the user on the basis of the sensor information;

life information acquisition means for acquiring life information obtained by observing life of the user; and

process execution means for executing a predetermined process on the basis of the determination result of the emotion, and the life information.

9. The information processing system according to claim 8, wherein

the process execution means executes, as the predetermined process, a process of calculating an index indicating the state of the user on the basis of the determination result of the emotion and the life information.

10. The information processing system according to claim 8, wherein

the process execution means executes, as the predetermined process, a process of generating suggestion information for performing suggestion to the user, on the basis of the determination result of the emotion and the life information, and presenting the user with the suggestion information.

11. The information processing system according to claim 8, wherein

the process execution means includes:

sensing control means for controlling, on the basis of the life information, whether or not to perform sensing of the sensor information, and

index calculation means for calculating, on the basis of the sensor information, an index indicating the state of the user.

12. The information processing system according to claim 11, further comprising period judgment means for judging, on the basis of the life information, whether or not the current is in a period during which a predetermined event related to the user is performed, and

the sensing control means causes the sensing means to sense the sensor information in the period during which the predetermined event is performed.

13. The information processing system according to claim 8, wherein

the life information acquisition means acquires, as the life information, at least one of information related to health of the user, positional information of the user, and information related to environment of the user.

14. The information processing system according to claim 8, wherein

the life information acquisition means acquires the life information in a period at least a part of which overlaps with the period during which the sensor information is detected.

15. An information processing system comprising a hand-held terminal and a server,

the hand-held terminal including sensing means for sensing sensor information for determining an emotion of a user;

the information processing system comprising;

emotion determining means for determining the emotion of the user on the basis of the sensor information; and

accumulation control means for accumulating a determination result of the emotion in a storage section included in the server.

16. The information processing system according to claim 15, wherein

the hand-held terminal includes:

the emotion determining means; and

transmission means for transmitting, to the server, information indicating the determination result of the emotion.

17. The information processing system according to claim 16, wherein

the sensing means repeatedly senses the sensor information,

the emotion determining means determines the emotion of the user in a predetermined monitoring period on the basis of multiple sets of the sensor information sensed during the monitoring period;

and

the transmission means transmits, to the server, the determination result based on the multiple sets of the sensor information sensed in the monitoring period, in response to an end of the monitoring period.

18. The information processing system according to claim 15, wherein

the hand-held terminal transmits, to the server, the sensor information and/or information obtained from the sensor information, and

the emotion determining means is included in the server, and determines the emotion of the user on the basis of the information transmitted from the hand-held terminal.

19. The information processing system according to claim 18, wherein

the sensing means repeatedly senses the sensor information, and

the hand-held terminal transmits, to the server, multiple sets of the sensor information sensed during a predetermined monitoring period and/or information obtained from the sensor information, in response to an end of the monitoring period.

20. The information processing system according to claim 15, further comprising presentation means for presenting the user with presentation information including at least one of the determination result of the emotion and suggestion in accordance with the determination result.

21. The information processing system according to claim 20, wherein

the server stores, in a predetermined storage section, identification information of another user different from the user for which determination of emotion has been performed, as a user to be presented with the presentation information, so that the identification information of the other user is associated with the user for which determination of emotion has been performed, and

the presentation means presents the determination result of the emotion of a certain user and/or presentation information corresponding to the determination result, to another user associated with the certain user.

22. The information processing system according to claim 21, wherein

the presentation means presents the certain user with first information, and presents the other user associated with the certain user with second information different from the first information, both the first information and the second information being based on the determination result of the emotion of the certain user.

28. A hand-held type information processing apparatus, comprising:

sensing means for sensing sensor information for determining an emotion of a user; and

emotion determining means for determining the emotion of the user on the basis of the sensor information, wherein

the sensing means senses the sensor information in a period during which the information processing apparatus is in a standby state.

29. An information processing apparatus, comprising:

sensing means for sensing sensor information for determining an emotion of a user;

emotion determining means for determining the emotion of the user on the basis of the sensor information;

life information acquisition means for acquiring life information obtained by observing life of the user; and

process execution means for executing a predetermined process on the basis of the determination result of the emotion, and the life information.