STORAGE MEDIUM HAVING STORED THEREON INFORMATION PROCESSING PROGRAM, AND INFORMATION PROCESSING DEVICE

• US 20100249494A1
• Filed: 09/15/2009
• Published: 09/30/2010
• Est. Priority Date: 03/26/2009
• Status: Active Grant

• Current Assignee: Nintendo Company Limited, Tohoku University National Universities Corporation
• Original Assignee: Nintendo Company Limited, Tohoku University National Universities Corporation
• Inventors: YOSHIZAWA, Makoto, FURUTA, Norikatsu, SUGITA, Norihiro, YAMBE, Tomoyuki
• Granted Patent: US 9,623,330 B2
• Time in Patent Office: Days
• US Class Current: 600/27
• CPC Class Codes: A61B 2562/0219 Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
• CPC Class Codes: A61B 2562/222 Electrical cables or leads therefor, e.g. coaxial cables or ribbon cables
• CPC Class Codes: A61B 5/0022 Monitoring a patient using a global network, e.g. telephone networks, internet
• CPC Class Codes: A61B 5/0059 using light, e.g. diagnosis by transillumination, diascopy, fluorescence A61B5/0093, A61B5/1455, A61B5/02416 and A61B5/0261 take precedence
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/0205 Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
• CPC Class Codes: A61B 5/021 Measuring pressure in heart or blood vessels A61B5/0205 takes precedence
• CPC Class Codes: A61B 5/02416 using photoplethysmograph signals, e.g. generated by infrared radiation A61B5/14552 takes precedence
• CPC Class Codes: A61B 5/02438 with portable devices, e.g. worn by the patient
• CPC Class Codes: A61B 5/026 Measuring blood flow A61B3/1233, A61B3/1241 take precedence
• CPC Class Codes: A61B 5/0261 using optical means, e.g. infrared light
• CPC Class Codes: A61B 5/0816 Measuring devices for examining respiratory frequency measuring frequency of electric signals G01R23/00
• CPC Class Codes: A61B 5/1118 Determining activity level
• CPC Class Codes: A61B 5/14552 Details of sensors specially adapted therefor
• CPC Class Codes: A61B 5/24 Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
• CPC Class Codes: A61B 5/318 Heart-related electrical modalities, e.g. electrocardiography [ECG]
• CPC Class Codes: A61B 5/389 Electromyography [EMG]
• CPC Class Codes: A61B 5/4035 Evaluating the autonomic nervous system
• CPC Class Codes: A61B 5/486 Bio-feedback A61B5/375 takes precedence
• CPC Class Codes: A61B 5/6826 Finger
• CPC Class Codes: A61B 5/6838 : Clamps or clips
• CPC Class Codes: A61B 5/6897 : Computer input devices, e.g. mice or keyboards
• CPC Class Codes: A61B 5/7278 : Artificial waveform generation or derivation, e.g. synthesising signals from measured signals A61B5/327 takes precedence
• CPC Class Codes: A61B 5/744 : Displaying an avatar, e.g. an animated cartoon character
• CPC Class Codes: A61B 5/7455 : characterised by tactile indication, e.g. vibration or electrical stimulation
• CPC Class Codes: A61B 5/7475 : User input or interface means, e.g. keyboard, pointing device, joystick
• CPC Class Codes: A61M 2021/0044 : by the sight sense
• CPC Class Codes: A61M 21/02 : for inducing sleep or relaxation, e.g. by direct nerve stimulation, hypnosis, analgesia for massage A61H; electrotherapy A61N, e.g. applying alternating or intermittent electric currents for producing anaesthesia A61N1/36021
• CPC Class Codes: A61M 2205/3561 : local, e.g. within room or hospital
• CPC Class Codes: A61M 2205/3592 : using telemetric means, e.g. radio or optical transmission
• CPC Class Codes: A61M 2205/502 : User interfaces, e.g. screens or keyboards
• CPC Class Codes: A61M 2205/52 : with memories providing a history of measured variating parameters of apparatus or patient
• CPC Class Codes: A61M 2209/01 : Remote controllers for specific apparatus
• CPC Class Codes: A61M 2230/06 : Heartbeat rate only
• CPC Class Codes: A61M 2230/42 : Rate
• CPC Class Codes: A61M 2230/63 : Motion, e.g. physical activity
• CPC Class Codes: A63F 13/10 : Control of the course of the game, e.g. start, progess, end
• CPC Class Codes: A63F 13/211 : using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/212 : using sensors worn by the player, e.g. for measuring heart beat or leg activity
• CPC Class Codes: A63F 13/428 : involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 13/45 : Controlling the progress of the video game
• CPC Class Codes: A63F 2300/1012 : involving biosensors worn by the player, e.g. for measuring heart beat, limb activity
• CPC Class Codes: A63F 2300/105 : using inertial sensors, e.g. accelerometers, gyroscopes
• CPC Class Codes: A63F 2300/6045 : for mapping control signals received from the input arrangement into game commands

Abstract

A computer readable storage medium having stored thereon an information processing program executable by a computer of an information processing device which presents information corresponding to a biological signal acquired from a user, is provided. The information processing program causes the computer to function as biological signal acquiring means, motion/attitude information acquiring means, and presentation means. The biological signal acquiring means acquires the biological signal from the user. The motion/attitude information acquiring means acquires information about a motion or an attitude of the user from detecting means, in association with the biological signal acquired by the biological signal acquiring means. The presentation means performs predetermined presentation based on both the biological signal acquired by the biological signal acquiring means and the information acquired by the motion/attitude information acquiring means.

Claims

1. A computer readable storage medium having stored thereon an information processing program executable by a computer of an information processing device which presents information corresponding to a biological signal acquired from a user, the information processing program causing the computer to function as:

biological signal acquiring means for acquiring the biological signal from the user;

motion/attitude information acquiring means for acquiring information about a motion or an attitude of the user from detecting means, in association with the biological signal acquired by the biological signal acquiring means; and

presentation means for performing predetermined presentation based on both the biological signal acquired by the biological signal acquiring means and the information acquired by the motion/attitude information acquiring means.

2. The computer readable storage medium according to claim 1, wherein

the information processing program causes the computer to further function as:

motion determining means for determining a motion of an input device operated by the user, based on the information acquired by the motion/attitude information acquiring means, and

the presentation means performs the presentation based on both the biological signal acquired by the biological signal acquiring means and the motion of the input device determined by the motion determining means.

3. The computer readable storage medium according to claim 1, wherein

the information processing program causes the computer to further function as:

instruction means for instructing the user to take a predetermined motion or attitude.

4. The computer readable storage medium according to claim 3, wherein

the presentation means performs the presentation based on both the biological signal and the information acquired by the motion/attitude information acquiring means, the biological signal and the information being acquired when the instruction means performs instruction.

5. The computer readable storage medium according to claim 3, wherein

the information processing program causes the computer to further function as:

determination means for determining whether or not the user is in the motion or attitude which the instruction means instructs the user to take, based on the information acquired by the motion/attitude information acquiring means, and

the presentation means performs the presentation based on the biological signal acquired by the biological signal acquiring means, during or after the determination means determines that the user is in the motion or attitude which the instruction means instructs the user to take.

6. The computer readable storage medium according to claim 3, wherein

the instruction means instructs the user to take a motion or an attitude which causes a predetermined biological signal to be output.

7. The computer readable storage medium according to claim 2, wherein

the presentation means performs presentation indicating an operation moving the input device corresponding to a motion of the input device which can be determined by the motion determining means.

8. The computer readable storage medium according to claim 1, wherein

the presentation means performs presentation indicating a predetermined motion or attitude of the user, based on both the biological signal acquired by the biological signal acquiring means and the information acquired by the motion/attitude information acquiring means.

9. The computer readable storage medium according to claim 8, wherein

the presentation means performs presentation indicating a motion or an attitude causing a change in the biological signal, based on the biological signal acquired by the biological signal acquiring means.

10. The computer readable storage medium according to claim 1, wherein

the biological signal acquiring means acquires as the biological signal a signal relating to pulsation or heartbeat of the user.

11. The computer readable storage medium according to claim 1, wherein

the biological signal acquiring means acquires as the biological signal at least one selected from the group consisting of a pulse wave, a heart rate, an activity level of the sympathetic nervous system, an activity level of the parasympathetic nervous system, a heart rate variance coefficient, a cardiac cycle, a respiration frequency, and a pulse wave amplitude of the user.

12. The computer readable storage medium according to claim 11, wherein

the biological signal acquiring means acquires at least the pulse wave amplitude of the user, and

the presentation means determines a difficulty level of the user using a change in the pulse wave amplitude of the user, and performs presentation indicating a motion based on a result of the determination.

13. The computer readable storage medium according to claim 2, wherein

the input device includes an acceleration sensor, and

the motion determining means determines a motion of the input device using an acceleration indicated by acceleration data outputted from the acceleration sensor.

14. The computer readable storage medium according to claim 13, wherein

the motion determining means determines a motion of the input device based on an inclination of the input device with reference to a direction of gravity, where the direction of gravity is the acceleration indicated by the acceleration data outputted from the acceleration sensor.

15. The computer readable storage medium according to claim 2, wherein

the input device includes a gyro-sensor, and

the motion determining means determines a motion of the input device using an angular velocity indicated by angular velocity data outputted from the gyro-sensor.

16. The computer readable storage medium according to claim 1, wherein

the presentation means performs the presentation by displaying on a display device at least either of an image and characters generated based on both the biological signal acquired by the biological signal acquiring means and the information acquired by the motion/attitude information acquiring means.

17. The computer readable storage medium according to claim 16, wherein

the presentation means performs the presentation by displaying on the display device an object generated based on both the biological signal acquired by the biological signal acquiring means and the information acquired by the motion/attitude information acquiring means.

18. The computer readable storage medium according to claim 1, wherein

the presentation means performs the presentation by controlling a motion of a predetermined object displayed on a display device, based on both the biological signal acquired by the biological signal acquiring means and the information acquired by the motion/attitude information acquiring means.

19. The computer readable storage medium according to claim 18, wherein

the presentation means performs presentation in which the object performs a first motion in a virtual world based on the biological signal acquired by the biological signal acquiring means, and performs presentation in which the object performs a second motion different from the first motion in the virtual world based on the information acquired by the motion/attitude information acquiring means.

20. The computer readable storage medium according to claim 19, wherein

the presentation means moves at least a portion of the object in the virtual world as one of the first and second motions, and changes an attitude of the object in the virtual world as the other of the first and second motions.

21. The computer readable storage medium according to claim 12, wherein

the presentation means moves at least a portion of the object in a predetermined first direction in the virtual world as one of the first and second motions, and moves at least a portion of the object in a predetermined second direction in the virtual world as the other of the first and second motions.

22. The computer readable storage medium according to claim 18, wherein

the information processing program causes the computer to further function as:

object motion determining means for determining a motion of the object in the virtual world.

23. The computer readable storage medium according to claim 22, wherein

the information processing program causes the computer to further function as:

instruction means for instructing the user to take a predetermined motion or attitude by causing a topographical object for designating a motion of the object to appear in the virtual world, and

the object motion determining means determines whether or not the object contacts the topographical object.

24. The computer readable storage medium according to claim 23, wherein

the instruction means changes the topographical object, depending on the biological signal acquired by the biological signal acquiring means.

25. The computer readable storage medium according to claim 19, wherein

the presentation means moves at least a portion of the object in a predetermined direction as the first motion, depending on a biological signal relating to respiration of the user acquired by the biological signal acquiring means.

26. The computer readable storage medium according to claim 25, wherein

the presentation means performs the presentation by further displaying on the display device an obstacle in the virtual world which limits a movement in the predetermined direction of the object, the objects rising and falling based a respiration frequency of the user acquired from the biological signal acquired by the biological signal acquiring means, and

the information processing program causes the computer to further function as:

assessment means for degrading assessment when the object contacts or overlaps the rising and falling obstacle in the virtual world.

27. The computer readable storage medium according to claim 19, wherein

the biological signal acquiring means acquires at least a pulse wave amplitude of the user, and

the presentation means performs the presentation by determining a difficulty level of the user using a change in the pulse wave amplitude of the user acquired by the biological signal acquiring means, and when determining the user has difficulty, changing a way in which the object is displayed.

28. The computer readable storage medium according to claim 27, wherein

the presentation means changes and inclines an attitude of the object in the virtual world as the second motion based on the information acquired by the motion/attitude information acquiring means,

the information processing program causes the computer to further function as:

assessment means for degrading assessment when the object contacts or overlaps an obstacle in the virtual world, an inclination angle of the obstacle limiting an inclining motion of the object in the virtual world, and

the assessment means gradually increases and changes the inclination angle of the obstacle with time, and when the presentation means determines that the user has difficulty, stops changing the inclination angle of the obstacle.

29. The computer readable storage medium according to claim 1, wherein

the presentation means performs the presentation by outputting audio based on both the biological signal acquired by the biological signal acquiring means and the information acquired by the motion/attitude information acquiring means.

30. An information processing device for presenting information corresponding to a biological signal acquired from a user, comprising:

biological signal acquiring means for acquiring the biological signal from the user;

motion/attitude information acquiring means for acquiring information about a motion or an attitude of the user from detecting means, in association with the biological signal acquired by the biological signal acquiring means; and

presentation means for performing predetermined presentation based on both the biological signal acquired by the biological signal acquiring means and the information acquired by the motion/attitude information acquiring means.