Physiologically Modulating Videogames or Simulations Which Use Motion-Sensing Input Devices

• US 20120004034A1
• Filed: 06/22/2011
• Published: 01/05/2012
• Est. Priority Date: 07/02/2010
• Status: Active Grant

• Current Assignee: United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration
• Original Assignee: The United States of America As Represented By The Secretary of Agriculture
• Inventors: Pope, Alan T., Stephens, Chad L., Blanson, Nina Marie
• Granted Patent: US 8,827,717 B2
• Time in Patent Office: Days
• US Class Current: 463/36
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/235 using a wireless connection, e.g. infrared or piconet
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 2300/1012 involving biosensors worn by the player, e.g. for measuring heart beat, limb activity
• CPC Class Codes: A63F 2300/1043 being characterized by constructional details
• CPC Class Codes: A63F 2300/105 using inertial sensors, e.g. accelerometers, gyroscopes
• CPC Class Codes: A63F 2300/1075 using a touch screen
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands

Abstract

New types of controllers allow players to make inputs to a video game or simulation by moving the entire controller itself. This capability is typically accomplished using a wireless input device having accelerometers, gyroscopes, and an infrared LED tracking camera. The present invention exploits these wireless motion-sensing technologies to modulate the player'"'"'s movement inputs to the videogame based upon physiological signals. Such biofeedback-modulated video games train valuable mental skills beyond eye-hand coordination. These psychophysiological training technologies enhance personal improvement, not just the diversion, of the user.

Claims

1. A method for modifying the effect of an operator controlled input device on an interactive device to encourage the self-regulation of at least one physiological activity by the operator, the operator controlled input device having motion and/or position-sensing capability, the interactive device comprising a display area that depicts images and an apparatus for receiving at least one input from the operator controlled input device to thus permit the operator to control and interact with at least some of the depicted images, the method for modifying comprising the steps of:

measuring at least one physiological activity of the operator to obtain at least one physiological signal having a value indicative of the level of the at least one physiological activity; and

modifying the motion and/or position sensing capability of the operator controlled input device in response to (a) changes in the measured at least one physiological signal and/or (b) differences between the measured at least one physiological signal and a corresponding predetermined desired physiological signal level, thereby modifying the ability of the operator to control and interact with at least some of the depicted images.

2. The method of claim 1, wherein modifying the motion and/or position sensing capability of the operator controlled input device comprises modulating a voltage input to one or more motion and/or position-sensing elements of the input device.

3. The method of claim 2, further wherein the one or more motion and/or position-sensing elements comprise one or more accelerometers and/or one or more gyroscopes.

4. The method of claim 1, wherein modifying the motion and/or position sensing capability of the operator controlled input device comprises the step of modifying one or more position reference signal elements that are used by the input device to determine a motion or position of the operator controlled input device relative to the one or more position reference signal elements.

5. The method of claim 4, further wherein the one or more position reference signal elements comprise two light emitting diodes (LEDs) or two sets of LEDs having a fixed distance therebetween;

wherein the operator controlled input device comprises a light detector for detecting light emitted from the LEDs; and

wherein modifying one or more position reference signal elements comprises mechanically translating the two LEDs from a first position to a second position, the difference between the first and second positions being based on either (a) the difference between the measured at least one physiological signal and the corresponding predetermined desired physiological signal level, or (b) the measured at least one physiological signal.

6. The method of claim 4, further wherein the one or more position reference signal elements comprise a plurality of LEDs, two of which emit light at any particular time;

wherein the operator controlled input device comprises a light detector for detecting light emitted from the LEDs; and

wherein the step of modifying one or more position reference signal elements comprises the step of changing which two of the LEDs are emitting light at any particular time.

7. The method of claim 6, wherein the step of changing which two of the LEDs are emitting light at any particular time comprises turning pairs of LEDs on and off in a predetermined pattern based on either (a) the difference between the measured at least one physiological signal and the corresponding predetermined desired physiological signal level, or (b) the measured at least one physiological signal.

8. The method of claim 6, wherein the plurality of LEDs comprises two groups of linearly arranged LEDs, each of the two linearly arranged groups being positioned substantially horizontally.

9. The method of claim 6, wherein the plurality of LEDs comprises two groups of linearly arranged LEDs, each of the two linearly arranged groups being positioned substantially vertically.

10. The method of claim 6, wherein the plurality of LEDs comprise two groups of LEDs, each of the groups being arranged in two linearly arranged sub-groups, each sub-group of a group crossing the other sub-group at a center of each sub-group and at a perpendicular angle.

11. The method of claim 1, wherein the at least one physiological signal comprises at least one or more of:

skin temperature, skin conductance, electrical activity of muscles, blood flow, heart rate, heart rate variability, and respiratory rate.

12. The method of claim 1, wherein the at least one physiological signal comprises at least one or more of:

brainwave electrical event-related potentials, and at least one brainwave frequency band;

wherein the at least one brainwave frequency band comprises at least one or more of;

(a) theta, (b) alpha, (c) Sensorimotor Response (SMR), (d) beta, and (e) gamma.

13. The method of claim 1, further comprising:

displaying the at least one physiological signal having a value indicative of the level of the at least one physiological activity.

14. The method of claim 13, wherein the steps of measuring, modifying, and displaying are performed wirelessly without any direct connection to the operator controlled device and to the interactive device.

15. The method of claim 1 wherein the steps of measuring and modifying are performed wirelessly without any direct connection to the operator controlled device and to the interactive device.

16. An apparatus for modifying the effect of an operator controlled input device on an interactive device to encourage the self-regulation of at least one physiological activity by the operator, the operator controlled input device having motion and/or position-sensing capability, the interactive device comprising a display area, a processor for depicting images upon the display area, and a receiver device permitting the operator to control and interact with at least some of the depicted images, the modifying apparatus comprising:

at least one measurement device for measuring at least one physiological activity of the operator to obtain at least one physiological signal having a value indicative of the level of the at least one physiological activity; and

at least one modifying device for modifying the motion and/or position sensing capability of the operator controlled input device in response to (a) changes in the measured at least one physiological signal and/or (b) differences between the measured at least one physiological signal and a corresponding predetermined desired physiological signal level, thereby modifying the ability of the operator to control and interact with at least some of the depicted images.

17. The apparatus of claim 16, wherein the at least one modifying device comprises a voltage modulator for modulating a voltage input to one or more motion and/or position-sensing elements of the input device.

18. The apparatus of claim 17, wherein the one or more motion and/or position-sensing elements comprise one or more accelerometers and/or one or more gyroscopes.

19. The apparatus of claim 16, wherein the at least one modifying device comprises a signal modulator for modifying one or more position reference signal elements that are used by the input device to determine a motion or position of the operator controlled input device relative to the one or more position reference signal elements.

20. The apparatus of claim 19, wherein the one or more position reference signal elements comprise two light emitting diodes (LEDs) or two sets of LEDs having a fixed distance therebetween;

wherein the operator controlled input device comprises a light detector for detecting light emitted from the LEDs; and

wherein the signal modulator comprises a mechanical translator for mechanically translating the two LEDs from a first position to a second position, the difference between the first and second positions being based on either (a) the difference between the measured at least one physiological signal and the corresponding predetermined desired physiological signal level, or (b) the measured at least one physiological signal.

21. The apparatus of claim 19, wherein the one or more position reference signal elements comprise a plurality of LEDs, two of which emit light at any particular time;

wherein the operator controlled input device comprises a light detector for detecting light emitted from the LEDs; and

wherein the signal modulator comprises a dual changing device for changing which two of the LEDs are emitting light at any particular time.

22. The apparatus of claim 21, wherein the dual changing device comprises a pattern regulator for turning pairs of LEDs on and off in a predetermined pattern based on either (a) the difference between the measured at least one physiological signal and the corresponding predetermined desired physiological signal level, or (b) the measured at least one physiological signal.

23. The apparatus of claim 21, wherein the plurality of LEDs comprises two groups of linearly arranged LEDs, each of the two linearly arranged groups being positioned substantially horizontally.

24. The apparatus of claim 21, wherein the plurality of LEDs comprises two groups of linearly arranged LEDs, each of the two linearly arranged groups being positioned substantially vertically.

25. The apparatus of claim 21, wherein the plurality of LEDs comprise two groups of LEDs, each of the groups being arranged in two linearly arranged sub-groups, each sub-group of a group crossing the other sub-group at a center of each sub-group and at a perpendicular angle.

26. The apparatus of claim 16, wherein the at least one physiological signal comprises at least one or more of:

skin temperature, skin conductance, electrical activity of muscles, blood flow, heart rate, heart rate variability, and respiratory rate.

27. The apparatus of claim 26, wherein the measurement device is a chest band electrode in combination with a wireless transmitter.

28. The apparatus of claim 16, wherein the at least one physiological signal comprises at least one or more of:

brainwave electrical event-related potentials, and at least one brainwave frequency band;

wherein the at least one brainwave frequency band comprises at least one or more of;

(a) theta, (b) alpha, (c) Sensorimotor Response (SMR), (d) beta, and (e) gamma.

29. The apparatus of claim 16, further comprising:

a display sub-area for displaying the at least one physiological signal having a value indicative of the level of the at least one physiological activity.

30. The apparatus of claim 29, wherein the display sub-area is substantially separate from the interactive device.

31. The apparatus of claim 30, wherein the at least one measurement device, the at least one modifying device, and the display sub-area are connected wirelessly without any direct connection to the operator controlled device and to the interactive device.

32. The apparatus of claim 16, wherein the at least one measurement device and the at least one modifying device are connected wirelessly without any direct connection to the operator controlled device and to the interactive device.