Interactive gaming systems with haptic feedback

• US 8,992,322 B2
• Filed: 06/09/2004
• Issued: 03/31/2015
• Est. Priority Date: 06/09/2003
• Status: Active Grant

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Endo, Shoichi, Jasso, Alexander
• Primary Examiner(s): LIM, SENG HENG
• Application Number:
  US10/864,108
• Publication Number:
  US 20050017454A1
• Time in Patent Office: 3,947 Days
• Field of Search: 463 36- 37
• US Class Current: 463/37
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/219 for aiming at specific areas on the display, e.g. light-guns
• CPC Class Codes: A63F 13/235 using a wireless connection, e.g. infrared or piconet
• CPC Class Codes: A63F 13/245 specially adapted to a particular type of game, e.g. steering wheels
• CPC Class Codes: A63F 13/285 Generating tactile feedback signals via the game input device, e.g. force feedback
• CPC Class Codes: A63F 13/655 by importing photos, e.g. of the player
• CPC Class Codes: A63F 13/812 Ball games, e.g. soccer or baseball
• CPC Class Codes: A63F 2300/1037 being specially adapted for converting control signals received from the game device into a haptic signal, e.g. using force feedback
• CPC Class Codes: A63F 2300/105 using inertial sensors, e.g. accelerometers, gyroscopes
• CPC Class Codes: A63F 2300/1062 being specially adapted to a type of game, e.g. steering wheel
• CPC Class Codes: A63F 2300/695 Imported photos, e.g. of the player
• CPC Class Codes: A63F 2300/8011 Ball
• CPC Class Codes: G06F 2203/013 Force feedback applied to a game
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user

Abstract

Interactive gaming systems and methods with haptic feedback are described. One described apparatus comprises: a portable manipulandum configured to simulate an element associated with a sports activity; a sensor in communication with the portable manipulandum and configured to detect a movement of the portable manipulandum; an actuator disposed in the portable manipulandum; and a processor in communication with the sensor and the actuator. The processor is configured to receive a sensor signal from the sensor associated with the movement of the portable manipulandum and to output a control signal to the actuator based at least in part on the sensor signal. The control signal is configured to cause the actuator to output a haptic feedback associated with the movement of the portable manipulandum, e.g., simulating an impact between the portable manipulandum and an object.

Claims

1. An apparatus, comprising:

a portable manipulandum configured to simulate an element associated with a physical activity;

an actuator disposed in the portable manipulandum, wherein the actuator comprises one of a pager motor, an eccentric mass actuator, a harmonic eccentric mass actuator, an inertial mass harmonic actuator, a voice coil, a moving magnet actuator, a piezoelectric actuator, or an electro-active polymer actuator;

a sensor in communication with the portable manipulandum and configured to detect a movement of the portable manipulandum; and

a processor in communication with the sensor and the actuator, the processor configured to receive a sensor signal from the sensor associated with the movement of the portable manipulandum and to output a control signal to the actuator based at least in part on the sensor signal and haptic data in a lookup table, wherein the lookup table comprises a first data field and a second data field, wherein the first data field comprises a name of a haptic effect and the second data field comprises a portion of the haptic data, and wherein the control signal is configured to cause the actuator to output a haptic feedback associated with the movement of the portable manipulandum, the haptic feedback comprising a vibrotactile effect.

2. The apparatus of claim 1 wherein the haptic feedback is operable to simulate an impact between the portable manipulandum and an object.

3. The apparatus of claim 1 wherein the sensor is disposed in the manipulandum.

4. The apparatus of claim 3 wherein the sensor comprises one of an acceleration sensor or a tilt sensor.

5. The apparatus of claim 1 wherein the processor is disposed in the portable manipulandum.

6. The apparatus of claim 1 wherein the processor is disposed in a housing separate from the portable manipulandum.

7. The apparatus of claim 6 wherein the processor comprises a wireless communication means for communicating with at least one of the sensor or the actuator.

8. The apparatus of claim 6 wherein the processor is a first processor, the apparatus further comprising a second processor in communication with the first processor, the second processor being disposed in the manipulandum.

9. The apparatus of claim 1 wherein the sensor comprises a first element and a second element in communication with one another.

10. The apparatus of claim 9 wherein the first element is disposed in the portable manipulandum, the second element and the processor being included in a housing separate from the portable manipulandum.

11. The apparatus of claim 9 wherein the second element is disposed in the portable manipulandum, the first element and the processor being included in a housing separate from the portable manipulandum.

12. The apparatus of claim 9 wherein the first element includes one of a radio frequency emitter, an infrared emitter, or an ultrasound emitter.

13. The apparatus of claim 12 wherein the second element comprises one of a radio frequency receiver, an infrared receiver, or an ultrasound receiver.

14. The apparatus of claim 1 wherein the sensor comprises one of a video camera or an infrared camera.

15. The apparatus of claim 14 wherein the sensor and the processor are disposed in a housing separate from the portable manipulandum.

16. The apparatus of claim 1 wherein the processor is further configured to execute an application program associated with the physical activity.

17. The apparatus of claim 16 further comprising a memory in communication with the processor, the memory storing the application program.

18. The apparatus of claim 16 wherein the application program causes a graphical environment associated with the physical activity to be output.

19. The apparatus of claim 18 wherein the output comprises a visual display on a display device.

20. The apparatus of claim 18 wherein the output comprises an audio output from an audio device, the audio output indicating a status associated with the physical activity.

21. The apparatus of claim 1 wherein the element associated with the physical activity comprises one of a tennis racket, a badminton racket, a racquetball racket, a squash racket, a ping-pong racket, a baseball bat, a hockey stick, a golf club, a gun, a rifle, a sword, a boxing glove, a baseball glove, a football, or a drumstick.

47. The apparatus of claim 1, wherein the portion of the haptic data is predetermined.

22. An apparatus, comprising:

a portable manipulandum configured to simulate an element associated with a physical activity;

a sensor in communication with the portable manipulandum and configured to output a sensor signal associated with a movement of the portable manipulandum; and

an actuator disposed in the portable manipulandum, the actuator configured to receive a control signal based at least in part on the sensor signal and haptic data in a lookup table, wherein the lookup table comprises a first data field and a second data field, wherein the first data field comprises a name of a haptic effect and the second data field comprises a portion of the haptic data, and to output a haptic feedback that simulates an impact between the portable manipulandum and an object, the haptic feedback comprising a vibrotactile effect, and wherein the actuator comprises one of a pager motor, an eccentric mass actuator, a harmonic eccentric mass actuator, an inertial mass harmonic actuator, a voice coil, a moving magnet actuator, a piezoelectric actuator, or an electro-active polymer actuator.

23. The apparatus of claim 22 wherein the sensor is disposed in the portable manipulandum.

24. The apparatus of claim 22 wherein the sensor includes one of a video camera or an infrared camera, separate from the manipulandum.

25. The apparatus of claim 22 further comprising a processor in communication with the sensor and the actuator, the processor configured to receive the sensor signal from the sensor and to output the control signal to the actuator.

26. The apparatus of claim 25 wherein the processor is disposed in the portable manipulandum.

27. The apparatus of claim 25 wherein the processor is separate from the portable manipulandum.

28. The apparatus of claim 27 wherein the processor is included in one of a computer or a television set.

29. The apparatus of claim 23 further comprising a memory in communication with the processor, the memory storing an application program associated with the physical activity.

30. The apparatus of claim 29 wherein the application program is configured to cause a graphical environment associated with the physical activity to be output.

31. The apparatus of claim 30 wherein the output comprises a visual display on a display device.

32. The apparatus of claim 30 wherein the output comprises an audio output from an audio device, the audio output indicating a status associated with the physical activity.

33. The apparatus of claim 22 wherein the element associated with the physical activity includes one of a tennis racket, a badminton racket, a racquetball racket, a squash racket, a ping-pong racket, a baseball bat, a hockey stick, a golf club, a gun, a rifle, a sword, a boxing glove, a baseball glove, a football, or a drumstick.

48. The apparatus of claim 22, wherein the portion of the haptic data is predetermined.

34. A method, comprising:

providing a portable manipulandum, the portable manipulandum configured to simulate an element associated with a physical activity;

providing a sensor in communication with the portable manipulandum, the sensor configured to output a sensor signal associated with a movement of the portable manipulandum; and

providing an actuator disposed in the portable manipulandum, the actuator configured to receive a control signal based at least in part on the sensor signal and haptic data in a lookup table, wherein the lookup table comprises a first data field and a second data field, wherein the first data field comprising a name of a haptic effect and the second data field comprises a portion of the haptic data, and to output a haptic feedback associated with the movement of the portable manipulandum, the haptic feedback comprising a vibrotactile effect, and wherein the actuator comprises one of a pager motor, an eccentric mass actuator, a harmonic eccentric mass actuator, an inertial mass harmonic actuator, a voice coil, a moving magnet actuator, a piezoelectric actuator, or an electro-active polymer actuator.

35. The method of claim 34 wherein the haptic feedback is operable to simulate an impact between the portable manipulandum and an object.

36. The method of claim 34 further comprising providing a processor in communication with the sensor and the actuator, the processor configured to receive the sensor signal from the sensor and to output the control signal to the actuator.

37. The method of claim 36 wherein the processor is disposed in the portable manipulandum.

38. The method of claim 36 wherein the processor is separate from the portable manipulandum.

39. The method of claim 38 wherein the sensor includes one of a video camera or an infrared camera, the sensor and the processor being disposed in a housing separate from the portable manipulandum.

40. The method of claim 36 wherein the processor is a first processor, the method further comprising providing a second processor in communication with the first processor, the second processor being disposed in the portable manipulandum.

41. The method of claim 34 wherein the sensor includes a first element and a second element in communication with one another.

42. The method of claim 41 wherein the first element is disposed in the portable manipulandum, the second element and the processor being included in a housing separate from the portable manipulandum.

43. The method of claim 41 wherein the second element is disposed in the portable manipulandum, the first element and the processor being included in a housing separate from the portable manipulandum.

44. The method of claim 41 wherein the first element includes one of a radio frequency emitter, an infrared emitter, or an ultrasound emitter.

45. The method of claim 44 wherein the second element includes one of a radio frequency receiver, an infrared receiver, or an ultrasound receiver.

46. The method of claim 34 wherein the element associated with the sports activity includes one of a tennis racket, a badminton racket, a racquet ball racket, a squash racket, a ping-pong racket, a baseball bat, a hockey stick, a golf club, a gun, a rifle, a sword, a boxing glove, a baseball glove, a football, or a drumstick.

49. The method of claim 34, wherein the portion of the haptic data is predetermined.