System and method for providing complex haptic stimulation during input of control gestures, and relating to control of virtual equipment

• US 8,469,806 B2
• Filed: 07/21/2010
• Issued: 06/25/2013
• Est. Priority Date: 07/22/2009
• Status: Active Grant

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Grant, Danny A., Heubel, Robert W., Birnbaum, David M., Ramsay, Erin B.
• Primary Examiner(s): Elisca, Pierre E
• Application Number:
  US12/840,797
• Publication Number:
  US 20110021272A1
• Time in Patent Office: 1,070 Days
• Field of Search: 463/30, 463/22
• US Class Current: 463/30
• CPC Class Codes: A63F 13/10 Control of the course of the game, e.g. start, progess, end
• CPC Class Codes: A63F 13/12 involving interaction between a plurality of game devices, e.g. transmisison or distribution systems protocols for networked virtual reality, networked games H04L29/06034
• CPC Class Codes: A63F 13/214 for locating contacts on a surface, e.g. floor mats or touch pads
• CPC Class Codes: A63F 13/28 responding to control signals received from the game device for affecting ambient conditions, e.g. for vibrating players' seats, activating scent dispensers or affecting temperature or light controlling the output signals based on the game progress A63F13/50
• CPC Class Codes: A63F 13/285 Generating tactile feedback signals via the game input device, e.g. force feedback
• CPC Class Codes: A63F 13/30 Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
• CPC Class Codes: A63F 13/45 Controlling the progress of the video game
• CPC Class Codes: A63F 13/48 Starting a game, e.g. activating a game device or waiting for other players to join a multiplayer session
• CPC Class Codes: A63F 13/92 Video game devices specially adapted to be hand-held while playing
• CPC Class Codes: A63F 2300/1037 being specially adapted for converting control signals received from the game device into a haptic signal, e.g. using force feedback
• CPC Class Codes: A63F 2300/1075 using a touch screen
• CPC Class Codes: A63F 2300/204 the platform being a handheld device
• CPC Class Codes: A63F 2300/575 for trading virtual items
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 2203/04803 Split screen, i.e. subdividing the display area or the window area into separate subareas
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04883 : for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G08B 6/00 : Tactile signalling systems, e.g. personal calling systems

Abstract

A system is configured to provide haptic stimulation to a user. In one embodiment, the haptic stimulation is provided to the user in conjunction with the performance of one or more control gestures through which the user controls, for example, a game, a real world component or piece of equipment, and/or other entity. In one embodiment, the haptic stimulation is provided to the user in conjunction with control of virtual equipment by the user.

Claims

1. A system configured to provide haptic stimulation to a user, the system comprising:

a user interface configured to generate output signals related to the gestures of a user;

a haptic device configured to generate haptic stimulation to the user; and

one or more processors configured to execute computer program modules, the computer program modules comprising;

a gesture module configured to monitor performance of a control gesture by the user based on the output signals of the user interface,

wherein the control gesture is a gesture associated with a command input to the system, and includes an initial portion, a first intermediate portion, and an ending portion;

a stimulation module configured to receive information related to performance of the control gesture from the gesture module, and to determine haptic stimulation to be generated for the user associated with the control gesture,

wherein the haptic stimulation includes a first stimulation determined responsive to performance of the initial portion of the control gesture, and a second stimulation that is different from the first stimulation and is determined responsive to performance of the first intermediate portion of the control gesture; and

a control module configured to control the haptic device to generate the stimulation determined by the stimulation module.

2. The system of claim 1, wherein the stimulation module is configured such that the haptic stimulation associated with the control gesture includes a third stimulation different from the first stimulation and the second stimulation that is determined responsive to performance of the ending portion of the control gesture.

3. The system of claim 1, wherein the control gesture further includes a second intermediate portion, and wherein the stimulation module is configured such that the haptic stimulation associated with the control gesture includes a third stimulation different from the first stimulation and the second stimulation that is determined responsive to performance of the second intermediate portion of the control gesture.

4. The system of claim 3, wherein the second stimulation is determined to signal to the user that the second intermediate portion of the control gesture should be commenced.

5. The system of claim 1, wherein the command input associated with the control gesture is a single, discrete command.

6. The system of claim 1, wherein the second stimulation is determined by adjusting one or more parameters of the first stimulation.

7. The system of claim 6, wherein the one or more parameters of the first stimulation that are adjusted to determine the second stimulation include one or more of periodicity, force, directionality, or location.

8. The system of claim 1, wherein the first intermediate portion of the control gesture includes maintaining contact with a touch sensitive surface for a predetermined period of time.

9. The system of claim 1, wherein the gesture module is configured to identify a control gesture failure responsive to the users commencing performance of the control gesture and not successfully performing all of the portions of the control gesture, and wherein the stimulation module is configured such that the haptic stimulation associated with the control gesture includes a third stimulation different from the first stimulation and the second stimulation that is determined responsive to identification of a control gesture failure by the gesture module.

10. The system of claim 1, wherein the stimulation module is configured such that the first stimulation and/or the second stimulation are determined in part based on one or more of a skill-level, fatigue, or injury of a character in a game under the control of the user.

11. A computer-implemented method of providing haptic stimulation to a user of a system, the method being implemented in the system which includes a haptic device and one or more physical processors configured to execute computer program modules, the method comprising:

monitoring, on the one or more processors, performance of a control gesture by a user,

wherein the control gesture is a gesture associated with a command input to the system, and includes an initial portion, a first intermediate portion, and an ending portion;

determining, on the one or more processors, haptic stimulation associated with performance of the control gesture to be generated for the user,

wherein the haptic stimulation includes a first stimulation determined responsive

to performance of the initial portion of the control gesture, and a second stimulation that is different from the first stimulation and is determined responsive to performance of the first intermediate portion of the control gesture; and

generating, with the haptic device, the determined stimulation during performance of the control gesture.

12. The method of claim 11, wherein the haptic stimulation associated with the control gesture includes a third stimulation different from the first stimulation and the second stimulation that is determined responsive to performance of the ending portion of the control gesture.

13. The method of claim 11, wherein the control gesture further includes a second intermediate portion, and wherein the haptic stimulation associated with the control gesture further includes a third stimulation different from the first stimulation and the second stimulation that is determined responsive to performance of the second intermediate portion of the control gesture.

14. The method of claim 13, wherein the second stimulation is determined by the one or more processors to signal to the user that the second intermediate portion of the control gesture should be commenced.

15. The method of claim 11, wherein the command input associated with the control gesture is a single, discrete command.

16. The method of claim 11, wherein the second stimulation is determined by the one or more processors by adjusting one or more parameters of the first stimulation.

17. The method of claim 16, wherein the one or more parameters of the first stimulation that are adjusted to determine the second stimulation include one or more of periodicity, force, directionality, or location.

18. The method of claim 11, wherein the first intermediate portion of the control gesture includes maintaining contact with an interface surface of a touch sensitive surface for a predetermined period of time.

19. The method of claim 11, wherein responsive to identification of a control gesture failure during monitoring of performance of the control gesture the haptic stimulation associated with the control gesture includes a third stimulation different from the first stimulation and the second stimulation.

20. The method of claim 11, wherein the first stimulation and/or the second stimulation are determined by the one or more processors in part based on one or more of a skill-level, fatigue, or injury of a character in a game under the control of the user.

21. A system configured to provide stimulation to a user of a game, the system comprising:

a touch sensitive electronic display having an interface surface accessible for engagement by the user, the touch sensitive user interface being configured to generate output signals related to the position at which the interface surface is engaged, and to present views of the game to the user through the interface surface,

wherein the views presented through the interface surface include views of virtual equipment having user selectable sections that are selectable by the user to interact with the virtual equipment by engaging the interface surface at the user selectable sections of the views of the virtual equipment;

a haptic device configured to generate haptic stimulation to the user; and

one or more processors in operative communication with the touch sensitive electronic display and the haptic device, the one or more processors being configured to execute computer program modules, the computer program modules comprising;

an equipment module configured to determine the operating parameters of the virtual equipment in the views, and to simulate operation of the virtual equipment,

wherein the equipment module determines the operating parameters of the virtual equipment and/or simulates operation of the virtual equipment based on selections by the user of the user selectable sections of the views of the virtual equipment;

a stimulation module configured to determine haptic stimulation to be generated for the user associated with the operating parameters of the virtual equipment and/or simulated operation of the virtual equipment,

a control module configured to control the haptic device to generate the stimulation determined by the stimulation module.

22. The system of claim 21, wherein the virtual equipment includes a projectile weapon.

23. The system of claim 22, wherein the operating parameters of the virtual equipment based on selections by the user of the user selectable sections of the views of the virtual equipment include one or more of an amount of loaded rounds of ammunition, a level of disrepair, a stopping power, a projectile velocity, an ammunition type, or a noise level.

24. The system of claim 21, wherein the haptic device is configured to actuate the touch sensitive electronic display.

25. The system of claim 21, wherein the haptic device is configured to actuate the interface surface.

26. The system of claim 21, wherein the operating parameters of the virtual equipment include activation and deactivation of individual pieces of virtual equipment.

27. The system of claim 21, wherein the user selectable sections of the views of the virtual equipment correspond to sections of the virtual equipment analogous to sections of equipment that would be engaged in real life to configure operating parameters and/or operate the equipment.

28. The system of claim 21, wherein the equipment module is configured to add or remove one or more components of a piece of virtual equipment based on the user engaging user selectable sections of a view of the piece of virtual equipment.

29. The system of claim 28, wherein the removal and/or addition of one or more components of the piece of virtual equipment are reflected in the views of virtual equipment presented to the user through the interface surface.

30. The system of claim 21, wherein equipment module is configured to change equipment modes of a piece of virtual equipment based on the user engaging user selectable section of a view of the piece of virtual equipment.

31. A computer-implemented method of providing stimulation to a user of a game, the method being implemented in a system including a haptic device, a touch sensitive electronic display, and one or more physical processors configured to execute computer program modules, the method comprising:

presenting views of a game through an interface surface of the touch sensitive electronic display that is accessible for engagement by a user,

wherein the views presented through the interface surface include views of virtual equipment having user selectable sections that are selectable by the user to interact with the virtual equipment by engaging the interface surface at the user selectable sections of the views of the virtual equipment;

receiving selection of one of the user selectable sections via an by the user engagement of the selected user selectable section on the interface surface;

determining, on the one or more processors, the operating parameters of the virtual equipment in the views and/or simulating operation of the virtual equipment based on the received selection;

determining on the one or more processors, responsive to the received selection, haptic stimulation to be generated for the user associated with the operating parameters of the virtual equipment and/or simulated operation of the virtual equipment; and

generating the determined haptic stimulation with the haptic device.

32. The method of claim 31, wherein the virtual equipment includes a projectile weapon.

33. The method of claim 32, wherein the operating parameters of the virtual equipment determined based on selection of the selected user selectable section include one or more of an amount of loaded rounds of ammunition, a level of disrepair, a stopping power, a projectile velocity, an ammunition type, or a noise level.

34. The method of claim 31, wherein the haptic stimulation is generated to actuate the touch sensitive electronic display.

35. The method of claim 31, wherein the haptic stimulation is generated to actuate the interface surface.

36. The method of claim 31, wherein the operating parameters of the virtual equipment determined based on selection of the selected user selectable section include activation and deactivation of individual pieces of virtual equipment.

37. The method of claim 31, wherein the user selectable sections of the views of the virtual equipment correspond to sections of the virtual equipment analogous to sections of equipment that would be engaged in real life to configure operating parameters and/or operate the equipment.

38. The method of claim 31, further comprising adding or removing one or more components of a piece of virtual equipment based on the user engaging user selectable sections of a view of the piece of virtual equipment.

39. The method of claim 38, wherein the removal and/or addition of one or more components of the piece of virtual equipment are reflected in the views of virtual equipment presented to the user through the interface surface.

40. The method of claim 31, further comprising changing equipment modes of a piece of virtual equipment based on the user engaging user selectable section of a view of the piece of virtual equipment.