HAPTIC SPATIALIZATION SYSTEM

• US 20150130707A1
• Filed: 11/12/2014
• Published: 05/14/2015
• Est. Priority Date: 11/14/2013
• Status: Active Grant

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: DA COSTA, Henry, LACROIX, Robert, GRANT, Danny, RANK, Stephen D., BIRNBAUM, David, RIHN, William
• Granted Patent: US 9,164,587 B2
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: A63F 13/22 Setup operations, e.g. calibration, key configuration or button assignment
• CPC Class Codes: A63F 13/23 for interfacing with the game device, e.g. specific interfaces between game controller and console
• CPC Class Codes: A63F 13/285 Generating tactile feedback signals via the game input device, e.g. force feedback
• CPC Class Codes: A63F 13/60 Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user

Abstract

A system is provided that controls a haptic effect experienced at a peripheral device. The system receives a haptic effect definition including haptic data. The system further receives spatialization data including: a distance of the haptic effect; a direction of the haptic effect; or a flow of the haptic effect. The system further includes modifying the haptic effect definition based on the received spatialization data. The system further includes sending a haptic instruction and the modified haptic effect definition to the peripheral device. The system further includes causing one or more haptic output devices to produce one or more haptic effects based on the modified haptic effect definition at the peripheral device in response to the haptic instruction.

Claims

1. A non-transitory computer-readable medium having instructions stored thereon that, when executed by a processor, cause the processor to control a haptic effect experienced at a peripheral device, the controlling comprising:

receiving a haptic effect definition comprising haptic data;

receiving spatialization data comprising at least one of;

a position of the haptic effect;

a distance of the haptic effect;

a velocity of the haptic effect;

a direction of the haptic effect;

or a flow of the haptic effect;

modifying the haptic effect definition based on the received spatialization data;

sending a haptic instruction and the modified haptic effect definition to the peripheral device; and

causing one or more haptic output devices to produce one or more haptic effects based on the modified haptic effect definition at the peripheral device in response to the haptic instruction.

2. The non-transitory computer-readable medium of claim 1,

wherein the modifying the haptic effect definition comprises dividing the haptic effect definition into one or more haptic effect definition components;

wherein the sending the haptic instruction and the modified haptic effect definition comprises sending the one or more haptic effect definition components to the peripheral device;

wherein the causing the one or more haptic output devices to produce the one or more haptic effects based on the modified haptic effect definition comprises causing the one or more haptic output devices to produce the one or more haptic effects based on the one or more haptic effect definition components.

3. The non-transitory computer-readable medium of claim 2, further comprising:

scaling, based on the spatialization data, at least one of;

a magnitude of the haptic data of at least one haptic effect definition component;

a frequency of the haptic data of at least one haptic effect component;

or a duration of the haptic data of at least one haptic effect component.

4. The non-transitory computer-readable medium of claim 2, further comprising:

attenuating, based on the spatialization data, at least one of;

a magnitude of the haptic data of at least one haptic effect definition component;

a frequency of the haptic data of at least one haptic effect definition component;

or a duration of the haptic data of at least one haptic effect definition component.

5. The non-transitory computer-readable medium of claim 2, further comprising:

causing at least one haptic output device to delay a playback of at least one haptic effect based on the spatialization data.

6. The non-transitory computer-readable medium of claim 2, wherein the one or more haptic effect definition components are distinct.

7. The non-transitory computer-readable medium of claim 2, wherein the one or more haptic effect definition components are identical.

8. The non-transitory computer-readable medium of claim 1, wherein the peripheral device comprises a controller or gamepad.

9. The non-transitory computer-readable medium of claim 1, wherein the causing the one or more haptic output devices to produce the one or more haptic effects comprises causing the one or more haptic output devices to produce the one or more haptic effects at one or more user input elements of the peripheral device.

10. The non-transitory computer-readable medium of claim 9, wherein at least one user input element comprises one of:

a digital button;

an analog button;

a bumper;

a directional pad;

an analog or digital stick;

a driving wheel;

or a trigger.

11. The non-transitory computer-readable medium of claim 1, wherein at least one haptic output device comprises an actuator.

12. The non-transitory computer-readable medium of claim 1, wherein the causing the one or more haptic output devices to produce the one or more haptic effects based on the modified haptic effect definition comprises outputting the one or more haptic effects at a plurality of actuators at multiple distinct attenuations based on the modified haptic effect definition.

13. The non-transitory computer-readable medium of claim 1, wherein the causing the one or more haptic output devices to produce the one or more haptic effects based on the modified haptic effect definition comprises outputting the one or more haptic effects at a plurality of actuators by inversely ramping attenuation based on the modified haptic effect definition.

14. The non-transitory computer-readable medium of claim 1, wherein the causing the one or more haptic output devices to produce the one or more haptic effects based on the modified haptic effect definition comprises outputting the one or more haptic effects at a plurality of rumble actuators and targeted actuators by inversely ramping attenuation from a rumble actuator to a targeted actuator based on the modified haptic effect definition.

15. The non-transitory computer-readable medium of claim 1, wherein the causing the one or more haptic output devices to produce the one or more haptic effects based on the modified haptic effect definition comprises outputting the one or more haptic effects at a plurality of rumble actuators and targeted actuators by inversely ramping attenuation from a targeted actuator to a rumble actuator based on the modified haptic effect definition.

16. The non-transitory computer-readable medium of claim 1, wherein the causing the one or more haptic output devices to produce the one or more haptic effects based on the modified haptic effect definition comprises outputting the one or more haptic effects at a plurality of actuators with a delay based on the modified haptic effect definition.

17. The non-transitory computer-readable medium of claim 1, wherein the causing the one or more haptic output devices to produce the one or more haptic effects based on the modified haptic effect definition comprises outputting the one or more haptic effects at a plurality of rumble actuators and targeted actuators with a delay from a rumble actuator to a targeted actuator based on the modified haptic effect definition.

18. The non-transitory computer-readable medium of claim 1, wherein the causing the one or more haptic output devices to produce the one or more haptic effects based on the modified haptic effect definition comprises outputting the one or more haptic effects at a plurality of rumble actuators and targeted actuators with a delay from a targeted actuator to a rumble actuator based on the modified haptic effect definition.

19. The non-transitory computer-readable medium of claim 1, wherein the causing the one or more haptic output devices to produce the one or more haptic effects based on the modified haptic effect definition comprises outputting the one or more haptic effects at a plurality of actuators with a delay in a clockwise or counter-clockwise order based on the modified haptic effect definition.

20. The non-transitory computer-readable medium of claim 1,

wherein the modifying the haptic effect definition comprises detecting a motion, change in position, or change in orientation of the peripheral device, modifying the spatialization data based on the detected motion, detected change in position, or detected change in orientation, and subsequently modifying the modified haptic effect definition based on the modified spatialization data;

wherein the sending the haptic instruction and the modified haptic effect definition comprises sending the subsequently modified haptic effect definition to the peripheral device;

wherein the causing the one or more haptic output devices to produce the one or more haptic effects based on the modified haptic effect definition comprises causing the one or more haptic output devices to produce one or more modified haptic effects based on the subsequently modified haptic effect definition.

21. A computer-implemented method for controlling a haptic effect experienced at a user input element of a peripheral device, the computer-implemented method comprising:

receiving a haptic effect definition comprising haptic data;

receiving spatialization data comprising at least one of;

a position of the haptic effect;

a distance of the haptic effect;

a velocity of the haptic effect;

a direction of the haptic effect;

or a flow of the haptic effect;

modifying the haptic effect definition based on the received spatialization data;

sending a haptic instruction and the modified haptic effect definition to the peripheral device; and

causing one or more haptic output devices to produce one or more haptic effects based on the modified haptic effect definition at the peripheral device in response to the haptic instruction.

22. The computer-implemented method of claim 21,

wherein the modifying the haptic effect definition comprises dividing the haptic effect definition into one or more haptic effect definition components;

wherein the sending the haptic instruction and the modified haptic effect definition comprises sending the one or more haptic effect definition components to the peripheral device;

wherein the causing the one or more haptic output devices to produce the one or more haptic effects based on the modified haptic effect definition comprises causing the one or more haptic output devices to produce the one or more haptic effects based on the one or more haptic effect definition components.

23. The computer-implemented method of claim 22, further comprising:

scaling, based on the spatialization data, at least one of;

a magnitude of the haptic data of at least one haptic effect definition component;

a frequency of the haptic data of at least one haptic effect component;

or a duration of the haptic data of at least one haptic effect component.

24. The computer-implemented method of claim 22, further comprising:

attenuating, based on the spatialization data, at least one of;

a magnitude of the haptic data of at least one haptic effect definition component;

a frequency of the haptic data of at least one haptic effect definition component;

or a duration of the haptic data of at least one haptic effect definition component.

25. The computer-implemented method of claim 22, further comprising:

causing at least one haptic output device to delay a playback of at least one haptic effect based on the spatialization data.

26. A system for controlling a haptic effect experienced at a peripheral device, the system comprising:

a memory configured to store a haptic spatialization module; and

a processor configured to execute the haptic spatialization module stored on the memory;

wherein the processor, when executing the haptic spatialization module, is configured to receive a haptic effect definition comprising haptic data;

wherein the processor, when executing the haptic spatialization module, is further configured to receive spatialization data comprising at least one of;

a position of the haptic effect;

a distance of the haptic effect;

a velocity of the haptic effect;

a direction of the haptic effect;

or a flow of the haptic effect;

wherein the processor, when executing the haptic spatialization module, is further configured to modify the haptic effect definition based on the received spatialization data;

wherein the processor, when executing the haptic spatialization module, is further configured to send a haptic instruction and the modified haptic effect definition to the peripheral device; and

wherein the processor, when executing the haptic spatialization module, is further configured to cause one or more haptic output devices to produce one or more haptic effects based on the modified haptic effect definition at the peripheral device in response to the haptic instruction.

27. The system of claim 26,

wherein the processor, when executing the haptic spatialization module, is further configured to divide the haptic effect definition into one or more haptic effect definition components;

wherein the processor, when executing the haptic spatialization module, is further configured to send the one or more haptic effect definition components to the peripheral device;

wherein the processor, when executing the haptic spatialization module, is further configured to cause the one or more haptic output devices to produce the one or more haptic effects based on the one or more haptic effect definition component.

28. The system of claim 27,

wherein the processor, when executing the haptic spatialization module, is further configured to scale, based on the spatialization data, at least one of:

a magnitude of the haptic data of at least one haptic effect definition component;

a frequency of the haptic data of at least one haptic effect component;

or a duration of the haptic data of at least one haptic effect component.

29. The system of claim 27,

wherein the processor, when executing the haptic spatialization module, is further configured to attenuate, based on the spatialization data, at least one of:

a magnitude of the haptic data of at least one haptic effect definition component;

a frequency of the haptic data of at least one haptic effect definition component;

or a duration of the haptic data of at least one haptic effect definition component.

30. The system of claim 27,

wherein the processor, when executing the haptic spatialization module, is further configured to cause at least one haptic output device to delay a playback of at least one haptic effect based on the spatialization data.