Haptic effect conversion system using granular synthesis

• US 10,082,874 B2
• Filed: 06/13/2017
• Issued: 09/25/2018
• Est. Priority Date: 06/14/2012
• Status: Active Grant

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Cruz-Hernandez, Juan Manuel, Modarres, Ali, Wu, Liwen, Birnbaum, David
• Primary Examiner(s): TRIEU, VAN THANH
• Application Number:
  US15/620,960
• Publication Number:
  US 20170285750A1
• Time in Patent Office: 469 Days
• CPC Class Codes: A63F 13/285 Generating tactile feedback signals via the game input device, e.g. force feedback
• CPC Class Codes: A63F 13/424 involving acoustic input signals, e.g. by using the results of pitch or rhythm extraction or voice recognition
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G08B 6/00 Tactile signalling systems, e.g. personal calling systems

Abstract

A system is provided that converts an input, such as audio data, into one or more haptic effects. The system applies a granular synthesis algorithm to the input in order to generate a haptic signal. The system subsequently outputs the one or more haptic effects based on the generated haptic signal. The system can also shift a frequency of the input, and also filter the input, before the system applies the granular synthesis algorithm to the input.

Claims

1. A computer-readable medium having instructions stored thereon that, when executed by a processor, cause the processor to execute a method for generating a haptic effect, the method comprising:

receiving a parameter;

generating a plurality of waveforms based on the parameter;

combining each waveform with an envelope to generate a first grain and a second grain;

combining the first grain and the second grain to generate a cloud, wherein the cloud comprises a representation of the first grain and the second grain; and

generating the haptic effect based on the cloud.

2. The computer-readable medium of claim 1, wherein the plurality of waveforms includes at least one of static data and dynamic data.

3. The computer-readable medium of claim 1, wherein the method further comprises creating the envelope using an envelope type.

4. The computer-readable medium of claim 3, wherein the envelope type comprises a sine or saturated sine.

5. The computer-readable medium of claim 3, wherein the envelope type comprises a triangle or saturated triangle.

6. The computer-readable medium of claim 3, wherein the envelope type comprises a sinc.

7. The computer-readable medium of claim 3, wherein the envelope type comprises an expodec or rexpodec.

8. The computer-readable medium of claim 3, wherein the envelope type comprises a square.

9. The computer-readable medium of claim 1, wherein the method further comprises receiving an input signal, and wherein the parameter is separate and distinct from the received input signal.

10. A system for generating a haptic effect, the system comprising:

a memory configured to store a haptic conversion module;

a processor configured to execute the haptic conversion module stored on the memory,

wherein the haptic conversion module is configured to

receive a parameter,

generate a plurality of waveforms based on the parameter,

combine each waveform with an envelope to generate a first grain and a second grain,

combine the first grain and the second grain to generate a cloud, wherein the cloud comprises a representation of the first grain and the second grain, and

generate the haptic effect based on the cloud.

11. The system of claim 10, wherein the plurality of waveforms includes at least one of static data and dynamic data.

12. The system of claim 10 wherein the haptic conversion module is further configured to create the envelope using an envelope type.

13. The system of claim 12, wherein the envelope type comprises a sine or saturated sine.

14. The system of claim 12, wherein the envelope type comprises a triangle or saturated triangle.

15. The system of claim 12, wherein the envelope type comprises a sinc.

16. The system of claim 12, wherein the envelope type comprises an expodec or rexpodec.

17. The system of claim 12, wherein the envelope type comprises a square.

18. A method to generate a haptic effect comprising:

receiving a parameter;

generating a plurality of waveforms based on the parameter;

combining each waveform with an envelope to generate a first grain and a second grain;

combining the first grain and the second grain to generate a cloud, wherein the cloud comprises a representation of the first grain and the second grain; and

generating the haptic effect based on the cloud.

19. The method of claim 18, wherein the plurality of waveforms includes at least one of static data and dynamic data.

20. The method of claim 18, further comprising creating the envelope using an envelope type comprising at least one of a sine, saturated sine, triangle, saturated triangle, sinc, expodec, rexpodec and a square.