Audio Conversion To Vibration Patterns

• US 20120306631A1
• Filed: 09/13/2011
• Published: 12/06/2012
• Est. Priority Date: 06/03/2011
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Hughes, Gregory F.
• Granted Patent: US 9,083,821 B2
• Time in Patent Office: Days
• US Class Current: 340/407.1
• CPC Class Codes: G08B 1/08 using electric transmission ; transformation of alarm signals to electrical signals from a different medium, e.g. transmission of an electric alarm signal upon detection of an audible alarm signal
• CPC Class Codes: G09B 21/009 Teaching or communicating with deaf persons G09B21/04 takes precedence; deaf and dumb persons G09B21/00
• CPC Class Codes: H04M 19/047 Vibrating means for incoming calls

Abstract

In general, in one aspect, a method performed by one or more processes executing on a computer systems includes receiving an audio signal comprising a range of audio frequencies including high frequencies and low frequencies, converting a first portion of the range of audio frequencies into haptic data, shifting a second portion of the range of audio frequencies to a different range of audio frequencies, and presenting at least one of the converted first portion and the shifted second portion to a human user. Other implementations of this aspect include corresponding systems, apparatus, and computer program products.

Claims

1. A method performed by one or more processes executing on an electronic device, the method comprising:

receiving an audio signal comprising a range of audio frequencies including high frequencies and low frequencies;

converting a first portion of the range of audio frequencies into haptic data;

shifting a second portion of the range of audio frequencies to a different range of audio frequencies; and

presenting at least one of the converted first portion and the shifted second portion to a human user.

2. The method of claim 1 wherein performance of the converting and the shifting overlap in time at least in part.

3. The method of claim 1 wherein performance of the converting and the shifting is order independent.

4. The method of claim 1 wherein the presenting occurs while one or more of the receiving, converting and shifting are ongoing.

5. The method of claim 1 wherein presenting the converted first portion comprises providing the human user with haptic feedback via a haptic mechanism associated with the electronic device.

6. The method of claim 5 wherein the haptic feedback comprises at least one of vibration, temperature variation, or electric stimulus.

7. The method of claim 1 wherein presenting the shifted second portion comprises providing the human user with sounds corresponding to the shifted second portion via an audio output mechanism associated with the electronic device.

8. The method of claim 1 wherein the first portion and the second portion are mutually exclusive.

9. The method of claim 1 wherein the first portion and the second portion overlap at least in part.

10. The method of claim 1 wherein converting the first portion comprises converting a subset of the low frequencies to haptic data.

11. The method of claim 1 wherein shifting the second portion comprises shifting a subset of the high frequencies to lower frequencies.

12. The method of claim 1 wherein the electronic device comprises a mobile communications device having an audio subsystem and a haptic subsystem.

13. The method of claim 1 wherein the one or both of the converting and the shifting are performed according to one or more hearing-related parameters associated with the human user.

14. The method of claim 13 wherein the one or more hearing-related parameters associated with the human user are defined by a hearing profile associated with the human user.

15. An electronic device comprising:

a processor configured to execute instructions stored in a machine-readable medium;

an audio subsystem, operatively coupled to the processor, including an audio input and an audio output;

a haptic subsystem, operatively coupled to the processor, including a haptic feedback mechanism and configured to provide a user of the electronic device with haptic feedback in response to information received from the processor;

a memory serving as the machine-readable medium and storing processor-executable instructions to cause the electronic device to perform operations comprising;

receiving, via the audio input, an audio signal comprising a range of audio frequencies including high frequencies and low frequencies;

converting a first portion of the range of audio frequencies into haptic data;

shifting a second portion of the range of audio frequencies to a different range of audio frequencies; and

presenting to the electronic device user at least one of (i) the converted first portion via the haptic feedback mechanism and (ii) the shifted second portion via the audio output.

16. The device of claim 15 wherein performance of the converting and the shifting overlap in time at least in part.

17. The device of claim 15 wherein performance of the converting and the shifting is order independent.

18. The device of claim 15 wherein the presenting occurs while one or more of the receiving, converting and shifting are ongoing.

19. The device of claim 15 wherein presenting the converted first portion comprises providing the human user with haptic feedback via the haptic feedback mechanism.

20. The device of claim 19 wherein the haptic feedback comprises at least one of vibration, temperature variation, or electric stimulus.

21. The device of claim 15 wherein presenting the shifted second portion comprises providing the electronic device user with sounds corresponding to the shifted second portion via the audio output.

22. The device of claim 15 wherein the first portion and the second portion are mutually exclusive.

23. The device of claim 15 wherein the first portion and the second portion overlap at least in part.

24. The device of claim 15 wherein converting the first portion comprises converting a subset of the low frequencies to haptic data.

25. The device of claim 15 wherein shifting the second portion comprises shifting a subset of the high frequencies to lower frequencies.

26. The device of claim 15 wherein the electronic device comprises a mobile communications device.

27. The device of claim 15 wherein the one or both of the converting and the shifting are performed according to one or more hearing-related parameters associated with the human user.

28. The device of claim 27 further comprising a hearing profile stored in the memory and configured to specify the one or more hearing-related parameters associated with the electronic device user.

29. A computer program product, encoded on a computer-readable medium, operable to cause a data processing apparatus to perform operations comprising:

receiving an audio signal comprising a range of audio frequencies including high frequencies and low frequencies;

converting a first portion of the range of audio frequencies into haptic data;

shifting a second portion of the range of audio frequencies to a different range of audio frequencies; and

presenting at least one of the converted first portion and the shifted second portion to a human user.

30. The computer program product of claim 29 wherein performance of the converting and the shifting overlap in time at least in part.

31. The computer program product of claim 29 wherein performance of the converting and the shifting is order independent.

32. The computer program product of claim 29 wherein the presenting occurs while one or more of the receiving, converting and shifting are ongoing.

33. The computer program product of claim 29 wherein presenting the converted first portion comprises providing the human user with haptic feedback via a haptic mechanism associated with the electronic device.

34. The computer program product of claim 29 wherein the haptic feedback comprises at least one of vibration, temperature variation, or electric stimulus.

35. The computer program product of claim 29 wherein presenting the shifted second portion comprises providing the human user with sounds corresponding to the shifted second portion via an audio output mechanism associated with the electronic device.

36. The computer program product of claim 29 wherein the first portion and the second portion are mutually exclusive.

37. The computer program product of claim 29 wherein the first portion and the second portion overlap at least in part.

38. The computer program product of claim 29 wherein converting the first portion comprises converting a subset of the low frequencies to haptic data.

39. The computer program product of claim 29 wherein shifting the second portion comprises shifting a subset of the high frequencies to lower frequencies.

40. The computer program product of claim 29 wherein the electronic device comprises a mobile communications device having an audio subsystem and a haptic subsystem.

41. The computer program product of claim 29 wherein the one or both of the converting and the shifting are performed according to one or more hearing-related parameters associated with the human user.

42. The computer program product of claim 41 wherein the one or more hearing-related parameters associated with the human user are defined by a hearing profile associated with the human user.