Method and apparatus for ultrasonic directional sound applicable to vehicles

• US 10,522,165 B2
• Filed: 08/03/2017
• Issued: 12/31/2019
• Est. Priority Date: 04/15/2003
• Status: Active Grant

• Current Assignee: IpVenture, Inc.
• Original Assignee: IpVenture, Inc.
• Inventors: Cheung, Kwok Wai, Tong, Peter P., Thomas, C. Douglass
• Primary Examiner(s): Ramakrishnaiah, Melur
• Application Number:
  US15/667,742
• Publication Number:
  US 20180018988A1
• Time in Patent Office: 880 Days
• Field of Search: 381 98, 381 77, 381182
• CPC Class Codes: G10L 21/0208 Noise filtering
• CPC Class Codes: H04R 1/403 loud-speakers
• CPC Class Codes: H04R 2201/023 Transducers incorporated in garment, rucksacks or the like
• CPC Class Codes: H04R 2217/03 Parametric transducers where sound is generated or captured by the acoustic demodulation of amplitude modulated ultrasonic waves
• CPC Class Codes: H04R 25/405 by combining a plurality of transducers
• CPC Class Codes: H04R 3/12 for distributing signals to two or more loudspeakers specially adapted for hearing aids H04R25/407

Abstract

Methods and systems to produce audio output signals from audio input signals. In one embodiment, a first portion of the audio input signals can be pre-processed, with the output used to modulate ultrasonic carrier signals, thereby producing modulated ultrasonic signals. The modulated ultrasonic signals can be transformed into a first portion of the audio output signals, which is directional. Based on a second portion of the audio input signals, a standard audio speaker can output a second portion of the audio output signals. Another embodiment further produces distortion compensated signals based on the pre-processed signals. The distortion compensated signals can be subtracted from the second portion of the audio input signals to generate inputs for the standard audio speaker to output the second portion of the audio output signals. In yet another embodiment, noise can be added during pre-processing of the first portion of the audio input signals.

Claims

1. A method to at least produce audio output sound, for a user, from audio input signals, the audio output sound comprising at least a first portion of the audio output sound and a second portion of the audio output sound, with the frequencies of at least a part of the first portion of the audio output sound being less than all the frequencies of the second portion of the audio output sound, the method comprising:

providing ultrasonic input signals as inputs to an ultrasonic speaker to generate at least ultrasonic output sound to be transformed in air into the second portion of the audio output sound, the second portion of the audio output sound being directional; and

providing non-ultrasonic input signals as inputs to a non-ultrasonic speaker to generate at least the first portion of the audio output sound, wherein the non- ultrasonic speaker is configured not to generate ultrasonic sound,

wherein at least the first portion of the audio output sound is combined in air with the second portion of the audio output sound to form the audio output sound, and

wherein at least the ultrasonic input signals and the non-ultrasonic input signals are from the audio input signals.

2. A method as recited in claim 1,

wherein the second portion of the audio output sound is directional in at least a direction, and

wherein the method comprises electronically steering the direction of the second portion of the audio output sound.

3. A method as recited in claim 2, wherein the method comprises:

identifying electronically an area of the user; and

steering electronically the direction of the second portion of the audio output sound towards the identified area of the user.

4. A method as recited in claim 3,

tracking electronically the area of the user as the user moves;

and

steering electronically the direction of the second portion of the audio output sound towards the area of the user being tracked as the user moves.

5. A method as recited in claim 4, wherein the method comprises receiving voice inputs from the user via a directional microphone directed towards the user.

6. A method as recited in claim 1 further comprising wirelessly receiving at least a portion of the audio input signals via wireless communication circuitries.

7. A method as recited in claim 1, wherein at least the ultrasonic speaker is attached to a vehicle, with the user being in the vehicle.

8. A computer-implemented method to at least produce a first audio output sound for a first user, and a second audio output sound for a second user by an ultrasonic speaker system, the method comprising:

generating at least a first ultrasonic output sound and a second ultrasonic sound by the ultrasonic speaker system, with the first ultrasonic output sound to be transformed in air into at least a portion of the first audio output sound, the at least a portion of the first audio output sound being directional in at least a first direction, and with the second ultrasonic output sound to be transformed in air into at least a portion of the second audio output sound, the at least a portion of the second audio output sound being directional in at least a second direction;

tracking the first user and tracking the second user; and

steering the first direction of the at least a portion of the first audio output sound towards the first user based on the tracking the first user, and steering the second direction of the at least a portion of the second audio output sound towards the second user based on the tracking of the second user.

9. A computer-implemented method as recited in claim 8, wherein the first audio output sound is configured to reach the first user after the first audio output sound is reflected by a surface.

10. A computer-implemented method as recited in claim 9, wherein both the ultrasonic speaker and the surface are in a vehicle.

11. A computer-implemented method as recited in claim 8,

wherein the method is configured to operate in at least a mode selected from a first mode and a second mode,

wherein in the first mode, the method is configured to output the at least a portion of the first audio output sound, and

wherein in the second mode, the method is configured to output audio sound produced from an audio speaker that is non-ultrasonic.

12. A computer-implemented method as recited in claim 8 further comprising personalizing the audio output sound for the user, based on at least a hearing characteristic of the user.

13. A computer-implemented method as recited in claim 8, wherein at least the ultrasonic speaker system is attached to a vehicle, with both the first user and the second user being in the vehicle.

14. A computer-implemented method as recited in claim 8, wherein the frequencies of at least a part of the first ultrasonic output sound are at least 100 KHz.

15. An electronic system at least for producing audio output sound, for a user, from audio input signals, the audio output sound comprising at least a first portion of the audio output sound and a second portion of the audio output sound, with the frequencies of at least a part of the first portion of the audio output sound being less than all the frequencies of the second portion of the audio output sound, the system comprising:

an ultrasonic speaker configured to receive ultrasonic input signals to generate at least ultrasonic output sound to be transformed in air into the second portion of the audio output sound, the second portion of the audio output sound being directional; and

a non-ultrasonic speaker configured to receive non-ultrasonic input signals to generate at least the first portion of the audio output sound, wherein the non-ultrasonic speaker is configured not to generate ultrasonic sound,

wherein at least the first portion of the audio output sound is combined in air with the second portion of the audio output sound to form the audio output sound, and

wherein at least the ultrasonic input signals and the non-ultrasonic input signals are from the audio input signals.

16. An electronic system as recited in claim 15,

wherein the second portion of the audio output sound is directional in at least a direction, and

wherein the electronic system includes steering circuitries to steer the direction of the second portion of the audio output sound.

17. An electronic system as recited in claim 16 further comprising imaging circuitries to identify an area of the user,

wherein the steering circuitries are configured to steer the direction of the second portion of the audio output sound towards the identified area of the user.

18. An electronic system as recited in claim 17,

wherein the imaging circuitries is configured to track the area of the user as the user moves, and

wherein the steering circuitries is configured to steer the direction of the second portion of the audio output sound towards the area of the user being tracked as the user moves.

19. An electronic system as recited in claim 18 further comprising a directional microphone configured to receive voice inputs from the user with the directional microphone directed towards the user.

20. An electronic system as recited in claim 15 further comprising wireless communication circuitries configured to wirelessly receive at least a portion of the audio input signals.

21. An electronic system as recited in claim 15, wherein at least the ultrasonic speaker is attached to a vehicle, with the user being in the vehicle.

22. An electronic system at least for producing audio output sound for a user comprising:

an ultrasonic speaker configured to receive ultrasonic input signals to generate at least ultrasonic output sound to be transformed in air into at least a portion of the audio output sound, the at least a portion of the audio output sound being directional in at least a direction;

imaging circuitries configured to track an area of the user;

steering circuitries configured to steer the direction of the at least a portion of the audio output sound towards the area of the user being tracked, as the user moves; and

a directional microphone configured to receive voice inputs from the user with the directional microphone directed towards the user.

23. An electronic system as recited in claim 22, wherein the audio output sound is personalized for the user, based on at least a hearing characteristic of the user.

24. An electronic system as recited in claim 22, wherein at least the ultrasonic speaker is attached to a vehicle, with the user being in the vehicle.

43. A computer-implemented method as recited in claim 22, wherein the frequencies of at least a part of the ultrasonic sound are at least 100 KHz.

25. An electronic system at least for producing audio output sound for a user comprising:

an ultrasonic speaker configured to receive ultrasonic input signals to generate at least ultrasonic output sound to be transformed in air into at least a portion of the audio output sound, the at least a portion of the audio output sound being directional in at least a direction;

imaging circuitries configured to track an area of the user; and

steering circuitries configured to steer the direction of the at least a portion of the audio output sound towards the area of the user being tracked, as the user moves,

wherein the electronic system is configured to operate in a mode selected at least from a first mode and a second mode,

wherein in the first mode, the system is configured to output the at least a portion of the audio output sound, and

wherein in the second mode, the system is configured to output audio sound produced from an audio speaker that is non-ultrasonic.

26. An electronic system as recited in claim 25, wherein the system is configured to operate in both the first and the second modes together.

27. An electronic system as recited in claim 25, wherein at least the ultrasonic speaker is attached to a vehicle, with the user being in the vehicle.

28. A computer-implemented method by an electronic system, with at least an ultrasonic speaker, at least for producing audio sound for a user, the computer-implemented method comprising:

generating at least ultrasonic sound by at least the ultrasonic speaker to be transformed in air into at least a portion of the audio sound, the at least a portion of the audio sound being directional in at least a direction;

tracking an area of the user;

steering the direction of the at least a portion of the audio sound towards the area of the user being tracked, as the user moves;

operating in a first mode with the electronic system generating at least the ultrasonic sound; and

operating in a second mode with the electronic system generating at least another portion of the audio sound produced by an audio speaker of the electronic system, the another portion of the audio sound being non-ultrasonic.

29. A computer-implemented method as recited in claim 28 comprising operating in both the first and the second modes together.

30. A computer-implemented method as recited in claim 28, wherein the steering the direction by the electronic system doesn'"'"'t require to move any movable parts.

31. A computer-implemented method as recited in claim 30 comprising coordinating the operation of at least two ultrasonic speakers of the electronic system for the steering the direction by the electronic system without requiring to move any movable parts.

32. A computer-implemented method as recited in claim 30, wherein the area is at the head of the user.

33. A computer-implemented method as recited in claim 32 comprising capturing images of the user for the tracking.

34. A computer-implemented method as recited in claim 33 comprising analyzing at least one of the captured images of the user based on at least pattern recognition, for the tracking.

35. A computer-implemented method as recited in claim 34 comprising recognizing at least one of the ears of the user for the tracking.

36. A computer-implemented method as recited in claim 28, wherein the area is at the head of the user.

37. A computer-implemented method as recited in claim 36, wherein the area is at one of the ears of the user.

38. A computer-implemented method as recited in claim 28 comprising capturing images of the user for the tracking.

39. A computer-implemented method as recited in claim 38 comprising analyzing at least one of the captured images of the user based on at least pattern recognition, for the tracking.

40. A computer-implemented method as recited in claim 39 comprising recognizing at least one of the ears of the user for the tracking.

41. A computer-implemented method as recited in claim 40 comprising using at least a CCD array to capture the images of the user.

42. A computer-implemented method as recited in claim 28, wherein at least the ultrasonic speaker is attached to a vehicle, with the user being in the vehicle.

50. An electronic system as recited in claim 36, wherein the frequencies of at least a part of the ultrasonic sound are at least 100 KHz.

44. An electronic system at least for producing audio sound for a user comprising:

an ultrasonic speaker configured to generate at least ultrasonic sound to be transformed in air into at least a portion of the audio sound, the at least a portion of the audio sound being directional in at least a direction; and

a controller configured to track an area of the user, and to steer the direction of the at least a portion of the audio sound towards the area of the user being tracked, as the user moves;

an audio speaker that is configured to generate at least another portion of the audio sound, with the another portion of the audio sound being non-ultrasonic,

wherein the electronic system is configured to operating in a first mode to generate at least the ultrasonic sound, and a second mode to generate at least the another portion of the audio sound by the audio speaker.

45. An electronic system as recited in claim 44 comprising at least another ultrasonic speaker to steer the direction without requiring to move any movable parts by coordinating the operation of the at least two ultrasonic speakers.

46. An electronic system as recited in claim 44 wherein the area is at one of the ears of the user.

47. An electronic system as recited in claim 44 wherein the controller is configured to track at least by capturing images of the user and analyzing at least one of the captured images of the user based on at least pattern recognition.

48. An electronic system as recited in claim 47 comprising at least a CCD array to capture the images of the user.

49. An electronic system as recited in claim 44, wherein at least the ultrasonic speaker is attached to a vehicle, with the user being in the vehicle.