Method and apparatus to provide a virtualized audio file

• US 10,129,682 B2
• Filed: 06/07/2016
• Issued: 11/13/2018
• Est. Priority Date: 01/06/2012
• Status: Active Grant

• Current Assignee: Bacch Laboratories Inc.
• Original Assignee: Bacch Laboratories Inc.
• Inventors: Mentz, James
• Primary Examiner(s): Islam, Mohammad
• Application Number:
  US15/175,901
• Publication Number:
  US 20160295341A1
• Time in Patent Office: 889 Days
• CPC Class Codes: H04R 1/1041 Mechanical or electronic switches, or control elements switches in general H01H
• CPC Class Codes: H04R 2460/07 Use of position data from wide-area or local-area positioning systems in hearing devices, e.g. program or information selection
• CPC Class Codes: H04S 1/007 in which the audio signals are in digital form data reduction aspects thereof based on psychoacoustics G10L19/02
• CPC Class Codes: H04S 2400/15 Aspects of sound capture and related signal processing for recording or reproduction
• CPC Class Codes: H04S 2420/01 Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
• CPC Class Codes: H04S 7/304 For headphones

Abstract

Embodiments of the subject invention relate to a method and apparatus for virtualizing an audio file. The virtualized audio file can be presented to a user via, for example, ear-speakers or headphones, such that the user experiences a change in the user'"'"'s perception of where the sound is coming from and/or 3D sound. Embodiments can utilize virtualization processing that is based on head rotated transfer functions (HRTF'"'"'s) or other processing techniques that can alter where the user perceives the sounds of the music file to originate from. A specified embodiment provides Surround Sound virtualization with DTS Surround Sensations software. Embodiments can utilize the 2-channel audio transmitted to the headphones.

Claims

1. A method for providing a virtualized audio file, comprising:

receiving a user location and a user angular direction;

receiving a virtualized audio file;

receiving a sound signal associated with at least one sound and a transmitting location;

processing the virtualized audio file based on;

the user location,

the user angular direction, and

the sound signal,

to produce a modified virtualized audio file, such that a user listening to the modified virtualized audio file would perceive the at least one sound originating from the transmitting location, if listening to the virtualized audio file via;

ear speakers,

headphones, or

wearable computing device; and

outputting the modified virtualized audio file,

wherein the ear speakers, headphones, or wearable computing device comprises a transducer apparatus,

wherein the transducer apparatus comprises;

at least one left transducer for converting a virtualized left channel signal into sound for presentation to a left ear of the user; and

at least one right transducer for converting a virtualized right channel signal into sound for presentation to a right ear of the user,

wherein when the modified virtualized audio file is provided to the transducer apparatus and the user listens to the sound from the at least one left transducer via the left ear of the user, and listens to the sound from the at least one right transducer via the right ear of the user, the user perceives the at least one sound originating from the transmitting location, and

wherein the method further comprises;

capturing information regarding one or more of the following;

a position of the transducer apparatus;

an angular direction of the transducer apparatus;

movement of the transducer apparatus; and

rotation of the transducer apparatus; and

processing the modified virtualized audio file based on the captured information to produce a processed modified virtualized audio file, such that when the virtualized left channel signal and the virtualized right channel signal based on the processed modified virtualized audio file are converted to sound and the user listens to the sound from the at least one left transducer via the left ear of the user, and listens to the sound from the at least one right transducer via the right ear of the user, the user perceives the at least one sound originating from the transmitting location even if the position of the transducer apparatus changes, an angular direction of the transducer apparatus changes, there is movement of the transducer apparatus, or there is rotation of the transducer apparatus.

2. The method according to claim 1,

wherein capturing information comprises:

capturing information regarding the position of the transducer apparatus; and

capturing information regarding the angular direction of the transducer apparatus.

3. The method according to claim 2,

wherein capturing information comprises:

capturing information regarding movement acceleration of the transducer apparatus; and

capturing information regarding rotational acceleration of the transducer apparatus.

4. The method according to claim 3,

wherein processing the modified virtualized audio file based on the captured information comprises:

(a) inputting captured information regarding the position of the transducer apparatus and captured information regarding the angular direction of the transducer apparatus,

(b) inputting captured information regarding movement acceleration of the transducer apparatus and captured information regarding rotational acceleration of the transducer apparatus;

(c) calculating a new position and a new angular direction based on the captured information regarding the position of the transducer apparatus, the captured information regarding the angular direction, the captured information regarding movement acceleration of the transducer apparatus, and the captured information regarding rotational acceleration of the transducer apparatus; and

(d) processing the modified virtualized audio file using the new position and the new angular direction to produce the processed virtualized audio file, such that when the virtualized left channel signal and the virtualized right channel signal based on the processed modified virtualized audio file are converted to sound and the user listens to the sound from the at least one left transducer via the left ear of the user, and listens to the sound from the at least one right transducer via the right ear of the user, the user perceives the at least one sound originating from the transmitting location even if the position of the transducer apparatus changes, an angular direction of the transducer apparatus changes, there is movement of the transducer apparatus, or there is rotation of the transducer apparatus.

5. The method according to claim 4,

wherein the captured information regarding the position of the transducer apparatus comprises:

information regarding movement acceleration of the transducer apparatus, and

wherein the new position is calculated via double integrating the movement acceleration of the transducer apparatus.

6. The method according to claim 5,

wherein the captured information regarding the angular direction of the transducer apparatus comprises:

information regarding rotational acceleration of the transducer apparatus, and

wherein the new angular direction is calculated via double integrating the rotational acceleration of the transducer apparatus.

7. The method according to claim 4, further comprising:

(e) repeating b, c, and d over a time period T;

(f) capturing additional information regarding the position of the transducer apparatus and additional information regarding the angular direction of the transducer apparatus;

(g) recalibrating the new position and the new angular direction,

wherein recalibrating the new position comprises;

replacing the new position with a measured position of the transducer apparatus,

wherein the measured position is determined using the captured additional information regarding the position of the transducer apparatus,

wherein recalibrating the new angular direction comprises;

replacing the new angular direction with a measured angular direction,

wherein the measured angular direction is determined using the captured additional information regarding the angular direction of the transducer apparatus.

8. The method according to claim 1,

wherein the information regarding the angular direction of the transducer apparatus is a measured angular direction of a device with a known orientation with respect to the transducer apparatus.

9. The method according to claim 7, further comprising:

repeating e, f, and g every T seconds,

wherein T is less than or equal to 0.01.

10. The method according to claim 7, further comprising:

repeating e, f, and g every T seconds,

wherein T is less than or equal to 0.001.

11. The method according to claim 7,

wherein the captured additional information regarding the angular direction of the transducer apparatus is a measured angular direction of the transducer apparatus, and

wherein the measured angular direction of the transducer apparatus is measured via a digital compass.

12. The method according to claim 7,

wherein the measured angular direction of the transducer apparatus comprises:

a first angle with respect to a first reference angle in a horizontal plane.

13. The method according to claim 12,

wherein the measured angular direction comprises:

a second angle with respect to a second reference angle in a vertical plane.

14. The method according to claim 7,

wherein the captured additional information regarding the angular direction of the transducer apparatus is a measured angular direction of the transducer apparatus, and

wherein the measured angular direction of the transducer apparatus is measured via a heading sensor.

15. The method according to claim 7,

wherein the captured additional information regarding the angular direction of the transducer apparatus is a measured angular direction of the transducer apparatus, and

wherein the measured angular direction is measured via a tilt sensor and at least one accelerometer.

16. The method according to claim 7,

wherein the captured additional information regarding the angular direction of the transducer apparatus is a measured angular direction of the transducer apparatus, and

wherein the measured angular direction is provided in a number of degrees with respect to a fixed reference heading in a horizontal plane.

17. A non-transitory computer-readable medium containing a set of instructions to cause a computer to perform a method comprising:

receiving a user location and a user angular direction;

receiving a virtualized audio file;

receiving a sound signal associated with at least one sound and a transmitting location;

processing the virtualized audio file based on;

the user location,

the user angular direction, and

the sound signal,

to produce a modified virtualized audio file, such that a user listening to the modified virtualized audio file

would perceive the at least one sound originating from the transmitting location, if listening to the modified virtualized audio file via;

ear speakers,

headphones, or

wearable computing device; and

outputting the modified virtualized audio file,

wherein the ear speakers, headphones, or wearable computing device comprises a transducer apparatus,

wherein the transducer apparatus comprises;

at least one left transducer for converting a virtualized left channel signal into sound for presentation to a left ear of the user; and

at least one right transducer for converting a virtualized right channel signal into sound for presentation to a right ear of the user,

wherein when the modified virtualized audio file is provided to the transducer apparatus and the user listens to the sound from the at least one left transducer via the left ear of the user, and listens to the sound from the at least one right transducer via the right ear of the user, the user perceives the at least one sound originating from the transmitting location, and

wherein the method further comprises;

capturing information regarding one or more of the following;

a position of the transducer apparatus;

an angular direction of the transducer apparatus;

movement of the transducer apparatus; and

rotation of the transducer apparatus; and

processing the modified virtualized audio file based on the captured information to produce a processed modified virtualized audio file, such that when the virtualized left channel signal and the virtualized right channel signal based on the processed modified virtualized audio file are converted to sound and the user listens to the sound from the at least one left transducer via the left ear of the user, and listens to the sound from the at least one right transducer via the right ear of the user, the user perceives the at least one sound originating from the transmitting location even if the position of the transducer apparatus changes, an angular direction of the transducer apparatus changes, there is movement of the transducer apparatus, or there is rotation of the transducer apparatus.

19. The non-transitory computer-readable medium according to claim 17,

wherein capturing information comprises:

capturing information regarding the position of the transducer apparatus; and

capturing information regarding the angular direction of the transducer apparatus.

20. The non-transitory computer-readable medium according to claim 19,

wherein capturing information comprises:

capturing information regarding movement acceleration of the transducer apparatus; and

capturing information regarding rotational acceleration of the transducer apparatus.

21. The non-transitory computer-readable medium according to claim 20,

wherein processing the modified virtualized audio file based on the captured information comprises:

(a) inputting captured information regarding the position of the transducer apparatus and captured information regarding the angular direction of the transducer apparatus,

(b) inputting captured information regarding movement acceleration of the transducer apparatus and captured information regarding rotational acceleration of the transducer apparatus;

(c) calculating a new position and a new angular direction based on the captured information regarding the position of the transducer apparatus, the captured information regarding the angular direction, the captured information regarding movement acceleration of the transducer apparatus, and the captured information regarding rotational acceleration of the transducer apparatus; and

(d) processing the modified virtualized audio file using the new position and the new angular direction to produce the processed virtualized audio file, such that when the virtualized left channel signal and the virtualized right channel signal based on the processed modified virtualized audio file are converted to sound and the user listens to the sound from the at least one left transducer via the left ear of the user, and listens to the sound from the at least one right transducer via the right ear of the user, the user perceives the at least one sound originating from the transmitting location even if the position of the transducer apparatus changes, an angular direction of the transducer apparatus changes, there is movement of the transducer apparatus, or there is rotation of the transducer apparatus.

22. The non-transitory computer-readable medium according to claim 21, wherein the method further comprises:

(e) repeating b, c, and d over a time period T;

(f) capturing additional information regarding the position of the transducer apparatus and additional information regarding the angular direction of the transducer apparatus;

(g) recalibrating the new position and the new angular direction,

wherein recalibrating the new position comprises;

replacing the new position with a measured position of the transducer apparatus,

wherein the measured position is determined using the captured additional information regarding the position of the transducer apparatus,

wherein recalibrating the new angular direction comprises;

replacing the new angular direction with a measured angular direction,

wherein the measured angular direction is determined using the captured additional information regarding the angular direction of the transducer apparatus.

23. The non-transitory computer-readable medium according to claim 22, further comprising:

repeating e, f, and g every T seconds,

wherein T is less than or equal to 0.01.

24. The non-transitory computer-readable medium according to claim 22, further comprising:

repeating e, f, and g every T seconds,

wherein T is less than or equal to 0.001.

25. The system according to claim 17,

wherein the processor is configured to receive captured information regarding:

the position of the transducer apparatus; and

the angular direction of the transducer apparatus.

26. The system according to claim 25,

wherein the processor is configured to receive captured information regarding:

movement acceleration of the transducer apparatus; and

rotational acceleration of the transducer apparatus.

27. The system according to claim 26,

wherein the processor is configured to process the modified virtualized audio file based on the captured information via:

(a) receiving captured information regarding the position of the transducer apparatus and captured information regarding the angular direction of the transducer apparatus,

(b) receiving captured information regarding movement acceleration of the transducer apparatus and captured information regarding rotational acceleration of the transducer apparatus;

(c) calculating a new position and a new angular direction based on the captured information regarding the position of the transducer apparatus, the captured information regarding the angular direction, the captured information regarding movement acceleration of the transducer apparatus, and the captured information regarding rotational acceleration of the transducer apparatus; and

(d) processing the modified virtualized audio file using the new position and the new angular direction to produce the processed virtualized audio file, such that when the virtualized left channel signal and the virtualized right channel signal based on the processed modified virtualized audio file are converted to sound and the user listens to the sound from the at least one left transducer via the left ear of the user, and listens to the sound from the at least one right transducer via the right ear of the user, the user perceives the at least one sound originating from the transmitting location even if the position of the transducer apparatus changes, an angular direction of the transducer apparatus changes, there is movement of the transducer apparatus, or there is rotation of the transducer apparatus.

28. The system according to claim 27, further comprising:

(e) repeating b, c, and d over a time period T;

(f) receiving additional captured information regarding the position of the transducer apparatus and additional captured information regarding the angular direction of the transducer apparatus;

(g) recalibrating the new position and the new angular direction,

wherein recalibrating the new position comprises;

replacing the new position with a measured position of the transducer apparatus,

wherein the measured position is determined using the captured additional information regarding the position of the transducer apparatus,

wherein recalibrating the new angular direction comprises;

replacing the new angular direction with a measured angular direction,

wherein the measured angular direction is determined using the captured additional information regarding the angular direction of the transducer apparatus.

29. The system according to claim 28, further comprising:

repeating e, f, and g every T seconds,

wherein T is less than or equal to 0.01.

30. The system according to claim 28, further comprising:

repeating e, f, and g every T seconds,

wherein T is less than or equal to 0.001.

18. An audio virtualization system for providing a virtualized audio file to a user, comprising:

a processor,

wherein the processor is configured to;

receive a user location and a user angular direction;

receive a virtualized audio file;

receive a sound signal associated with at least one sound and a transmitting location;

process the virtualized audio file based on;

the user location,

the user angular direction, and

the sound signal,

to produce a modified virtualized audio file, such that a user listening to the modified virtualized audio file

would perceive the at least one sound originating from the transmitting location, if listening to the virtualized audio file via;

ear speakers,

headphones, or

wearable computing device; and

output the modified virtualized audio file,

wherein the ear speakers, headphones, or wearable computing device comprises a transducer apparatus,

wherein the transducer apparatus comprises;

at least one left transducer for converting a virtualized left channel signal into sound for presentation to a left ear of the user; and

at least one right transducer for converting a virtualized right channel signal into sound for presentation to a right ear of the user,

wherein when the modified virtualized audio file is provided to the transducer apparatus and the user listens to the sound from the at least one left transducer via the left ear of the user, and listens to the sound from the at least one right transducer via the right ear of the user, the user perceives the at least one sound originating from the transmitting location, and

wherein processor is further configured to;

receive captured information regarding one or more of the following;

a position of the transducer apparatus;

an angular direction of the transducer apparatus;

movement of the transducer apparatus; and

rotation of the transducer apparatus; and

process the modified virtualized audio file based on the captured information to produce a processed modified virtualized audio file, such that when the virtualized left channel signal and the virtualized right channel signal based on the processed modified virtualized audio file are converted to sound and the user listens to the sound from the at least one left transducer via the left ear of the user, and listens to the sound from the at least one right transducer via the right ear of the user, the user perceives the at least one sound originating from the transmitting location even if the position of the transducer apparatus changes, an angular direction of the transducer apparatus changes, there is movement of the transducer apparatus, or there is rotation of the transducer apparatus.