3-DIMENSIONAL AUDIO PROJECTION

• US 20150223005A1
• Filed: 04/08/2014
• Published: 08/06/2015
• Est. Priority Date: 01/31/2014
• Status: Abandoned Application

• Current Assignee: Raytheon Company (Rtx Corporation)
• Original Assignee: Raytheon Company (Rtx Corporation)
• Inventors: Hardman, Brian T., Sobczak, Scott, Garro, John M., Weber, Kevin R.
• Application Number:
  US14/248,083
• Publication Number:
  US 20150223005A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: H04S 2400/11 Positioning of individual sound objects, e.g. moving airplane, within a sound field H04S2420/13 takes precedence
• CPC Class Codes: H04S 2420/01 Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
• CPC Class Codes: H04S 7/304 For headphones

Abstract

Described are computer-based methods and systems, including non-transitory computer program products, for audio data processing. In some examples, a 3-dimensional audio projection method includes receiving a signal including audio data and perceived location data. The perceived location data corresponds to a desired location from which sound associated with the audio data is to be perceived by a user in a 3-dimensional virtual environment. In addition, the method includes receiving a location and orientation of the user in physical space; determining a physical location in the physical space in which the user is to perceive the sound based on the perceived location data and the location and orientation of the user in physical space; and projecting the sound to the user in a 3-dimensional format based on the physical location in the physical space.

Claims

1. A method for 3-dimensional audio projection, the method comprising:

receiving, by one or more processors, a signal including audio data and perceived location data, the perceived location data corresponding to a desired location from which sound associated with the audio data is to be perceived by a user in a 3-dimensional virtual environment;

receiving, by the one or more processors, a location and orientation of the user in physical space;

determining, by the one or more processors, a physical location in the physical space in which the user is to perceive the sound based on the perceived location data and the location and orientation of the user in physical space; and

projecting the sound to the user in a 3-dimensional format based on the physical location in the physical space.

2. The method of claim 1 further comprising:

determining, by the one or more processors, the location of the user in the physical space based on data received from a positioning device; and

determining, by the one or more processors, the orientation of the user based on a line of sight of the user.

3. The method of claim 1 wherein the 3-dimensional virtual environment is based on a scene presented to the user on a display device.

4. The method of claim 1 wherein determining, by the one or more processors, a physical location in the physical space in which the user is to perceive the sound further includes:

determining, by the one or more processors, a virtual location and virtual orientation of the user in the 3-dimensional virtual environment; and

mapping, by the one or more processors, the virtual location and virtual orientation of the user to the physical location.

5. The method of claim 4 wherein determining the virtual location and virtual orientation of the user in the 3-dimensional virtual environment includes:

identifying an avatar in the 3-dimensional virtual environment, wherein the avatar is a representation of the user in the 3-dimensional environment; and

determining the virtual location and virtual orientation on the avatar in the 3-dimensional environment.

6. A system for 3-dimensional audio projection, the system comprising:

a memory; and

one or more processors in communication with the memory, the one or more processors configured to;

receive a signal including audio data and perceived location data, the perceived location data corresponding to a desired location from which sound associated with the audio data is to be perceived by a user in a 3-dimensional virtual environment;

receive a location and orientation of the user in physical space;

determine a physical location in the physical space in which the user is to perceive the sound based on the perceived location data and the location and orientation of the user in physical space; and

project the sound to the user in a 3-dimensional format based on the physical location in the physical space.

7. The system of claim 6 wherein the one or more processors are further configured to:

determine the location of the user in the physical space based on data received from a positioning device; and

determine the orientation of the user based on a line of sight of the user based on data received from the positioning device.

8. The system of claim 6 wherein the 3-dimensional virtual environment is based on a scene presented to the user on a display device.

9. The system of claim 6 further wherein the one or more processors are further configured to:

determine a virtual location and virtual orientation of the user in the 3-dimensional virtual environment; and

map the virtual location and virtual orientation of the user to the physical location.

10. The system of claim 9 wherein the one or more processors are further configured to:

identify an avatar in the 3-dimensional virtual environment, wherein the avatar is a representation of the user in the 3-dimensional environment; and

determine the virtual location and virtual orientation of the avatar in the 3-dimensional environment.