Three dimensional audio vision

• US 6,523,006 B1
• Filed: 01/27/1998
• Issued: 02/18/2003
• Est. Priority Date: 01/27/1998
• Status: Expired due to Term

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Parthasarathy, Balaji, Ellis, David G., Johnson, Louis J., Bloch, Peter B., Fordyce, Steven R., Munson, Bill
• Primary Examiner(s): Knepper, David D.
• Application Number:
  US09/013,848
• Time in Patent Office: 1,848 Days
• Field of Search: 704/260, 704/270, 704/273, 704/276, 382/135, 382/110, 382/114, 382/54, 340/435
• US Class Current: 704/270
• CPC Class Codes: H04S 1/005 For headphones

Abstract

Video data is received from multiple video receptors. This multidimensional video data is converted from the video receptors into a multidimensional audio representation of the multidimensional video data and are the multidimensional audio representation is output using multiple audio output devices. The conversion of the multidimensional video data includes generating a three-dimensional representation of the multidimensional video data, and generating an audio landscape representation with three-dimensional features based on the three-dimensional representation.

Claims

1. A method comprising:

receiving multidimensional video data by a plurality of video receptors;

converting the multidimensional video data from the plurality of video receptors to a multidimensional audio representation of the multidimensional video data, converting the multidimensional video data including;

generating a three-dimensional representation of the multidimensional video data; and

generating an audio landscape representation with three-dimensional features based on the three-dimensional representation; and

outputting the multidimensional audio representation by a plurality of audio output devices.

2. The method of claim 1, wherein the receiving the multidimensional video data by the plurality of video receptors is performed using a plurality of video cameras.

3. The method of claim 1, wherein the receiving the multidimensional video data by the plurality of video receptors includes the plurality of video receptors being affixed to a head of a user and being situated such that light is received from the general direction in which the head is pointed.

4. The method of claim 1, wherein the converting the multidimensional video data includes:

performing image recognition to determine recognized images from the multidimensional video data; and

mapping the recognized images to specific audio signals.

5. The method of claim 1, wherein the converting the multidimensional video data includes:

recognizing text from the multidimensional video data; and

generating audio signals equivalent to the text.

6. The method of claim 5, wherein the generating the audio signals equivalent to the text includes language translation.

7. The method of claim 1, wherein the converting the multidimensional video data includes providing a warning signal based on the multidimensional video data.

8. The method of claim 1, wherein the plurality of audio output devices includes one of headphones, ear inserts, or stereo speakers.

9. The method of claim 1, wherein generating a video landscape includes determining the distance between the plurality of video receptors and an object that is in view of the plurality of video receptors based at least in part on the differences in perspective of the object obtained from two or more of the video receptors.

10. The method of claim 9, wherein generating a video landscape includes determining the distance between the video receptors and the ground surface.

11. The method of claim 10, wherein determining the distance between the video receptors and the ground surface includes calculating the angle of the video receptors in relation to an identified point on the surface.

12. The method of claim 11, wherein calculating the angle of the video receptors in relation to an identified point on the ground surface including obtaining an angle of inclination of the video receptors.

13. An apparatus comprising:

a plurality of video receptors to receive light input and provide multidimensional video data;

a plurality of audio output devices to provide multidimensional audio output; and

a converter, coupled with the plurality of video receptors and the plurality of audio output devices, to receive the multidimensional video data from the plurality of video receptors, convert the multidimensional video data into a multidimensional audio representation of the multidimensional video data, and output the multidimensional audio representation to the plurality of audio output devices, the converter comprising;

a first generator to compile the multidimensional video data into a video landscape with three dimensional features; and

a second generator, coupled to the first generator, to generate an audio landscape representation with three dimensional features based on the video landscape.

14. The apparatus of claim 13 wherein the plurality of video receptors includes video cameras.

15. The apparatus of claim 13 wherein the plurality of video receptors are affixed to a head of a user and receive light from the general direction in which the head is pointed.

16. The apparatus of claim 13, wherein:

the first generator receives the multidimensional video data and performs image recognition to determine recognized images; and

the second generator maps the recognized images to specific audio signals.

17. The apparatus of claim 13, wherein the converter is coupled to the plurality of video receptors and the plurality of audio output devices by wireless communication media.

18. The apparatus of claim 13, wherein the plurality of audio output devices includes one of headphones, ear inserts, and stereo speakers.

19. The apparatus of claim 13, further comprising one or more inclination sensors to determine the inclination of the plurality of video receptors.

20. The apparatus of claim 19, wherein the apparatus determines the height of the plurality of video receptors above ground level at least in part by determining an angle between the plurality of video sensors and an identified point on the ground surface, wherein the angle is determined at least in part by obtaining the inclination of the plurality of video receptors using the one or more inclination sensors.

21. A system comprising:

a plurality of video receptors to receive light input and provide multidimensional video data;

a plurality of audio output devices to provide multidimensional audio output; and

a processor, coupled the plurality of video receptors and the plurality of audio output devices, to receive the multidimensional video data from the plurality of video receptors, convert the multidimensional video data into a multidimensional audio representation of the multidimensional video data, and output the multidimensional audio representation to the plurality of audio output devices, converting the multidimensional video data including;

generating a three-dimensional representation of the multidimensional video data; and

generating an audio landscape with three-dimensional features based on the three-dimensional representation.

22. A machine-readable storage medium having stored therein a plurality of programming instructions, designed to be executed by a processor, wherein the plurality of programming instructions implements the method of:

receiving multidimensional video data by a plurality of video receptors;

converting the multidimensional video data from the plurality of video receptors to a multidimensional audio representation of the multidimensional video data, converting the multidimensional video data including;

generating a three-dimensional representation of the multidimensional video data; and

generating an audio landscape with three-dimensional features based on the three-dimensional representation; and

outputting the multidimensional audio representation by a plurality of audio output devices.