Audio reproducing apparatus corresponding to picture

• US 5,696,831 A
• Filed: 06/16/1995
• Issued: 12/09/1997
• Est. Priority Date: 06/21/1994
• Status: Expired due to Term

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Yamada, Yuji, Inanaga, Kiyofumi
• Primary Examiner(s): HARVEY, MINSUN OH
• Application Number:
  US08/491,457
• Time in Patent Office: 907 Days
• Field of Search: 381/1, 381/25, 381/17, 381/24, 381/74
• US Class Current: 381/309
• CPC Class Codes: A63F 2300/105 using inertial sensors, e.g. accelerometers, gyroscopes
• CPC Class Codes: H04R 2201/025 Transducer mountings or cabinet supports enabling variable orientation of transducer of cabinet
• CPC Class Codes: H04R 2205/022 Plurality of transducers corresponding to a plurality of sound channels in each earpiece of headphones or in a single enclosure
• CPC Class Codes: H04R 2420/07 Applications of wireless loudspeakers or wireless microphones
• CPC Class Codes: H04R 5/0335 Earpiece support, e.g. headbands or neckrests for monophonic headphones H04R1/105
• CPC Class Codes: H04S 1/007 in which the audio signals are in digital form data reduction aspects thereof based on psychoacoustics G10L19/02
• CPC Class Codes: H04S 2420/01 Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
• CPC Class Codes: H04S 2420/05 Application of the precedence or Haas effect, i.e. the effect of first wavefront, in order to improve sound-source localisation
• CPC Class Codes: H04S 7/304 For headphones
• CPC Class Codes: H04S 7/306 For headphones

Abstract

Audio reproducing apparatus reproducing an audio signal corresponding to a picture which localizes a sound image in a direction corresponding to the picture by processing an audio signal in a real-time fashion is supplied with an audio signal from a general-purpose signal source such as a laser disc a digital vibratory gyroscope detects a rotational angle of a listener'"'"'s head. In response to the detected rotational angle, the audio reproducing apparatus subjects the audio signal to a predetermined signal processing in a real-time fashion. Thus, a sound image is localized in the direction corresponding to the picture projected on a screen from a projector.

Claims

1. An apparatus for reproducing an audio signal corresponding to a video signal comprising:

audio reproducing means comprising an attachment body attached to a listener'"'"'s head and angle detecting means for detecting a movement of the listener'"'"'s head with respect to a reference position and a reference direction at predetermined angular increments; and

a signal processing unit for subjecting an audio signal corresponding to a video signal and supplied from an external signal source to a predetermined signal processing comprising first storage means for storing a measured result of an impulse response from a virtual sound source position with respect to said reference position and reference direction of the listener'"'"'s head to both ears of the listener, second storage means for storing a control signal in response to measured results of an arrival time and a sound pressure level of an audio signal from a virtual sound source position with respect to said reference position and reference direction and outputting a signal, A/D converting means for converting the audio signals in respective channels supplied from said signal source to digital signals, correcting means for correcting the digital signals from said A/D converting means based on an impulse response stored in said first storage means in response to an output signal from said angle detecting means and for correcting the digital signals based on a control signal stored in said second storage means, D/A converting means for converting digital signals output from said correcting means into two-channel analog signals, and amplifying means for amplifying the analog signals from said D/A converting means, wherein the audio signals corrected by said signal processing unit in response to the movement of the listener'"'"'s head are reproduced through said audio reproducing means so as to be localized in the direction corresponding to a reproduced video signal being viewed by the listener.

2. An apparatus for reproducing an audio signal corresponding to a video signal according to claim 1, wherein said angle detecting means comprises a vibratory gyroscope.

3. An apparatus for reproducing an audio signal corresponding to a video signal according to claim 2, wherein said signal processing unit comprises display means and wherein when said signal processing unit is energized or when said audio reproducing means and said signal processing unit are brought in electrical communication with each other, said display means displays an alarm until an operation of said vibratory gyroscope is stabilized.

4. An apparatus for reproducing an audio signal corresponding to a video signal according to claim 2, wherein when a supply of power to said signal processing unit is interrupted, said signal processing unit supplies power to at least said vibratory gyroscope and peripheral circuits of said vibratory gyroscope so that said vibratory gyroscope maintains a normal state.

5. An apparatus for reproducing an audio signal corresponding to a video signal according to claim 2, wherein said angle detecting means further comprises a plurality of applying means having different respective gains for amplifying an output signal from said vibratory gyroscope, a plurality of A/D converting means for subjecting output signals from said amplifying means to A/D conversion, and calculating means for calculating a rotational angle of the listener'"'"'s head based on digital output signals from said A/D converting means.

6. An apparatus for reproducing an audio signal corresponding to a video signal according to claim 5, wherein said angle detecting means further comprises selection means for selecting an output signal for use in said calculation of said rotational angle in said calculating means from said digital output signals from said A/D converting means based on a calculated result from said calculating means.

7. An apparatus for reproducing an audio signal corresponding to a video signal according to claim 2, wherein said angle detecting means further comprises variable gain amplifying means for amplifying an output signal from said vibratory gyroscope, a plurality of A/D converting means for subjecting output signals from said amplifying means to A/D conversion, calculating means for calculating a rotational angle of the listener'"'"'s head based on output signals from said A/D converting means, and switching means for switching gains of said variable gain amplifying means based on an output signal from said calculating means.

8. An apparatus for reproducing an audio signal corresponding to a video signal according to claim 2, wherein said angle detecting means further comprises amplifying means for amplifying an output signal from said vibratory gyroscope, a plurality of A/D converting means for subjecting output signals from said amplifying means to A/D conversion, arithmetic means for calculating a rotational angle of the listener'"'"'s head based on output signals from said A/D converting means, extracting means for extracting a DC component from the output signals from said A/D converting means, DC component removing means for removing a DC component removing means from a signal supplied to said calculating means from said A/D converting means in response to an output of said extracting means.

9. An apparatus for reproducing an audio signal corresponding to a video signal according to claim 8, wherein said DC component removing means comprises pulse width modulating means and negative feedback means, wherein an output signal from said pulse width modulating means is smoothed in response to an output signal from said extracting means, and a smoothed signal is fed as a negative feedback through said negative feedback means to an input of said amplifying means.

10. An apparatus for reproducing an audio signal corresponding to a video signal according to claim 1, wherein said audio reproducing means further comprises a pair of housings and said angle detecting means is provided at one of said pair of housings for detecting an angle of horizontal direction rotation upon movement of the listener'"'"'s head.

11. An apparatus for reproducing an audio signal corresponding to a video signal according to claim 1, wherein said angle detecting means is provided on said attachment body at a position corresponding to a top of the listener'"'"'s head when said attachment body is put on the listener'"'"'s head.

12. An apparatus for reproducing an audio signal corresponding to a video signal according to claim 1, wherein said audio reproducing means further comprises a pair of housing portions opposed to side portions of the listener'"'"'s head when the said attachment body is attached to the listener'"'"'s head, and said angle detecting means is provided at one of pair of housing portions.

13. An apparatus for reproducing an audio signal corresponding to a video signal according to claim 1, wherein said angle detecting means includes a reset switch and a direction in which the listener'"'"'s head turns when said reset switch is operated is set to said reference direction.

14. An apparatus for reproducing an audio signal corresponding to a video signal according to claim 13, wherein said reset switch is provided on said audio reproducing means.

15. An apparatus for reproducing an audio signal corresponding to a video signal according to claim 1, wherein said angle detecting means comprises a reset switch and a direction in which the listener'"'"'s head turns when said reset switch is operated is set to a reference direction with respect to reproduced video signal being viewed by the listener.

16. An apparatus for reproducing an audio signal corresponding to a video signal according to claim 15, wherein said reset switch is provided at said audio reproducing means.

17. An apparatus for reproducing an audio signal corresponding to a video signal according to claim 1, wherein said audio reproducing means further comprises a pair of audio converting means corresponding to respective ears of the listener and said attachment body comprises holding means for holding said pair of audio converting means at positions away from the respective ears of the listener when said attachment body is attached to the listener'"'"'s head.

18. An apparatus for reproducing an audio signal corresponding to a video signal according to claim 17, wherein said holding means holds said pair of audio converting means such that a direction from which a sound is output from each of said pair of audio converting means is set to a predetermined angle relative to a straight line passing through both ears of the listener.

19. An apparatus for reproducing an audio signal corresponding to a video signal according to claim 1, wherein said first storage means stores characteristics for correcting characteristics inherent in said audio reproducing means which are subjecting to convolutional integration together with an impulse response.

20. An apparatus for reproducing an audio signal corresponding to a video signal according to claim 1, wherein said signal processing unit further comprises an analog filter for correcting DC offset characteristics of said audio reproducing means.

21. An apparatus for reproducing an audio signal corresponding to a video signal according to claim 1, further comprising selection means for selectively supplying an audio signal output from said external signal source to said audio reproducing means.

22. An apparatus for reproducing an audio signal corresponding to a video signal according to claim 1, wherein said signal processing unit further comprises reverberation adding means supplied with an output signal from said A/D converting means for adding a reverberation sound to the supplied output signal by changing a reverberation time thereof.

23. An apparatus for reproducing an audio signal corresponding to a video signal according to claim 22, wherein said audio reproducing means further comprises a variable operation unit for changing a reverberation sound added by said reverberation adding means of said signal processing unit.

24. An apparatus for reproducing an audio signal corresponding to a video signal according to claim 1, further comprising transmission means for transmitting an output signal from said signal processing unit to said audio reproducing means through wireless transmission.

25. An apparatus for reproducing an audio signal corresponding to a video signal according to claim 1, wherein said audio reproducing means further comprises adjusting means for adjusting an input level of an output signal from said signal processing unit fed to said audio reproducing means.

26. An apparatus for reproducing an audio signal corresponding to a video signal according to claim 1, wherein said signal processing unit further comprises a housing portion for housing said audio reproducing means.

27. An apparatus for reproducing an audio signal corresponding to a video signal according to claim 1, wherein said correcting means comprises a convolution processing unit for subjecting an output signal from said A/D converting means to convolution processing together with an impulse response read out from said first storage means.

28. An apparatus for reproducing an audio signal corresponding to a video signal according to claim 1, wherein said correcting means comprises a signal processor for subjecting an output signal from said A/D converting means to attenuation and delay processing and an FIR filter supplied with an output signal from said signal processor, said FIR filter being also supplied with the output signal from said A/D converting means at a center one of a plurality of delay means connected in a series and forming said FIR filter, and said output signal from said A/D converting means is subjected to convolution together with an impulse response.

29. An apparatus for reproducing an audio signal corresponding to a video signal according to claim 1, wherein said correcting means comprises dividing means for dividing an output signal from said A/D converting means into two frequency bands and a convolution processing circuit having an FIR filter, said convolution processing circuit sampling a low frequency band component of an output signal from said dividing means with a sampling frequency lower than a sampling frequency of said A/D converting means, and a sampled signal from said convolution processing circuit being subjected by said FIR filter to convolution together with an impulse response read out from said first storage means, added with a signal including a high frequency band component of the output signal from said dividing means, and then output.

30. An apparatus for reproducing an audio signal corresponding to a video signal according to claim 29, wherein said correcting means further comprises processing means for carrying out an over-sampling processing by which an output signal from said FIR filter has the same sampling frequency as a sampling frequency used by said A/D converting means, and an output signal from said processing means and a signal including a high frequency band component of an output signal from said dividing means are added.

31. An apparatus for reproducing an audio signal corresponding to a video signal according to claim 29, wherein said dividing means is formed of a low-pass filter and a high-pass filter, said correcting means further comprises delay means for delaying an output signal from said high-pass filter, and an output signal from said delay means is added with an output signal from said processing means.

32. An apparatus for reproducing an audio signal corresponding to a video signal according to claim 29, wherein said dividing means is formed of a low-pass filter and a high-pass filter, said correcting means further comprises characteristic correcting means for correcting frequency characteristics of an output signal from said high-pass filter, and an output signal from said characteristic correcting means is added with an output signal from said processing means.

33. An apparatus for reproducing an audio signal corresponding to a video signal according to claim 1, wherein said audio reproducing means comprises reset means for resetting said angle detecting means, a setting switch for setting the reference direction to a direction in which the listener'"'"'s head turns when said reset means is operated, a variable adjustment switch for changing a reverberation time added to a signal output from said signal processing unit, a switch for changing an impulse response stored in said first storage means, a cable for connecting said signal processing unit and said audio reproducing means, and a connection unit provided on an end of said cable for connecting to said signal processing unit.