Techniques for accommodating primary content (pure voice) audio and secondary content remaining audio capability in the digital audio production process

• US 8,108,220 B2
• Filed: 09/04/2007
• Issued: 01/31/2012
• Est. Priority Date: 03/02/2000
• Status: Expired due to Term

• Current Assignee: Benhov GmbH, LLC (Intellectual Ventures LLC)
• Original Assignee: Akiba Electronics Institute LLC (Intellectual Ventures LLC)
• Inventors: Saunders, William R., Vaudrey, Michael A.
• Primary Examiner(s): Abebe, Daniel D
• Application Number:
  US11/849,934
• Publication Number:
  US 20080059160A1
• Time in Patent Office: 1,610 Days
• Field of Search: 704/201, 704/500, 381/10, 381/23
• US Class Current: 704/500
• CPC Class Codes: G09B 5/04 with audible presentation of the material to be studied sound recording or reproducing G11B
• CPC Class Codes: G10L 2021/0575 Aids for the handicapped in speaking
• CPC Class Codes: G11B 20/00007 Time or data compression or expansion audio compression based on psychoacoustics G10L19/00; data processing for reproducing audio data at different playback speeds G10L21/04; video compression H04N19/00; data compression per se H03M7/30
• CPC Class Codes: G11B 20/00992 Circuits for stereophonic or quadraphonic recording or reproducing
• CPC Class Codes: G11B 20/10527 Audio or video recording; Data buffering arrangements G11B20/12 - G11B20/18 take precedence
• CPC Class Codes: G11B 2020/00036 AC-3, i.e. ATSC digital audio compression standard
• CPC Class Codes: G11B 2020/10546 specifically adapted for audio data
• CPC Class Codes: G11B 2020/10592 specifically adapted for recording or reproducing multichannel signals
• CPC Class Codes: G11B 2020/10601 surround sound signal
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: H04S 3/00 Systems employing more than two channels, e.g. quadraphonic H04S5/00, H04S7/00 take precedence

Abstract

The invention enables the inclusion of voice and remaining audio information at different parts of the audio production process. In particular, the invention embodies special techniques for VRA-capable digital mastering, accommodation of PCPV/PCA and/or SCRA signals in audio CODECs, VRA-capable encoders and decoders, and VRA in DVD and other digital audio file formats. The invention facilitates an end-listener'"'"'s voice-to-remaining audio (VRA) adjustment upon the playback of digital audio media formats by focusing on new configurations of multiple parts of the entire digital audio system, thereby enabling a new technique intended to benefit audio end-users (end-listeners) who wish to control the ratio of the primary vocal/dialog content of an audio program relative to the remaining portion of the audio content in that program. The invention facilitates storage of VRA audio programs on optical storage media, authoring systems for VRA-capable DVDs, playback hardware integrated into VRA-capable optical disc apparatus, and VRA playback hardware for use with non-VRA capable optical disc playback apparatus.

Claims

1. A non-transitory computer-readable storage medium whose contents cause an audio and/or video device to perform operations for decoding a voice-to-remaining-audio-capable (VRA-capable) audio program stored on the storage medium, the operations comprising:

identifying VRA data stored in the storage medium that assigns individual primary content pure voice (PCPV/PCA) audio tracks to first individual spatial channels and also assigns individual contextual audio tracks to second individual spatial channels, wherein the first and second individual spatial channels comprise non-VRA based audio channels; and

decoding the audio program based at least in part on the assignments contained in the VRA data.

2. The non-transitory computer-readable storage medium of claim 1 wherein the VRA data includes at least one of a combination of data bits, a data word, and a data sub-word that is identifiable by the audio and/or video device.

3. The non-transitory computer-readable storage medium of claim 1 wherein decoding the audio program comprises:

using a first decoder to decode the individual PCPV/PCA audio tracks; and

using a second decoder to decode the individual contextual audio tracks.

4. The non-transitory computer-readable storage medium of claim 1 wherein the operations further comprise outputting the decoded audio program to one or more digital and/or analog outputs.

5. The non-transitory computer-readable storage medium of claim 4 wherein the digital and/or analog outputs are coupled to a VRA-capable set-top box.

6. The non-transitory computer-readable storage medium of claim 1 wherein the VRA data stored in the storage medium further assigns auxiliary data to a third non-VRA based spatial channel.

7. The non-transitory computer-readable storage medium of claim 1 wherein the PCPV/PCA and contextual audio tracks are stored as a compressed data format on the storage medium.

8. The non-transitory computer-readable storage medium of claim 7 wherein the compressed data format is based on at least one of an LPCM format, a Dolby Digital format, a DTS format, a PCM format, an MPEG-1 format, an MPEG-2 format, an MPEG-2 ACC format, and a VRA format.

9. The non-transitory computer-readable storage medium of claim 1 wherein the first and second individual spatial channels are associated with at least one of a right front (R), a left front (L), a right surround (Rs), a left surround (Ls), a center (C), and a low frequency effect (LFE) channel.

10. The non-transitory computer-readable storage medium of claim 1 wherein the storage medium is a DVD.

11. A method for storing a voice-to-remaining-audio-capable (VRA-capable) audio program on a computer-readable storage medium, the method comprising:

receiving the VRA-capable audio program;

creating VRA data from the VRA-capable audio program that assigns individual primary content pure voice (PCPV/PCA) audio tracks to first individual spatial channels and also assigns individual contextual audio tracks to second individual spatial channels, wherein the first and second individual spatial channels are non-VRA based audio channels;

storing the VRA-capable audio program on the storage medium; and

storing the VRA data on the storage medium.

12. The method of claim 11 wherein storing the VRA-capable audio program occurs as part of a digital audio mastering process.

13. The method of claim 11 further comprising encoding the PCPV/PCA and contextual audio tracks based on at least one of an LPCM format, a Dolby Digital format, a DTS format, a PCM format, an MPEG-1 format, an MPEG-2 format, an MPEG-2 ACC format, and a VRA format.

14. The method of claim 11 wherein storing the VRA-capable audio program occurs as part of a DVD authoring process.

15. The method of claim 11 wherein storing the audio program further includes:

assigning a non-VRA based audio track to at least one of the individual first and second spatial channels; and

storing auxiliary data on the storage medium that indicates to an audio and/or video device to revert to non-VRA audio playback when the non-VRA based audio track is encountered by the audio and/or video device.

16. The method of claim 11 wherein the storage medium is a DVD.

17. The method of claim 16, further comprising authoring the DVD so that VRA audio playback can be enabled or disabled when an audio and/or video device is using the DVD.

18. The method of claim 16, further comprising creating a video title set in the DVD that automatically initiates VRA audio playback when an audio and/or video device uses the DVD.

19. An apparatus for producing voice-to-remaining-audio-capable (VRA-capable) audio, comprising:

one or more individual signal paths corresponding to non-VRA based audio channels; and

a post processor coupled to the one or more individual signal paths and configured to produce a first signal corresponding to at least one primary content pure voice (PCPV/PCA) audio track and a second signal corresponding to at least one contextual audio track, the first and second signals being based on audio information associated with the non-VRA based audio channels.

20. The apparatus of claim 19 wherein the apparatus is a VRA-capable DVD player or a set-top box for coupling to a non-VRA capable DVD player.

21. The apparatus of claim 19 wherein the non-VRA based audio channels correspond to at least one of a right front (R), a left front (L), a right surround (Rs), a left surround (Ls), a center (C), and a low frequency effect (LFE) channel.

22. The apparatus of claim 19 wherein the apparatus is a set-top box and the one or more individual signal paths include one or more digital or analog inputs.

23. The apparatus of claim 19 further comprising a control coupled to the post processor and allowing independent amplitude adjustments of the first and second signals.

24. The apparatus of claim 19 wherein the post processor is configured to sum the PCPV/PCA audio track with the contextual audio track.

25. The apparatus of claim 19 wherein the post processor is configured to produce virtual surround sound audio using the PCPV/PCA and contextual audio tracks.

26. The apparatus of claim 19 wherein the post processor is configured to output video that is synchronized with the PCPV/PCA and contextual audio tracks.