Metadata time marking information for indicating a section of an audio object

• US 9,105,300 B2
• Filed: 10/14/2010
• Issued: 08/11/2015
• Est. Priority Date: 10/19/2009
• Status: Expired due to Fees

• Current Assignee: Dolby International AB (Dolby Laboratories Incorporated)
• Original Assignee: Dolby International AB (Dolby Laboratories Incorporated)
• Inventors: Resch, Barbara, Engdegrd, Jonas
• Primary Examiner(s): Chawan, Vijay B
• Application Number:
  US13/499,892
• Publication Number:
  US 20120197650A1
• Time in Patent Office: 1,762 Days
• Field of Search: 704/200, 704/200.1, 704500-504, 704/278, 709/242, 709/204, 709/205, 370/352, 455/3.06, 725/45, 725/112, 725/113, 707/999.107, 369/1, 846/09, 713/863, 713/201, 345/473, 345/163, 701/3, 701/14, 701/33.4
• US Class Current: 1/1
• CPC Class Codes: G10L 21/04 Time compression or expansion
• CPC Class Codes: G10L 25/00 Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 muting semiconductor-based amplifiers when some special characteristics of a signal are sensed by a speech detector, e.g. sensing when no signal is present, H03G3/34
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence

Abstract

The application relates to a method for encoding time marking information within audio data. According to the method, time marking information is encoded as audio metadata within the audio data. The time marking information indicates at least one section of an audio object encoded in the audio data. E.g. the time marking information may specify a start position and an end position of the section or only a start position. The at least one section may be a characteristic part of the audio object, which allows instant recognition by listening. The time marking information encoded in the audio data enables instantaneous browsing to a certain section of the audio object. The application further relates to a method for decoding the time marking information encoded in the audio data.

Claims

1. A method for encoding time marking information within audio data, wherein the audio data is a bitstream, the method comprising:

encoding time marking information as audio metadata within the audio data, thereby forming a joint bitstream, wherein the time marking information indicates a plurality of sections of an audio object in the audio data;

wherein the time marking information is encoded in multiple positions of the audio data;

wherein the multiple positions occur at a particular occurrence rate in the audio data bitstream;

wherein time marking information in a given position of the multiple positions is specified in relation to the occurrence of the given position in the audio data bitstream; and

wherein the time marking information is encoded in a metadata container of the joint bitstream;

thereby enabling a corresponding decoder to start playback of the audio object at a beginning of a section of the audio object indicated by the time marking information.

2. The method of claim 1, wherein the audio object is a piece of music.

3. The method of claim 1, wherein the section is a characteristic part of the audio object.

4. The method of claim 3, wherein the audio object is a piece of music, and the section is the chorus, the refrain or a part thereof.

5. The method of claim 1, wherein the audio object is a piece of music, and the plurality of sections are different sections relating to the temporal musical structure of the piece of music.

6. The method of claim 5, wherein the plurality of sections include at least one of the following sections:

an introduction,

a verse,

a refrain or chorus,

a bridge, or

a solo.

7. The method of claim 1, wherein the audio object is a piece of music, and the time marking information indicates at least one of the following:

the occurrence of a specific instrument or instrument group within the piece of music,

the occurrence of a singing voice,

the loudest part of the piece of music,

a theme,

a motive, or

a variation of a theme.

8. The method of claim 1, wherein the time marking information specifies

a start position and

an end position or duration of the section.

9. The method of claim 1, the method comprising:

encoding labeling information in the audio data, the labeling information labeling the plurality of sections of the audio object;

wherein the labeling information is encoded as metadata of the joint bitstream.

10. The method of claim 9, wherein the audio object is a piece of music, and wherein the time marking information indicates a section having a particular musical property, and wherein the labeling information describes the particular musical property for the section.

11. The method of claim 10, wherein the musical property includes one of the following:

a particular tempo,

a particular articulation,

a particular mood,

a particular tonality, or

a particular musical style or genre.

12. The method of claim 9, wherein the labeling information is encoded as a text label.

13. The method of claim 9, wherein the labeling information is encoded as an index of a table.

14. The method of claim 1, wherein the time marking information comprises

a second value,

a second value and fractional second value,

a sample number,

a frame number,

an integer frame number and an integer sample number, or

an integer frame number and a fractional frame value.

15. The method of claim 1, wherein the time marking information is encoded in

an extension payload container of MPEG-2 or -4 AAC audio data, or

a metadata container compliant with MPEG-4 Part 12.

16. A method for decoding time marking information in a joint bitstream comprising audio data and audio metadata, the method comprising:

decoding time marking information provided as the audio metadata in the joint bitstream, the time marking information indicating a plurality of sections of an audio object encoded in the audio data;

wherein the time marking information is encoded in multiple positions of the audio data; and

wherein the time marking information is encoded in a metadata container of the joint bitstream;

wherein time marking information in a given position of the multiple positions is specified in relation to the occurrence of the given position in the audio data bitstream; and

wherein the multiple positions occur at a particular occurrence rate in the audio data bitstream;

thereby enabling to start playback of the audio object at a beginning of a section of the audio object indicated by the time marking information.

17. An encoder configured to encode time marking information as audio metadata within audio data, wherein the audio data is a bitstream, thereby forming a joint bitstream;

wherein the time marking information indicates a plurality of sections of an audio object encoded in the audio data;

wherein the time marking information is encoded in multiple positions of the audio data;

wherein the multiple positions occur at a particular occurrence rate in the audio data bitstream;

wherein time marking information in a given position of the multiple positions is specified in relation to the occurrence of the given position in the audio data bitstream; and

wherein the time marking information is encoded in a metadata container of the joint bitstream;

thereby enabling a corresponding decoder to start playback of the audio object at a beginning of a section of the audio object indicated by the time marking information.

18. A decoder configured to decode time marking information provided as audio metadata in a joint bitstream comprising audio data, wherein the time marking information indicates a plurality of sections of an audio object encoded in the audio data;

wherein the time marking information is encoded in multiple positions of the audio data;

wherein the multiple positions occur at a particular occurrence rate in the audio data bitstream;

wherein time marking information in a given position of the multiple positions is specified in relation to the occurrence of the given position in the audio data bitstream; and

wherein the time marking information is encoded in a metadata container of the joint bitstream;

thereby enabling the decoder to start playback of the audio object at a beginning of a section of the audio object indicated by the time marking information.

19. A non-transitory computer readable storage medium, storing software instructions, for encoding time marking information within audio data wherein the audio data is a bitstream, which when executed by one or more processors cause performing:

encoding time marking information as audio metadata within the audio data, thereby forming a joint bitstream, wherein the time marking information indicates a plurality of sections of an audio object in the audio data;

wherein the time marking information is encoded in multiple positions of the audio data;

wherein the multiple positions occur at a particular occurrence rate in the audio data bitstream;

wherein time marking information in a given position of the multiple positions is specified in relation to the occurrence of the given position in the audio data bitstream; and

wherein the time marking information is encoded in a metadata container of the joint bitstream;

thereby enabling a corresponding decoder to start playback of the audio object at a beginning of a section of the audio object indicated by the time marking information.