Audio module supporting audio signature

• US 7,359,006 B1
• Filed: 05/20/2004
• Issued: 04/15/2008
• Est. Priority Date: 05/20/2003
• Status: Expired due to Fees

• Current Assignee: Micronas Gmbh (TDK Corporation)
• Original Assignee: Micronas USA Incorporated (TDK Corporation)
• Inventors: Xiang, Shuhua, Yuan, Hongjun
• Primary Examiner(s): Natnael, Paulos M.
• Application Number:
  US10/851,814
• Time in Patent Office: 1,426 Days
• Field of Search: None
• US Class Current: 348/515
• CPC Class Codes: H04N 19/467 characterised by the embedded information being invisible, e.g. watermarking
• CPC Class Codes: H04N 21/2368 Multiplexing of audio and video streams
• CPC Class Codes: H04N 21/23892 involving embedding information at multiplex stream level, e.g. embedding a watermark at packet level
• CPC Class Codes: H04N 21/242 Synchronization processes, e.g. processing of PCR [Program Clock References] arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18
• CPC Class Codes: H04N 21/4302 Content synchronisation processes, e.g. decoder synchronisation
• CPC Class Codes: H04N 21/4341 Demultiplexing of audio and video streams
• CPC Class Codes: H04N 21/8106 involving special audio data, e.g. different tracks for different languages

Abstract

A system and method embed an audio signature in a video frame. An audio signature is generated from one bit a buffer input data. Two registers store an audio signature and reference count. According to an embodiment, the audio signature is generated left/right (L/R) interleaved with the left channel data in the most significant bit (MSB).

Claims

1. A method for interlinking audio data and video data for synchronization by audio content comprising:

forming an audio fingerprint by taking a bit sequence from an audio data;

creating an audio signature by combining the audio fingerprint with a reference count that keeps a running count of all audio samples;

embedding the audio signature in a video data, wherein the video data corresponds to the audio data.

2. The method of claim 1 wherein the embedding occurs when the video data is captured.

3. The method of claim 1, wherein the reference count is embedded in a video frame header.

4. The method of claim 1, wherein the reference count is a time stamp.

5. The method of claim 1, wherein the reference count increments for every plurality of bytes of audio data.

6. The method of claim 5, wherein the reference count increments for every n*2 bytes of audio data, wherein n is the number of audio channels.

7. The method of claim 1, further comprising extracting the audio signature from the audio data and matching the audio signature to the corresponding video data using a hash lookup.

8. The method of claim 7, wherein the audio signature is split into two words.

9. The method of claim 1, wherein the audio fingerprint is embedded in a video frame header.

10. The method of claim 1, wherein the audio data is in PCM format.

11. The method of claim 1, wherein the audio data is in ADPCM format.

12. A system for encoding an audio fingerprint comprising:

a fingerprint register for receiving a bit sequence selected from an audio data;

a signature generator for embedding the bit sequence in the fingerprint register in a video data, the video data corresponding to the audio data; and

a reference count register for storing a reference count, wherein the reference count is a running count of all audio samples, wherein the signature generator embeds the reference count in the video data.

13. The system of claim 12, wherein the reference count increments for every plurality of audio data.

14. The system of claim 12, wherein one bit from every plurality of bits of audio data is shifted into the fingerprint register.

15. The system of claim 12, further comprising a hash table for synchronously reconstructing the audio data and the video data.