Recorded video broadcast, streaming, download, and disk distribution with watermarking instructions

• US 7,920,713 B2
• Filed: 12/20/2004
• Issued: 04/05/2011
• Est. Priority Date: 12/20/2004
• Status: Active Grant

• Current Assignee: Avago Technologies International Sales Pte Limited (Broadcom, Inc.)
• Original Assignee: LSI Corporation (Broadcom, Inc.)
• Inventors: Wells, Aaron G., Linzer, Elliot N.
• Primary Examiner(s): Tucker; Wesley
• Assistant Examiner(s): Bitar; Nancy
• Application Number:
  US11/017,423
• Publication Number:
  US 20060133644A1
• Time in Patent Office: 2,297 Days
• Field of Search: 382/100, 382/103, 713/176, 707/3, 707/102, 707/100, 380/22, 380/26, 380/210, 380/211, 380/212, 399/366, 370/529, 370/525, 370/526, 370/527, 725/13, 725/14, 725/18, 725/19, 725/20, 725/21, 725/31, 725/38, 725/39, 725/40, 725/41, 725/61, 725/88, 725/90, 725/102, 381/73.1, 381/239, 705/57, 705/51, 705/71, 705/75
• US Class Current: 382/100
• CPC Class Codes: G06Q 20/3829 involving key management
• CPC Class Codes: G10L 19/018 Audio watermarking, i.e. embedding inaudible data in the audio signal
• CPC Class Codes: G11B 20/00086 Circuits for prevention of unauthorised reproduction or copying, e.g. piracy indicating unauthorised use of record carriers in general G11B23/28; scrambling for television signal recording H04N5/913; network architectures or network protocols for network security H04L63/00; cryptographic mechanisms or cryptographic arrangements for secret or secure communication H04L9/00
• CPC Class Codes: G11B 20/00884 involving a watermark, i.e. a barely perceptible transformation of the original data which can nevertheless be recognised by an algorithm
• CPC Class Codes: H04N 2005/91335 the copy protection signal being a watermark
• CPC Class Codes: H04N 21/23892 involving embedding information at multiplex stream level, e.g. embedding a watermark at packet level
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/8358 involving watermark protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467
• CPC Class Codes: H04N 5/913 for scrambling ; for copy protection

Abstract

An apparatus comprising a first circuit and a second circuit. The first circuit may be configured to analyze an audio-video data stream to determine watermark appropriate information for the audio-video data stream. The second circuit may be configured to communicate the watermark appropriate information either in-band with or out-of-band from a bit stream communicating the audio-video data.

Claims

1. An apparatus comprising:

a first circuit configured to analyze an audio-video data stream to determine watermark appropriate information for said audio-video data stream, wherein said watermark appropriate information describes a location within said audio-video data where a watermark can be embedded and said watermark is embedded in said audio-video data during playback by a decoder based upon said watermark appropriate information and watermark data stored in said decoder, wherein said watermark data stored in said decoder is unique to said decoder; and

a second circuit configured to communicate said watermark appropriate information either in-band with or out-of-band from a bit stream comprising said audio-video data.

2. The apparatus according to claim 1, wherein said watermark appropriate information is communicated out-of-band in one or more of (i) one or more separate files on a medium communicating said audio-video data stream, (ii) a separate bit stream within the medium communicating said audio-video data stream, (iii) one or more separate communication channels, and (iv) one or more different communication media than said audio-video data stream.

3. The apparatus according to claim 1, wherein analyzing said audio-video data stream comprises a spatial analysis.

4. The apparatus according to claim 1, wherein analyzing said audio-video data stream comprises a temporal analysis.

5. The apparatus according to claim 1, wherein analyzing said audio-video data comprises transform domain analysis.

6. The apparatus according to claim 1, wherein analyzing said audio-video data stream comprises performing two or more analyses selected from the group consisting of spatial analysis, temporal analysis and transform domain analysis.

7. The apparatus according to claim 1, wherein said watermark appropriate information is determined according to a predetermined perceptual model involving spatial and temporal analysis of the audio-video data in real-time.

8. The apparatus according to claim 1, wherein said second circuit is further configured to perform a frame-accurate conveyance of said watermark appropriate information.

9. The apparatus according to claim 8, wherein said second circuit is further configured to convey said watermark appropriate information within the data to which said watermark appropriate information pertains.

10. The apparatus according to claim 8, wherein said second circuit is further configured to convey said watermark appropriate information in either (i) one or more previous frames or (ii) one or more subsequent frames with respect to a frame to which said watermark appropriate information pertains.

11. The apparatus according to claim 1, wherein said watermark appropriate information comprises information concerning how to embed said watermark in said audio-video data during decoding of said bit stream.

12. The apparatus according to claim 1, wherein said watermark appropriate information comprises information for instructing said decoder to embed said watermark based on one or more conditions selected from the group consisting of per player, per download, per playback session and per user.

13. The apparatus according to claim 1, wherein said second circuit is further configured to communicate information regarding watermark strength and watermark creation embedded in said bit stream.

14. The apparatus according to claim 13, wherein said information regarding watermark strength and watermark creation comprises information regarding survivability and obtrusiveness.

15. The apparatus according to claim 14, wherein said information regarding survivability and obtrusiveness is customizable by a content owner on one or both of a per-content basis and a per-player basis.

16. The apparatus according to claim 1, wherein said bit stream is compliant with an encoding standard selected from the group consisting of MPEG-1, MPEG-2, MPEG-4, WMV, VC-9, VC-1, H.262, H.263, H.264, H.264/JVC/AVC/MPEG-4 part 10, AVS 1.0, Real Networks, Divx Networks, Macromedia and other open or proprietary methods for compression of audio-video data.

17. The apparatus according to claim 1, wherein said audio-video data stream is not compressed and said watermark appropriate information is stored or communicated with said audio-video data stream.

18. The apparatus according to claim 17, wherein said watermark appropriate information is communicated via one of a vertical blanking interval (VBI), a horizontal blanking interval (HBI), a sub-picture unit (SPU), one or more chroma bits.

28. The apparatus according to claim 1, wherein the watermark appropriate information does not contain the actual watermark data embedded in the audio-video data.

31. The apparatus according to claim 1, wherein the actual watermark data is determined during decoding or playback.

19. A method for watermarking audio-video data comprising the steps of:

performing one or more analyses selected from the group consisting of spatial analysis, temporal analysis and transform domain analysis, on said audio-video data in an encoder; and

communicating a result of said one or more analyses from said encoder to a decoder either in-band with or out-of-band from a bit stream comprising said audio-video data, wherein a watermark is embedded in said audio-video data by said decoder during playback based upon said result of said one or more analyses and watermark data stored in said decoder, wherein said watermark data stored in said decoder is unique to said decoder.

20. The method according to claim 19, further comprising:

creating a watermark appropriate information database comprising watermark insertion meta data; and

performing forensic or on-the-fly detection of watermarked data based upon watermark insertion meta data retrieved from the database.

29. The method according to claim 19, wherein said watermark identifies a device on which the audio-video data is decoded for playback.

30. The method according to claim 19, wherein said result of said one or more analyses provides watermark appropriate information that comprises a data vector describing a location within a particular frame where the watermark data can be embedded by the decoder.

21. An apparatus for decoding a compressed bit stream comprising:

a first circuit configured (i) to detect watermark appropriate information communicated in-band with or out-of-band from an audio-video data bit stream and (ii) to extract said watermark appropriate information, wherein said watermark appropriate information describes a location within said audio-video data where a watermark can be embedded in said audio-video data by said apparatus during playback; and

a second circuit configured to embed one or more watermarks in said audio-video data at playback based upon said watermark appropriate information and watermark data stored in said apparatus, wherein said watermark data stored in said apparatus is unique to said apparatus.

22. The apparatus according to claim 21, wherein said apparatus is configured to perform any combination of functions selected from the group consisting of (i) optical disk player, (ii) broadcast receiver for any of digital broadcast satellite, digital cable and digital terrestrial, (iii) point-to-point streaming, (iv) point-to-point download and (v) non-volatile storage reader.

23. The apparatus according to claim 21, wherein said apparatus is configured to retrieve watermark insertion meta data from a database and perform forensic or on-the-fly detection of watermarked data based upon the watermark insertion meta data.

24. The apparatus according to claim 23, wherein said apparatus is configured to inspect a watermark overlay using information retrieved from said database.

25. A method for decoding a compressed bit stream comprising:

detecting watermark appropriate information communicated from an encoder either in-band with or out-of-band from an audio-video data bit stream, wherein said watermark appropriate information describes a location within said audio-video data where a watermark can be embedded in said audio-video data by a decoder during playback;

extracting said watermark appropriate information; and

embedding one or more watermarks in said audio-video data during playback using said decoder based on said watermark appropriate information and watermark data stored in said decoder, wherein said watermark data stored in said decoder is unique to said decoder.

26. The method according to claim 25, wherein said watermark appropriate information is communicated out-of-band in one or more of (i) one or more separate files on a medium communicating said audio-video data stream, (ii) a separate bit stream within the medium communicating said audio-video data stream, (iii) one or more separate communication channels, and (iv) one or more different communication media than said audio-video data stream.

27. The method according to claim 25, wherein said one or more watermarks are embedded based on one or more conditions selected from the group consisting of per player, per download, per playback session and per user.