Service signaling recovery for multimedia content using embedded watermarks

• US 10,277,959 B2
• Filed: 03/20/2017
• Issued: 04/30/2019
• Est. Priority Date: 12/18/2014
• Status: Active Grant

• Current Assignee: Verance Corporation
• Original Assignee: Verance Corporation
• Inventors: Winograd, Joseph M., Petrovic, Rade, Zhao, Jian
• Primary Examiner(s): Mendoza, Junior O
• Application Number:
  US15/464,237
• Publication Number:
  US 20170251282A1
• Time in Patent Office: 771 Days
• CPC Class Codes: G06F 16/7837 using objects detected or recognised in the video content
• CPC Class Codes: H04N 21/23892 involving embedding information at multiplex stream level, e.g. embedding a watermark at packet level
• CPC Class Codes: H04N 21/262 Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists scheduling strategies for dispatcher in multiprogramming arrangements G06F9/4881; arrangements for scheduling broadcast services or broadcast-related services H04H60/06; flow control in packet networks H04L47/10; establishing a time schedule or organising the servicing of application requests H04L67/62
• CPC Class Codes: H04N 21/26291 for providing content or additional data updates, e.g. updating software modules, stored at the client deployment, distribution, installation, update of software G06F8/65; error detection or correction during software upgrading G06F11/1433; arrangements for updating broadcast information or broadcast-related information H04H60/25
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/4627 Rights management associated to the content security in data switching network management H04L41/28; security management or policies for network security H04L63/20; access security in wireless networks H04W12/08
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content
• CPC Class Codes: H04N 21/8358 involving watermark protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467
• CPC Class Codes: H04N 21/8586 by using a URL processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02

Abstract

Methods, devices, systems and computer program products facilitate accessing metadata associated with a primary audio visual content. Upon reception of a primary content, one or more watermark messages are extracted from the primary content obtain a server code and an interval code. A query to a metadata server is initiated based on the information obtained from the extracted watermark messages. In response to the query, service recovery information is received that includes information identifying one or more timed events, where each timed event identifies an operation to be performed at a corresponding instance in time as the primary content is being presented by the receiver device. One or more operations identified the timed events are initiated at the corresponding instance(s) in time.

Claims

1. A method for reporting usage information associated with a content, comprising:

extracting one or more watermark messages that are embedded in a content to obtain a server code and an interval code, the one or more watermark messages extracted at a receiver device using a watermark extractor that it implemented at least partially in electronic circuits;

initiating a transmission to a metadata server that includes at least in-part the server code and the interval code;

receiving service recovery information associated with the content, the service recovery information including information associated with a usage monitoring operation;

initiating a transmission to a service function server in accordance with the usage monitoring operation obtained from the service recovery information, wherein the transmission to the service function server includes content usage monitoring information indicative of a change of the content and a time value associated with the change of the content.

2. The method of claim 1, wherein the transmission to the service function server is triggered in response to detection of a change of the content.

3. The method of claim 1, wherein the change of the content includes a change of the content'"'"'s rendering timeline.

4. The method of claim 3, wherein the change of the content'"'"'s rendering timeline is indicative of one or more of:

a change to a different content;

a skip forward in the timeline of the content;

or

a skip backward in the timeline of the content.

5. The method of claim 1, wherein the transmission to the service function server is triggered in response to receiving a poll.

6. The method of claim 1, wherein the transmission to the service function server is triggered based on a timed event that identifies the usage monitoring operation to be performed at a corresponding instant in time as the content is being presented by the receiver device.

7. The method of claim 6, wherein the information corresponding to the timed event is obtained from the service recovery information comprising a plurality of timed events, wherein each timed event is associated with a time at which the corresponding timed event is scheduled to occur.

8. The method of claim 1, wherein the transmission to the service function server includes an indication as to whether or not a watermarked segment of the content is received by the receiver device.

9. The method of claim 1, wherein the transmission to the service function server is carried out based on a service identifier that identifies a service associated with the content.

10. The method of claim 1, wherein the transmission to the service function server includes timing information associated with one or more boundaries of the one or more watermark messages.

11. The method of claim 1, wherein the transmission to the service function server includes one of a service message or a service file that includes data elements encapsulated in a file of a prescribed format.

12. The method of claim 1, wherein the transmission to the service function server includes a watermark state indicator including one or more of an inactive state, an active state or a gap state.

13. A method for receiving usage information associated with a content, comprising:

extracting one or more watermark messages that are embedded in a content to obtain a server code and an interval code, the one or more watermark messages extracted at a receiver device using a watermark extractor that it implemented at least partially in electronic circuits;

initiating a transmission from the receiver device to a metadata server that includes the server code and the interval code;

receiving, at the user device, service recovery information associated with the content, the service recovery information including information associated with a usage monitoring operation;

initiating a transmission from the receiver device to a service function server in accordance with the usage monitoring operation; and

receiving, at a service function server from the receiver device, content usage monitoring information including an indication of a change of the content and a time value associated with the change of the content.

14. A method for receiving usage information associated with a content, comprising:

embedding a plurality of watermark messages in a content, one or more of the watermark messages including a sever code and an interval code, the one or more watermark messages embedded at a broadcaster device using a watermark embedder that it implemented at least partially in electronic circuits, the server code and the interval code enabling identification of a metadata server comprising service recovery information associated with the content, the service recovery information including information associated with a usage monitoring event;

receiving a request at the metadata server for service recovery information from a client device;

transmitting the service recovery information to the client device including information associated with a usage monitoring event; and

receiving, at a service function server from the client device, content usage monitoring information including an indication of a change of the content and a time value associated with the change of the content.

15. A method for receiving usage information associated with a content that includes a plurality of watermark messages, the method comprising:

receiving a request at a metadata server for service recovery information associated with a content, the request produced by a client device based on detection of watermark messages that are embedded in the content, wherein one or more of the watermark messages includes a server code that enables identification of the metadata server and an interval code that enables identification of the service recovery information, the service recovery information including information identifying a usage monitoring service server;

transmitting the service recovery information including information associated with a usage monitoring event to the client device; and

receiving, at the usage monitoring service server from the client device, content usage monitoring information including an indication of a change of the content and a time value associated with the change of the content.

16. A device, comprising:

a processor; and

a memory including processor executable code, the processor executable code when executed by the processor causes the device to;

receive a content a the device;

extract one or more watermark messages that are embedded in the content to obtain a server code and an interval code;

initiate a transmission to a metadata server that includes the server code and the interval code;

receive service recovery information associated with the content, the service recovery information including information associated with a usage monitoring operation;

initiate a transmission to a service function server in accordance with the usage monitoring operation obtained from the service recovery information, wherein the transmission to the service function server includes content usage monitoring information indicative of a change of the content and a time value associated with the change of the content.

17. The device of claim 16, wherein the transmission to the service function server is triggered in response to detection of a change of the content.

18. The device of claim 16, wherein the change of the content includes a change of the content'"'"'s rendering timeline.

19. The device of claim 18, wherein the change of the content'"'"'s rendering timeline is indicative of one or more of:

a change to a different content;

a skip forward in the timeline of the content;

or

a skip backward in the timeline of the content.

20. The device of claim 16, wherein the transmission to the service function server is triggered in response to receiving a poll.

21. The device of claim 16, wherein the transmission to the service function server is triggered based on a timed event that identifies the usage monitoring operation to be performed at a corresponding instant in time as the content is being presented by the receiver device.

22. The device of claim 21, wherein the information corresponding to the timed event is obtained from the service recovery information comprising a plurality of timed events, wherein each timed event is associated with a time at which the corresponding timed event is scheduled to occur.

23. The device of claim 16, wherein the transmission to the service function server includes an indication as to whether or not a watermarked segment of the content is received by the receiver device.

24. The device of claim 16, wherein the transmission to the service function server is carried out based on a service identifier that identifies a service associated with the content.

25. The device of claim 16, wherein the transmission to the service function server includes timing information associated with one or more boundaries of the one or more watermark messages.

26. The device of claim 16, wherein the transmission to the service function server includes one of a service message or a service file that includes data elements encapsulated in a file of a prescribed format.

27. The device of claim 16, wherein the transmission to the service function server includes a watermark state indicator including one or more of an inactive state, an active state or a gap state.

28. A computer program product, embodied on a non-transitory computer readable medium, comprising instructions for reporting usage information associated with a content, comprising:

program code for extracting one or more watermark messages that are embedded in a content to obtain a server code and an interval code;

program code for initiating a transmission to a metadata server that includes at least in-part the server code and the interval code;

program code for receiving service recovery information associated with the content, the service recovery information including information associated with a usage monitoring operation; and

program code for initiating a transmission to a service function server in accordance with the usage monitoring operation obtained from the service recovery information, wherein the transmission to the service function server includes content usage monitoring information indicative of a change of the content and a time value associated with the change of the content.