System and method for distributing auxiliary data embedded in video data

• US 20110088075A1
• Filed: 03/30/2010
• Published: 04/14/2011
• Est. Priority Date: 10/13/2009
• Status: Active Grant

• Current Assignee: Saturn Licensing LLC (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Eyer, Mark
• Granted Patent: US 9,277,183 B2
• Time in Patent Office: Days
• US Class Current: 725/114
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/2353 specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
• CPC Class Codes: H04N 21/236 Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream multiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00
• CPC Class Codes: H04N 21/23614 Multiplexing of additional data and video streams arrangements for simultaneous broadcast of plural pieces of information H04H20/28
• CPC Class Codes: H04N 21/2665 Gathering content from different sources, e.g. Internet and satellite
• CPC Class Codes: H04N 21/434 Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream demultiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00
• CPC Class Codes: H04N 21/4348 Demultiplexing of additional data and video streams
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• CPC Class Codes: H04N 21/8133 specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 21/8173 End-user applications, e.g. Web browser, game
• CPC Class Codes: H04N 7/173 with two-way working, e.g. subscriber sending a programme selection signal

Abstract

A system and method for distributing auxiliary data embedded in video data includes a content source that embeds the auxiliary data into the video data. The content source then encodes the video data together with the auxiliary data to create a distribution multiplex including compressed video data. A decoder receives and decompresses the distribution multiplex to reproduce the video data with the auxiliary data embedded. A television or other device then detects and extracts the auxiliary data from the video data. The television or other device processes the auxiliary data to support a variety of possible interactive applications including displaying a synchronized widget on a display of the television.

Claims

1. A system for effectively distributing information in an electronic network, comprising:

a content source that embeds auxiliary data into video data, said content source encoding said video data together with said auxiliary data to create a distribution multiplex;

means for receiving and processing said distribution multiplex to reproduce said video data with said auxiliary data embedded; and

a television that extracts said auxiliary data, said television processing said auxiliary data.

2. The system of claim 1 wherein said auxiliary data provides widget content supporting a synchronized widget on a display of said television, said widget content relating to said video data that is simultaneously presented on said display.

3. The system of claim 1 wherein said auxiliary data is formatted as a multi-dimensional video bar code in said video data.

4. The system of claim 1 wherein said auxiliary data is formatted as one or more horizontal scan lines that are located in or near a top region or a bottom region of a decoded video frame of said video data.

5. The system of claim 1 wherein said auxiliary data is formatted as part of, or embedded within, a graphical icon that is visible on a display of said television.

6. The system of claim 1 wherein said auxiliary data includes trigger data, widget content, synchronization data, content identification data, or pointer data.

7. The system of claim 6 wherein said trigger data defines said synchronized widget with respect to widget visual appearance and behavior, information presented by said synchronized widget, and widget graphical states including colors, levels, settings, optimal widget location, shape, size, or display times.

8. The system of claim 6 wherein said pointer data provides a URL for contacting an Internet server from which said television obtains additional auxiliary data and widget content for supporting said synchronized widget.

9. A television device for effectively displaying information from an electronic network, comprising:

a detection module that that identifies auxiliary data embedded in video data by a content source, said content source encoding said video data together with said auxiliary data to create a distribution multiplex that is distributed by said electronic network, said distribution multiplex being received and processed by decoding means to reproduce said video data with said auxiliary data embedded;

an extraction module that extracts said auxiliary data from said video data; and

an auxiliary data module that processes said auxiliary data.

10. The television device of claim 9 wherein said auxiliary data provides widget content supporting a synchronized widget on a display of said television, said widget content relating to said video data that is simultaneously presented on said display.

11. The television device of claim 9 wherein said auxiliary data is formatted as a multi-dimensional video bar code in said video data.

12. The television device of claim 9 wherein said auxiliary data is formatted as one or more horizontal scan lines that are located in or near a top region or a bottom region of a decoded video frame of said video data.

13. The television device of claim 9 wherein said auxiliary data is formatted as part of, or embedded within, a graphical icon that is visible on a display of said television.

14. The television device of claim 9 wherein said auxiliary data includes trigger data, widget content, synchronization data, content identification data, or pointer data.

15. The television device of claim 14 wherein said pointer data provides a URL for contacting an Internet server from which said television obtains additional auxiliary data and widget content for supporting a synchronized widget.

16. A method for effectively distributing information in an electronic network, comprising:

utilizing a content source to embed auxiliary data into video data, said content source encoding said video data together with said auxiliary data to create a distribution multiplex;

receiving and processing said distribution multiplex to reproduce said video data with said auxiliary data embedded; and

extracting said auxiliary data with a television that processes said auxiliary data.