Content Overlay System

• US 20120185905A1
• Filed: 01/13/2011
• Published: 07/19/2012
• Est. Priority Date: 01/13/2011
• Status: Abandoned Application

• Current Assignee: Christopher Lee Kelley
• Original Assignee: Christopher Lee Kelley
• Inventors: Kelley, Christopher Lee
• Application Number:
  US13/006,155
• Publication Number:
  US 20120185905A1
• Time in Patent Office: Days
• US Class Current: 725/109
• CPC Class Codes: H04N 21/23614 Multiplexing of additional data and video streams arrangements for simultaneous broadcast of plural pieces of information H04H20/28
• CPC Class Codes: H04N 21/254 Management at additional data server, e.g. shopping server, rights management server arrangements for maintenance or administration in data networks H04L41/00; network services using third party service providers H04L67/53
• CPC Class Codes: H04N 21/41265 having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content
• CPC Class Codes: H04N 21/8153 comprising still images, e.g. texture, background image
• CPC Class Codes: H04N 9/75 Chroma key

Abstract

A system for associating overlay content with video programming and for allowing viewers of video programming to view the associated overlay content during playback of the video program, and methods for operation of video equipment, associated display devices and network servers to provide overlay content are disclosed. The overlay content is associated with specific passages of the video program while the content itself may be asynchronous or synchronized to the frames of the video programming. Users are able to identify what content is available and to determine how it will be played and on what devices.

Claims

6. An overlay content device comprising:

a network interface that allows retrieval and transmission of data, including one or more frame indexes each of which is derived from feature vectors that characterize a set of frames from a video program;

a video controller that matches data derived from frames in a viewed video program to corresponding data in one of said frame indexes in order to determine a frame position in a video program;

an overlay engine that generates graphical images and/or text to be overlayed onto said frames in a video program based on said frame position; and

a video interface for transmitting a video stream incorporating said frames in a video program overlayed with said graphical images and text.

7. The overlay content device of claim 6 further comprising:

a control processor; and

a software application for a wireless device that can communicate with said control processor so that content available for overlay on said frames in a video program is identified on the wireless device and may be selected using the software application.

8. The overlay content device of claim 6 further comprising:

a virtual machine that can process a set of instructions obtained across said network interface and, based upon said instructions, produce graphical images for overlay onto said frames in a video program.

9. The overlay content device of claim 8 wherein said overlay content device further comprises:

an audio interface for transmitting an audio stream; and

wherein said virtual machine can generate audio data that is combined with the audio of said video program for transmission over said audio interface.

10. The overlay content device of claim 6 further comprising:

a control processor that retrieves over said network interface overlay content data objects that include data enabling retrieval of the source data for said graphical images or text and also incorporate data fields that identify during what portion of said video program said graphical images or text may be presented.

11. A method for presenting graphics, video, audio and other data supplementary to a video program in coordination with playback of the program on a monitor, comprising the steps of:

determining the identity of a video program playing on a monitor;

retrieving content related to the video program whose identity was determined from a computer network where the retrieved content includes data defining a window of frames within said video program; and

visually identifying said retrieved content in synchronization with the playback of the video program on the monitor.

1. A method for presenting overlay content to viewers of a video program, the method comprising:

deriving a vector of feature values from a frame of a video program displayed on a monitor;

obtaining a sequence of frame identifiers;

comparing a frame identifier value based on said vector of feature values to a frame identifier from said sequence of frame identifiers;

obtaining data relating a piece of content to an identified portion of said sequence of frame identifiers; and

identifying said content on a display when said comparing step indicates that said displayed video frame is within said identified portion of the sequence of frame identifiers.

2. The method of claim 1 wherein the method of presenting overlay content further comprises:

permitting viewers of said video program to select said identified content; and

presenting said selected overlay content.

3. The method of claim 2 wherein said step of identifying content on a display includes presenting summary information identifying the content on a display other than said monitor.

4. The method of claim 2 wherein said step of presenting content includes presenting video or graphical content on a display device other than said monitor.

5. The method of claim 1 wherein said step of identifying content on a display involves presenting summary information identifying the content on one portion of said monitor.

12. The method of claim 11 further comprising the steps of:

extracting feature vectors from at least some frames of the video program;

comparing said feature vectors or data derived from said feature vectors with one or more sets of data derived from frames of a video program;

13. The method of claim 11 wherein the step of visually identifying said retrieved content is performed on a display device other than said monitor on which the video program is presented.

14. The method of claim 11 wherein the method further comprises the step of:

presenting graphical images, text or audio defined by said retrieved content on a display device.

15. The method of claim 11 wherein the step of visually identifying said retrieved data further includes visually identifying said retrieved content only when the portion of the video program presented to the viewer falls within said window of frames defined in said retrieved content.

15-1. The method of claim 14 wherein the step of presenting graphical images, text or audio further comprises querying a user as to whether the graphical images, text or audio should be presented on the monitor or on a display device other than the monitor.