Method and System for Video Event Detection for Contextual Annotation and Synchronization

• US 20140064693A1
• Filed: 08/31/2012
• Published: 03/06/2014
• Est. Priority Date: 08/31/2012
• Status: Active Grant

• Current Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Original Assignee: Nikhil Deshpande
• Inventors: DESHPANDE, Nikhil, Zhang, Yuecheng
• Granted Patent: US 9,124,856 B2
• Time in Patent Office: Days
• US Class Current: 386/230
• CPC Class Codes: H04N 21/4828 for searching program descriptors retrieval of video data G06F16/739
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal

Abstract

Described herein are methods and systems for video event detection for contextual annotation and synchronization. Exemplary embodiments relate to a method comprising receiving a video stream, extracting a first event from the video stream, determining an index value identifying a location within the video stream corresponding to the first event, and inserting content based on the first event at a location identified by the index value. Further exemplary embodiments relate to a system comprising an event-based data extractor that receives a video stream and extracts a first event from the video stream, a processor that determines an index value identifying a location within the video stream corresponding to the first event, and a video insertion module inserts content based on the first event at a location identified by the index value.

Claims

1. A method, comprising:

receiving a video stream;

extracting a first event from the video stream;

determining an index value identifying a location within the video stream corresponding to the first event; and

inserting content based on the first event at a location identified by the index value.

2. The method according to claim 1, further comprising:

receiving a second event from out-of-band data packets;

wherein determining the index value includes correlating the first event with the second event; and

wherein inserting content includes at least one of,

inserting content based on the first event; and

inserting content based on the second event.

3. The method according to claim 1, wherein the first event includes a first set of events and the second event includes a second set of events.

4. The method according to claim 3, further comprising:

extracting a composite event based on one or more events from one of the first set of events, the second set of events, and a combination thereof; and

wherein inserting content includes inserting content based on an composite event.

5. The method according to claim 4, further comprising:

storing the video stream, the at least one of the first, second, and composite events and their corresponding index values in a searchable database.

6. The method according to claim 5, further comprising:

receiving a query input indicating a desired event from a user via a user interface;

determining whether the desired event exists in the searchable database; and

retrieving a video segment with content associated with the desired event using the corresponding index value.

7. The method according to claim 1, wherein the extracting the first event from the video stream is based on an optical character recognition.

8. The method according to claim 1, wherein the extracting the first event includes data from at least one of a camera tracking technique, a player/object tracking technique, a detection of scene changes and a detection of a change in image pixels within frames of the video.

9. The method according to claim 1, wherein the first event is extracted from an on-screen dashboard.

10. The method according to claim 1, wherein the video stream is of a sporting event and the first event includes data related to an on-screen clock display.

11. A system, comprising:

an event-based data extractor that receives a video stream and extracts a first event from the video stream;

a processor that determines an index value identifying a location within the video stream corresponding to the first event; and

a video insertion module inserts content based on the first event at a location identified by the index value.

12. The system according to claim 11, wherein the processor receives a second event from out-of-band data packets;

and

wherein determining the index value includes correlating the first event with the second event and wherein inserting content includes at least one of,

inserting content based on the first event; and

inserting content based on the second event

13. The system according to claim 11, wherein the first event includes a first set of events and the second event includes a second set of events.

14. The system according to claim 13, wherein the event-based data extractor extracts a composite event based on one or more events from one of the first set of events, the second set of events, and a combination thereof;

and wherein inserting content based on the at least one event includes inserting content based on an composite event.

15. The system according to claim 14, further comprising:

a searchable database storing the video stream, the at least one of the first, second or composite events and their corresponding index values.

16. The system according to claim 15, further comprising:

a user interface that receives a query input indicating a desired event from a user; and

wherein the processor determines whether the desired event exists in the searchable database and retrieves a video segment with content associated with the desired event using the corresponding index value.

17. The system according to claim 15, wherein the first event is extracted from an on-screen dashboard.

18. A non-transitory computer readable storage medium including a set of instructions executable by a processor, the set of instructions, when executed, resulting in a performance of the following:

receiving a video stream;

extracting a first event from the video stream;

determining an index value identifying a location within the video stream corresponding to the first event; and

inserting content based on the first event at a location identified by the index value.

19. The non-transitory computer readable storage medium of claim 18, wherein the set of instructions, when executed, further result in:

receiving a second event from out-of-band data packets;

wherein determining the index value includes correlating the first event with the second event and wherein inserting content includes at least one of,

inserting content based on the basic event; and

inserting content based on the further event.

20. The non-transitory computer readable storage medium of claim 18, wherein the set of instructions, when executed, further result in:

extracting a composite event based on one or more events from one of the first set of events, the second set of events, and a combination thereof; and

wherein inserting content based on the at least one event includes inserting content based on an composite event.