Universal lookup of video-related data

• US 8,719,288 B2
• Filed: 01/06/2009
• Issued: 05/06/2014
• Est. Priority Date: 04/15/2008
• Status: Active Grant

• Current Assignee: Vdoqwest, Inc.
• Original Assignee: Novafora, Inc.
• Inventors: Bronstein, Alexander, Bronstein, Michael, Rakib, Shlomo Selim
• Primary Examiner(s): WILSON, KIMBERLY LOVEL
• Application Number:
  US12/349,473
• Publication Number:
  US 20090259633A1
• Time in Patent Office: 1,946 Days
• Field of Search: 707/758
• US Class Current: 707/758
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06
• CPC Class Codes: G06F 16/447 Temporal browsing, e.g. timeline
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/7847 using low-level visual features of the video content
• CPC Class Codes: G06V 20/40 in video content extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44
• CPC Class Codes: G11B 2220/2562 DVDs [digital versatile discs]; Digital video discs; MMCDs; HDCDs
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: G11B 27/11 by using information not detectable on the record carrier

Abstract

A universal video-related lookup system and method receives a request for information associated with specific video content from a requesting device. The system and method identify a first video content identifier associated with the specific video content and retrieves first metadata associated with the specific video content based on the first video content identifier. Next, the system and method translate the first video content identifier into a second video content identifier associated with the specific video content and retrieves second metadata based on the second video content identifier. The first metadata and the second metadata are then provided to the requesting device.

Claims

1. A method of lookup of video-related data, capable of operating with different versions of related video content, comprising:

receiving a request from a requesting device for information for a first version of video content;

identifying a first video content identifier associated with either the entire video content, the filename of the video content, a particular time interval within the video content, or a spatio-temporal object in the first version of video content from a video content source;

using said first video content identifier to retrieve first metadata associated with said first version of video content;

wherein said first metadata is at least one of untimed metadata, timed metadata associated with a time interval, or spatio-temporal metadata associated with a spatio-temporal object in said first version of video content;

wherein irrespective of if said first metadata is available, then;

translating said first video content identifier into a second video content identifier;

wherein translating said first video content identifier into a second video content identifier comprises finding a correspondence between spatial and temporal coordinates of image features in the first version of video content associated with the first video content identifier, and the spatial and temporal coordinates of image features of a second version of video content associated with said second video content identifier;

wherein said first version of video content and said second version of video content comprise either identical versions of the same original video content, or different but related versions of said original video content;

wherein said different but related versions of said original video content differ by at least one of different edits, different aspect ratios, or different transcoding versions;

retrieving second metadata based on said second video content identifier; and

providing, to the requesting device, the first metadata if said first metadata is available, and said second metadata.

2. The method of claim 1, wherein the first video content identifier is a file content-based identifier associated with payload of a video file.

3. The method of claim 2, wherein the first video content identifier is a hash value computed from the payload of said video file.

4. The method of claim 1, wherein the first video content comprises video image frames with image portions, and the first video content identifier is a video content-based identifier associated with visual information obtained from said image portion of said video image frames of the first video content.

5. The method of claim 1, wherein the source of the first version of video content is a DVD and the first video content identifier is a DVDid.

6. The method of claim 1, wherein the first version of video content is obtained from a file in a peer-to-peer network and the first video content identifier is a hash value associated with the file.

7. The method of claim 1, wherein the first version of video content is obtained from a video file stored on a server and the first video content identifier is a URL identifying the server and the video file.

8. The method of claim 1, wherein translating the first video content identifier into a second video content identifier includes finding a correspondence between temporal coordinates in a first version of video content data associated with the first video content identifier and a second version of video content data associated with the second video content identifier.

9. The method of claim 1, wherein the first metadata is retrieved from a first metadata source and the second metadata is retrieved from a second metadata source.

10. The method of claim 1, wherein translating the first video content identifier into a second video content identifier includes performing the translation in response to each received request.

11. The method of claim 1, wherein translating the first video content identifier into a second video content identifier includes retrieving a second video content identifier previously generated by:

finding a plurality of correspondences between a plurality of spatial and temporal image feature coordinates in the first version of video content associated with the first video content identifier, and a plurality of spatial and temporal image feature coordinates of a second version of video content associated with the second video content identifier;

saving said plurality of correspondences in memory;

and using said first content identifier to retrieve the corresponding second video content identifier from memory.

12. The method of claim 1, wherein identifying a first video content identifier includes receiving a first video content identifier from the requesting device.

13. The method of claim 1, further comprising identifying a correspondence between a timeline associated with said first version of video content and a timeline associated with the second metadata.

14. The method of claim 13, further comprising providing the identified correspondence to the requesting device.

15. A method of lookup of video-related data, capable of operating with different versions of related video content, comprising:

receiving a request for metadata for a first version of a video program, wherein the request includes a first video content identifier associated with said first version of a video program;

identifying a first video sequence in said first version of a video program;

finding a correspondence between the spatial and temporal coordinates of image features of said first video sequence in said first version of a video program, and the spatial and temporal coordinates of image features of a second version of said video program;

wherein said first version of a video program and said second version of a video program comprise either identical versions of the same original video program, or different but related versions of said original video program;

wherein said different but related versions of said original video program differ by at least one of different edits, different aspect ratios, or different transcoding versions;

using said correspondence to identify a second video content identifier associated with said second version of a video program based on the identified first video sequence; and

retrieving the requested metadata from a metadata source based on said second video content identifier.

16. The method of claim 15, wherein the retrieved requested metadata is subtitle information associated with said second video program.

17. The method of claim 15, wherein the retrieved requested metadata includes reviews associated with the second video program.

18. The method of claim 15, further identifying a correspondence between a timeline associated with the said first version of a video program and a timeline associated with the retrieved metadata;

wherein identifying a metadata timeline correspondence includes calculating a spatial, temporal, or spatio-temporal correspondence between the first version of a video program and the retrieved metadata;

or

wherein identifying a metadata timeline correspondence includes retrieving a previously computed correspondence from a storage device.

19. An apparatus for lookup of video-related data, capable of operating with different versions of related video content, comprising:

a communication module configured to receive a request from a requesting device for information for a first version of video content, and at least one processor;

said at least one processor coupled to the communication module and configured to identify a first video content identifier associated with said first version of video content, said at least one processor further configured to retrieve first metadata associated with said first version of video content based on the first video content identifier;

said at least one processor additionally configured to handle situations, even if said first metadata is unavailable, to also satisfy said request with information associated with a second version of video content;

said additional configuration being to translate the first video content identifier into a second video content identifier;

said at least one processor configured to use said first video content identifier associated with said first version of video content to identify first video content video image frames comprising first video content image features with spatial coordinates and temporal coordinates, and to determine image features in the spatial coordinates and temporal coordinates identified by said first video content identifier in said first version of video content;

said translation using image features in the spatial coordinates and temporal coordinates identified by said first video content identifier in said first version of video content to find a second video content identifier in said second video content that identify corresponding image features in the spatial coordinates and temporal coordinates in said second video content;

wherein said first version of video content and said second version of video content comprise either identical versions of a same original video content, or different but related versions of said original video content;

wherein said different but related versions of an original video content differ by at least one of different edits, different aspect ratios, or different transcoding versions;

wherein said at least one processor is further configured to retrieve second metadata based on the second video content identifier and provide, to the requesting device, said first metadata if said first metadata is available, and said second metadata.

20. The apparatus of claim 19, wherein said at least one processor is further configured to find a correspondence between temporal coordinates or spatial and temporal coordinates in video content associated with the first video content identifier and video content associated with the second video content identifier.