VIDEO INDEXING AND FINGERPRINTING FOR VIDEO ENHANCEMENT

• US 20090213270A1
• Filed: 02/22/2008
• Published: 08/27/2009
• Est. Priority Date: 02/22/2008
• Status: Abandoned Application

• Current Assignee: Sportvision, Inc. (Sportsmedia Technology Corporation)
• Original Assignee: Sportvision, Inc. (Sportsmedia Technology Corporation)
• Inventors: Ismert, Ryan, White, Marvin S.
• Application Number:
  US12/035,562
• Publication Number:
  US 20090213270A1
• Time in Patent Office: Days
• US Class Current: 348/575
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/7847 using low-level visual features of the video content
• CPC Class Codes: H04N 5/765 Interface circuits between an apparatus for recording and another apparatus
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure
• CPC Class Codes: H04N 5/91 Television signal processing therefor
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal

Abstract

Metadata associated with a video is used to enhance a display of the video. A fingerprint is calculated using a particular fingerprint algorithm for one or more frames or images of the video. The fingerprint is associated with metadata for the one or more frames or images, and the fingerprint and the associated metadata are stored in a metadata repository. When a user requests enhancement of a video at a client device, the client device will calculate a fingerprint for one or more frames or images of the video to be enhanced using the same fingerprint algorithm and use the calculated fingerprint to access metadata associated with that fingerprint in the metadata repository. The accessed metadata is used to enhance a display of the video based on the user request.

Claims

1. A method for enhancing video, comprising:

receiving video at a client device;

calculating a first identifier of one or more images of said video at said client device using particular features within said one or more images;

accessing metadata associated with said one or more images using said first identifier; and

enhancing said one or more images using said metadata.

2. A method according to claim 1, further comprising:

receiving a request to enhance said one or more images of said video from a user, said step of enhancing is based on said request.

3. A method according to claim 1, further comprising:

sending said one or more images of said video to a display device.

4. A method according to claim 1, wherein said step of enhancing comprises:

inserting a graphic into a display of said one or more images using said metadata.

5. A method according to claim 1, wherein:

said metadata is data indicating a camera position, camera orientation, or intrinsic parameters associated with said one or more images of said video.

6. A method according to claim 1, wherein:

said metadata is data associated with events occurring in said one or more images of said video.

7. A method according to claim 1, further comprising:

counting images of said video received after said one or more images; and

accessing metadata associated with said images of said video using a count of said images received at said client device.

8. A method according to claim 1, wherein said step of calculating a first identifier comprises:

extracting said particular features from said one or more images; and

calculating said first identifier using said particular features in an identifier function.

9. A method according to claim 1, wherein:

said step of calculating includes calculating subsequent identifiers for images of video received after said one or more images; and

said step of accessing includes accessing metadata for said video using said first identifier and said subsequent identifiers.

10. A method according to claim 1, wherein:

said particular features are associated with data about particular pixels in said one or more images of said video.

11. A system for enhancing video, further comprising:

upstream inspection circuitry, said upstream inspection circuitry receives video and calculates an identifier of one or more images of said video using particular features within said one or more images;

association circuitry, said association circuitry associates said identifier with metadata of said one or more images;

downstream inspection circuitry, said downstream inspection circuitry receives said video and calculates said identifier of said one or more images using said particular features, said downstream inspection circuitry accesses said metadata using said identifier; and

enhancement circuitry, said enhancement circuitry enhances said one or more images using said metadata.

12. A system according to claim 11, wherein:

said upstream inspection circuitry extracts data associated with said particular features within said one or more images and calculates said identifier using said data.

13. A system according to claim 11, further comprising:

user input circuitry, said user input circuitry receives a request to enhance said one or more images of said video, said enhancement circuitry enhances said video based on said request.

14. A system according to claim 13, wherein:

said user input circuitry receives a request to enhance said video, said downstream inspection circuitry accesses metadata for images of said video using a count of images of said video, said enhancement circuitry enhances said video based on said request.

15. A system according to claim 11, further comprising:

image counter circuitry, said image counter circuitry counts images of said video received at said downstream inspection circuitry after said downstream inspection circuitry calculates said identifier.

16. An apparatus for enhancing video, comprising:

video input circuitry, said video input circuitry receives video;

downstream inspection circuitry, said downstream inspection circuitry calculates an identifier of one or more frames of said video using particular features within said one or more frames, said downstream inspection circuitry accesses metadata associated with said one or more frames using said identifier; and

enhancement circuitry, said enhancement circuitry enhances said one or more frames using said metadata.

17. A system according to claim 16, further comprising:

user input circuitry, said user input circuitry receives a request to enhance said one or more frames of said video, said enhancement circuitry enhances said one or more frames based on said request.

18. A system according to claim 17, further comprising:

video output circuitry, said video output circuitry sends said video to a display device based on said request to enhance.

19. A system according to claim 16, further comprising:

frame counter circuitry, said frame counter circuitry counts frames of said video received at said downstream inspection circuitry after said downstream inspection circuitry calculates said identifier.

20. A system for enhancing video, comprising:

a first set of one or more processors, said first set of one or more processors receives video and calculates an identifier of one or more frames of said video using particular features within said one or more frames;

a second set of one or more processors in communication with said first set of one or more processors, said second set of one or more processors associates said identifier with metadata of said one or more frames; and

a client device, said client device receives said video and calculates said identifier of said one or more frames using said particular features, said client device accesses said metadata using said identifier, said client device enhances said one or more frames using said metadata.