Systems and methods for generating bookmark video fingerprints

• US 9,754,170 B2
• Filed: 09/14/2016
• Issued: 09/05/2017
• Est. Priority Date: 06/18/2007
• Status: Active Grant

• Current Assignee: Synergy Sports Technology, LLC
• Original Assignee: Synergy Sports Technology, LLC
• Inventors: Lahr, Nils B., Barr, Garrick C.
• Primary Examiner(s): Fitzpatrick, Atiba O
• Application Number:
  US15/265,452
• Publication Number:
  US 20170004364A1
• Time in Patent Office: 356 Days
• Field of Search: None
• CPC Class Codes: G06F 16/183 Provision of network file services by network file servers, e.g. by using NFS, CIFS network file access protocols H04L67/1097
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/7847 using low-level visual features of the video content
• CPC Class Codes: G06F 16/7867 using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
• CPC Class Codes: G06F 16/9562 Bookmark management
• CPC Class Codes: G06F 16/958 Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06T 1/0021 Image watermarking
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 7/215 Motion-based segmentation
• CPC Class Codes: G06V 20/40 in video content extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44
• CPC Class Codes: G06V 20/48 Matching video sequences
• CPC Class Codes: G10L 21/00 Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility G10L19/00 takes precedence
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04N 21/2223 being a public access point, e.g. for downloading to or uploading from clients arrangements specially adapted to plural spots in a confined site in broadcast systems H04H20/63
• CPC Class Codes: H04N 21/2393 : involving handling client requests scheduling or organising the servicing of application requests H04L67/60
• CPC Class Codes: H04N 21/4312 : involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/4325 : by playing back content from the storage medium reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79
• CPC Class Codes: H04N 21/4334 : Recording operations recording of a television signal H04N5/76; arrangements for recording or accumulating broadcast information or broadcast-related information H04H60/27
• CPC Class Codes: H04N 21/44236 : Monitoring of piracy processes or activities protecting computer platforms against harmful, malicious or unexpected behaviour or activities using intrusion detection and counter measures G06F21/566; computer virus detection and handling G06F21/56
• CPC Class Codes: H04N 21/4627 : Rights management associated to the content security in data switching network management H04L41/28; security management or policies for network security H04L63/20; access security in wireless networks H04W12/08
• CPC Class Codes: H04N 21/47214 : for content reservation or setting reminders; for requesting event notification, e.g. of sport results or stock market stock exchange data over packet-switching network H04L12/1804; push services over packet-switching network H04L12/1859; notification of incoming messages in packet switching networks H04L51/224
• CPC Class Codes: H04N 21/4782 : Web browsing , e.g. WebTV
• CPC Class Codes: H04N 21/812 : involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/8173 : End-user applications, e.g. Web browser, game
• CPC Class Codes: H04N 21/8358 : involving watermark protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467
• CPC Class Codes: H04N 21/84 : Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 7/17318 : Direct or substantially direct transmission and handling of requests

Abstract

Systems and methods for replacing original media bookmarks of at least a portion of a digital media file with replacement bookmarks is described. A media fingerprint engine detects the location of the original fingerprints associated with the portion of the digital media file and a region analysis algorithm characterizes regions of media file spanning the location of the original bookmarks by data class types. The replacement bookmarks are associated with the data class types and are overwritten or otherwise are substituted for the original bookmarks. The replacement bookmarks then are subjected to a fingerprint matching algorithm that incorporates media timeline and media related metadata.

Claims

1. A method for generating video fingerprints comprising:

identifying a portion of an original digital media file, the portion including original bookmarks;

detecting the location of at least one original fingerprint associated with the portion of the file;

generating a plurality of replacement bookmarks;

replacing the original bookmarks with the replacement bookmarks; and

after replacing the original bookmarks with the replacement bookmarks, fingerprinting the replacement bookmarks.

2. The method of claim 1, wherein identifying a portion of the original digital media file includes determining data types within the digital media file.

3. The method of claim 2, wherein determining data types includes at least one of a pixel luminescence value, a region of pixel luminescence values, an indicator of object motion, a change in sound volume, and a change in sound types.

4. The method of claim 1, wherein identifying a portion includes selecting a frame group, examining for the presence of matchable characteristics in the frame group, applying a region algorithm to the frame group, removing repetitive occurrences of the matchable characteristics, and defining a path of the matchable characteristics within the frame group.

5. The method of claim 4, wherein examining for the presence of matchable characteristics in the frame group includes generating data set type classes for regions within each frame of the frame group, associating the data set type classes with location points of the video frame, and ascertaining possible pathways between data set type classes between loci of adjacent frames.

6. The method of claim 5, wherein defining a path of the matchable characteristics within the frame group includes performing a matrix analysis of the data set classes for ascertaining a high confidence pathway.

7. The method of claim 6, wherein defining a path of the matchable characteristics within the frame group include selecting the high confidence pathway between similar data set classes.

8. The method of claim 6, wherein defining a path of the matchable characteristics within the frame group include selecting the high confidence pathway between dissimilar data set classes.

9. The method of claim 6, wherein defining a path of the matchable characteristics within the frame group include selecting the high confidence pathway between similar and dissimilar data set classes.

10. A method for replacing bookmarks in digital media files comprising:

selecting a portion of a digital media file;

detecting an original bookmark associated with the portion;

characterizing, according to a plurality of data class types, regions of the portion

generating a replacement bookmark, the replacement bookmark being associated with at least one of the data class types;

overwriting the original bookmark with the replacement bookmark; and

fingerprinting the replacement bookmark.

11. The method of claim 10, wherein detecting the original bookmark includes using a fingerprinting algorithm.

12. The method of claim 10, wherein ascertaining data set classes within the portion of the media file include examining for the presence at least one of a pixel luminescence value, a region of pixel luminescence values, an indicator of object motion, a change in sound volume, and a change in sound types.

13. The method of claim 10, wherein applying a replacement bookmark to associate with the data set classes includes determining the matchable characteristics present in a video frame group of a media file.

14. The method of claim 13, wherein determining the matchable characteristics present in a video frame group includes ascertaining the location of at least one of the pixel luminescence value, the region of pixel luminescence values, the indicator of object motion, the change in sound volume, and the change in sound types.

15. The method of claim 14, wherein determining the matchable characteristics present in the video frame group includes establishing a vector pathway between matchable characteristics.

16. The method of claim 15, wherein establishing the vector pathway between matchable characteristics include selecting for a high confidence pathway determined by matrix analysis of the matchable characteristics.

17. The method of claim 16, wherein selecting for a high confidence pathway includes vector pathway between similar matchable characteristics, dissimilar matchable characteristics, and a combination of similar and dissimilar matchable characteristics.

18. A system for generating video fingerprints comprising:

means for identifying a portion of an original digital media file, the portion including original bookmarks;

means for detecting the location of at least one original fingerprint associated with the portion of the file;

means for generating a plurality of replacement bookmarks;

means for replacing the original bookmarks with the replacement bookmarks; and

means for, after replacing the original bookmarks with the replacement bookmarks, fingerprinting the replacement bookmarks.

19. The system of claim 18, wherein the means for identifying a portion of the original media file includes a region analysis algorithm configured to detect matchable characteristics comprising at least one of a pixel luminescence value, a region of pixel luminescence values, an indicator of object motion, a change in sound volume, and a change in sound types.