Systems and methods for generating bookmark video fingerprints

• US 9,070,187 B2
• Filed: 04/11/2014
• Issued: 06/30/2015
• Est. Priority Date: 06/18/2007
• Status: Active Grant

• Current Assignee: Synergy Sports Technology, LLC
• Original Assignee: Synergy Sports Technology, LLC
• Inventors: Lahr, Nils Bjorn, Barr, Garrick
• Primary Examiner(s): Fitzpatrick, Atiba O
• Application Number:
  US14/251,139
• Publication Number:
  US 20140219496A1
• Time in Patent Office: 445 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 16/183 Provision of network file services by network file servers, e.g. by using NFS, CIFS network file access protocols H04L67/1097
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/7847 using low-level visual features of the video content
• CPC Class Codes: G06F 16/7867 using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
• CPC Class Codes: G06F 16/9562 Bookmark management
• CPC Class Codes: G06F 16/958 Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06T 1/0021 Image watermarking
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 7/215 Motion-based segmentation
• CPC Class Codes: G06V 20/40 in video content extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44
• CPC Class Codes: G06V 20/48 Matching video sequences
• CPC Class Codes: G10L 21/00 Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility G10L19/00 takes precedence
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04N 21/2223 being a public access point, e.g. for downloading to or uploading from clients arrangements specially adapted to plural spots in a confined site in broadcast systems H04H20/63
• CPC Class Codes: H04N 21/2393 : involving handling client requests scheduling or organising the servicing of application requests H04L67/60
• CPC Class Codes: H04N 21/4312 : involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/4325 : by playing back content from the storage medium reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79
• CPC Class Codes: H04N 21/4334 : Recording operations recording of a television signal H04N5/76; arrangements for recording or accumulating broadcast information or broadcast-related information H04H60/27
• CPC Class Codes: H04N 21/44236 : Monitoring of piracy processes or activities protecting computer platforms against harmful, malicious or unexpected behaviour or activities using intrusion detection and counter measures G06F21/566; computer virus detection and handling G06F21/56
• CPC Class Codes: H04N 21/4627 : Rights management associated to the content security in data switching network management H04L41/28; security management or policies for network security H04L63/20; access security in wireless networks H04W12/08
• CPC Class Codes: H04N 21/47214 : for content reservation or setting reminders; for requesting event notification, e.g. of sport results or stock market stock exchange data over packet-switching network H04L12/1804; push services over packet-switching network H04L12/1859; notification of incoming messages in packet switching networks H04L51/224
• CPC Class Codes: H04N 21/4782 : Web browsing , e.g. WebTV
• CPC Class Codes: H04N 21/812 : involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/8173 : End-user applications, e.g. Web browser, game
• CPC Class Codes: H04N 21/8358 : involving watermark protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467
• CPC Class Codes: H04N 21/84 : Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 7/17318 : Direct or substantially direct transmission and handling of requests

Abstract

Systems and methods for replacing original media bookmarks of at least a portion of a digital media file with replacement bookmarks is described. A media fingerprint engine detects the location of the original fingerprints associated with the portion of the digital media file and a region analysis algorithm characterizes regions of media file spanning the location of the original bookmarks by data class types. The replacement bookmarks are associated with the data class types and are overwritten or otherwise are substituted for the original bookmarks. The replacement bookmarks then are subjected to a fingerprint matching algorithm that incorporates media timeline and media related metadata.

Claims

1. At least one non-transitory computer-readable medium including instructions that, when executed by at least one processing device, enable the at least one processing device to perform a method of generating video fingerprints to be associated with a digital media file, the method comprising the steps of:

detecting a location of at least one original fingerprint associated with a first digital media file and including a plurality of original bookmarks;

detecting a portion of the first digital media file bounded by the plurality of original bookmarks;

characterizing at least one class type of data in the portion of the first digital media file bounded by the plurality of original bookmarks;

generating at least one replacement bookmark associated with the at least one characterized data class type;

generating a replacement fingerprint including the at least one replacement bookmark;

and

applying the replacement fingerprint to a second digital media file.

2. The medium of claim 1, wherein detecting the portion of the first digital media file includes using a fingerprinting algorithm.

3. The medium of claim 1, wherein characterizing at least one class type of data includes examining for the presence at least one of a pixel luminescence value, a region of pixel luminescence values, an indicator of object motion, a change in sound volume, and a change in sound types.

4. The medium of claim 1, wherein generating at least one replacement bookmark includes determining the matchable characteristics present in a video frame group of a media file.

5. The medium of claim 4, wherein determining the matchable characteristics present in a video frame group includes ascertaining the location of at least one of the pixel luminescence value, the region of pixel luminescence values, the indicator of object motion, the change in sound volume, and the change in sound types.

6. The medium of claim 5, wherein determining the matchable characteristics present in the video frame group includes establishing a vector pathway between matchable characteristics.

7. The medium of claim 6, wherein establishing the vector pathway between matchable characteristics include selecting for a high confidence pathway determined by matrix analysis of the matchable characteristics.

8. The medium of claim 7, wherein selecting for a high confidence pathway includes vector pathway between similar matchable characteristics, dissimilar matchable characteristics, and a combination of similar and dissimilar matchable characteristics.

9. The medium of claim 1, wherein the replacement fingerprint incorporates at least one of a media timeline and media-related metadata.