Systems and methods for generating bookmark video fingerprints

• US 10,198,638 B2
• Filed: 08/04/2017
• Issued: 02/05/2019
• Est. Priority Date: 07/27/2007
• Status: Active Grant

• Current Assignee: Synergy Sports Technology, LLC
• Original Assignee: Synergy Sports Technology, LLC
• Inventors: Lahr, Nils B., Barr, Garrick C.
• Primary Examiner(s): Fitzpatrick, Atiba O
• Application Number:
  US15/669,736
• Publication Number:
  US 20180129880A1
• Time in Patent Office: 550 Days
• Field of Search: None
• CPC Class Codes: G06F 16/183 Provision of network file services by network file servers, e.g. by using NFS, CIFS network file access protocols H04L67/1097
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/7847 using low-level visual features of the video content
• CPC Class Codes: G06F 16/7867 using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
• CPC Class Codes: G06F 16/9562 Bookmark management
• CPC Class Codes: G06F 16/958 Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06T 1/0021 Image watermarking
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 7/215 Motion-based segmentation
• CPC Class Codes: G06V 20/40 in video content extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44
• CPC Class Codes: G06V 20/48 Matching video sequences
• CPC Class Codes: G10L 21/00 Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility G10L19/00 takes precedence
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04N 21/2223 being a public access point, e.g. for downloading to or uploading from clients arrangements specially adapted to plural spots in a confined site in broadcast systems H04H20/63
• CPC Class Codes: H04N 21/2393 : involving handling client requests scheduling or organising the servicing of application requests H04L67/60
• CPC Class Codes: H04N 21/4312 : involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/4325 : by playing back content from the storage medium reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79
• CPC Class Codes: H04N 21/4334 : Recording operations recording of a television signal H04N5/76; arrangements for recording or accumulating broadcast information or broadcast-related information H04H60/27
• CPC Class Codes: H04N 21/44236 : Monitoring of piracy processes or activities protecting computer platforms against harmful, malicious or unexpected behaviour or activities using intrusion detection and counter measures G06F21/566; computer virus detection and handling G06F21/56
• CPC Class Codes: H04N 21/4627 : Rights management associated to the content security in data switching network management H04L41/28; security management or policies for network security H04L63/20; access security in wireless networks H04W12/08
• CPC Class Codes: H04N 21/47214 : for content reservation or setting reminders; for requesting event notification, e.g. of sport results or stock market stock exchange data over packet-switching network H04L12/1804; push services over packet-switching network H04L12/1859; notification of incoming messages in packet switching networks H04L51/224
• CPC Class Codes: H04N 21/4782 : Web browsing , e.g. WebTV
• CPC Class Codes: H04N 21/812 : involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/8173 : End-user applications, e.g. Web browser, game
• CPC Class Codes: H04N 21/8358 : involving watermark protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467
• CPC Class Codes: H04N 21/84 : Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 7/17318 : Direct or substantially direct transmission and handling of requests

Abstract

Systems and methods for replacing original media bookmarks of at least a portion of a digital media file with replacement bookmarks is described. A media fingerprint engine detects the location of the original fingerprints associated with the portion of the digital media file and a region analysis algorithm characterizes regions of media file spanning the location of the original bookmarks by data class types. The replacement bookmarks are associated with the data class types and are overwritten or otherwise are substituted for the original bookmarks. The replacement bookmarks then are subjected to a fingerprint matching algorithm that incorporates media timeline and media related metadata.

Claims

1. A method for generating video fingerprints comprising:

sharing timeline and metadata of an original digital media file including at least one of a video digital file and an audio digital file;

identifying a region within the original media file;

bookmarking the identified region;

detecting a bookmarked region of a duplicate of the original media file; and

comparing the bookmarked region of the original media file to the bookmarked region of the duplicate, wherein detecting a bookmarked region includes selecting a frame group, examining for the presence of matchable characteristics in the frame group, applying a region algorithm to the frame group, removing repetitive occurrences of the matchable characteristics, and defining a path of the matchable characteristics within the frame group.

2. The method of claim 1, wherein identifying a region of the original digital media file includes determining data types within the digital media file.

3. The method of claim 2, wherein determining data types includes at least one of a pixel luminescence value, a region of pixel luminescence values, an indicator of object motion, a change in sound volume, and a change in sound types.

4. The method of claim 1, wherein examining for the presence of matchable characteristics in the frame group includes generating data set type classes for regions within each frame of the frame group, associating the data set type classes with location points of the video frame, and ascertaining possible pathways between data set type classes between loci of adjacent frames.

5. The method of claim 4, wherein defining a path of the matchable characteristics within the frame group includes performing a matrix analysis of the data set classes for ascertaining a high confidence pathway.

6. The method of claim 5, wherein defining a path of the matchable characteristics within the frame group include selecting the high confidence pathway between similar data set classes.

7. The method of claim 5, wherein defining a path of the matchable characteristics within the frame group include selecting the high confidence pathway between dissimilar data set classes.

8. The method of claim 5, wherein defining a path of the matchable characteristics within the frame group include selecting the high confidence pathway between similar and dissimilar data set classes.

9. A method for replacing bookmarks in digital media files comprising:

selecting a portion of a digital media file;

detecting an original bookmark associated with the portion;

ascertaining data set classes within the portion of the digital media file;

generating a replacement bookmark associated with the data set classes;

overwriting the original bookmark with the replacement bookmark; and

fingerprinting the replacement bookmark.

10. The method of claim 9, wherein detecting the original bookmark includes using a fingerprinting algorithm.

11. The method of claim 9, wherein ascertaining data set classes within the portion of the media file include examining for the presence at least one of a pixel luminescence value, a region of pixel luminescence values, an indicator of object motion, a change in sound volume, and a change in sound types.

12. The method of claim 9, wherein applying a replacement bookmark to associate with the data set classes includes determining the matchable characteristics present in a video frame group of a media file.

13. The method of claim 12, wherein determining the matchable characteristics present in a video frame group includes ascertaining the location of at least one of the pixel luminescence value, the region of pixel luminescence values, the indicator of object motion, the change in sound volume, and the change in sound types.

14. The method of claim 13, wherein determining the matchable characteristics present in the video frame group includes establishing a vector pathway between matchable characteristics.

15. The method of claim 14, wherein establishing the vector pathway between matchable characteristics include selecting for a high confidence pathway determined by matrix analysis of the matchable characteristics.

16. The method of claim 15, wherein selecting for a high confidence pathway includes vector pathway between similar matchable characteristics, dissimilar matchable characteristics, and a combination of similar and dissimilar matchable characteristics.

17. A system for generating video fingerprints comprising:

an original digital media file having at least one of a video digital file and an audio digital file;

means for identifying a region within the original media file;

means for bookmarking the identified region;

means for detecting a bookmarked region of a duplicate of the original digital media file; and

means for comparing the bookmarked region of the original media file to the bookmarked region of the duplicate,

wherein the means for identifying a region within the original media file includes a region analysis algorithm configured to detect matchable characteristics comprising at least one of a pixel luminescence value, a region of pixel luminescence values, an indicator of object motion, a change in sound volume, and a change in sound types, and

wherein the means for comparing the bookmarked region of the original media file to the bookmarked region of the duplicate includes determining a vector pathway between the matchable characteristics.