Digital fingerprinting of live events for automatic detection

• US 10,009,663 B1
• Filed: 08/02/2012
• Issued: 06/26/2018
• Est. Priority Date: 08/02/2012
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Hoffman, Michael Theodor
• Primary Examiner(s): Bali, Vikkram
• Application Number:
  US13/565,235
• Time in Patent Office: 2,154 Days
• Field of Search: None
• CPC Class Codes: H04N 21/21805 enabling multiple viewpoints, e.g. using a plurality of cameras
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/23109 by placing content in organized collections, e.g. EPG data repository details of retrieval of video data and associated meta data in video databases G06F16/739
• CPC Class Codes: H04N 21/2353 specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
• CPC Class Codes: H04N 21/2541 Rights Management protecting software against unauthorised usage in a vending or licensing environment G06F21/10; security in data switching network management H04L41/28; security management or policies for network security H04L63/20; access security in wireless networks H04W12/08
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/4627 Rights management associated to the content security in data switching network management H04L41/28; security management or policies for network security H04L63/20; access security in wireless networks H04W12/08
• CPC Class Codes: H04N 21/8358 involving watermark protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467

Abstract

Aspects relate to causing one or more signals to be detectable within a live event such that devices that record at least a portion of the event also record the one or more signals. The signals can be used for later processing and categorization of received recordings in order to associate the recordings with the event. Further actions can be performed based on the association. Such actions include digital rights management, crowd-sourced experiences, and categorization of the event for searching and retrieval purposes.

Claims

1. A method for fingerprinting live events comprising:

generating, by a signal generation component, a first signal for an event occurring at a physical venue,

wherein the first signal is to be used as a fingerprint for identifying live recordings of the event,

wherein the first signal is to be overlaid, by an output component located at the physical venue, onto the physical venue during a portion of the event, and

wherein a recording device capturing the portion of the event, at the physical venue and at a time of the portion of the event, captures the first signal with the portion of the event;

creating, by a correlation component operably coupled to the signal generation component, a first mapping that associates the first signal with an identifier that identifies the event;

storing, by the correlation component, the first mapping in a database;

receiving, by the output component from the signal generation component, the first signal; and

overlaying, by the output component, the first signal onto the physical venue instantaneously with the portion of the event and at a time that the recording device is capturing a recording of the portion of the event, wherein the recording device captures the first signal in the recording of the portion of the event;

receiving, from a submitter, the recording of the portion of the event; and

in response to detecting, by a matching component, that the recording of the portion of the event includes the first signal, retrieving, by an action component and for the recording of the portion of the event, a digital rights management policy.

2. The method of claim 1, wherein overlaying, by the output component, the first signal onto the physical venue comprises:

broadcasting a digital audio signal that mixes with a plurality of audio signals generated at the event.

3. The method of claim 1, wherein overlaying, by the output component, the first signal onto the physical venue comprises:

projecting a digital image.

4. The method of claim 1, wherein overlaying, by the output component, the first signal onto the physical venue comprises:

modulating a light source in a detectable pattern.

5. The method of claim 1, the first signal having a format, and wherein the format of the first signal is one of a digital audio signal, a digital image, or a pattern of modulated light.

6. The method of claim 5, further comprising:

generating, by the signal generation component, a second signal that is detectable by a second recording device that is recording the event, the second signal having a format different from a format of the first signal;

creating, by the correlation component, a second mapping that associates the second signal with the identifier;

storing, by the correlation component, the second mapping in the database; and

overlaying, by the output component, the second signal onto the physical venue during the event.

7. The method of claim 6, wherein the format of the second signal is one of a digital audio signal, a digital image, or a pattern of modulated light.

8. A system for fingerprinting live events, comprising:

a memory that stores computer executable components; and

a processor that executes computer executable components stored in the memory, the computer executable components comprising;

a signal generation component configured to generate a first signal for an event, the event occurring at a physical venue,

wherein the first signal is to be used as a fingerprint for identifying live recordings of the event,

wherein the first signal is to be overlaid, by an output component, onto the physical venue during a portion of the event, and

wherein a recording device, capturing the portion of the event of the physical venue and at a time of the portion of the event, captures the first signal with the portion of the event;

a correlation component configured to;

create a first mapping that associates the first signal with an identifier that identifies the event; and

store the first mapping in a database;

an output component, located at the physical venue, configured to;

receive the first signal from the signal generation component;

overlay the first signal onto the physical venue during the portion of the event and at a time that the recording device is capturing a recording of the portion of the event, wherein the output component overlays the first signal onto the physical venue instantaneous with the portion of the event, and

wherein the recording device captures the first signal in the recording of the portion of the event;

a reception component configured to receive, from a submitter, the recording of the portion of the event;

a matching component configured to determine whether the recording of the portion of the event includes the first signal; and

an action component configured to, in response to the matching component determining that the recording of the portion of the event includes the first signal, execute an action of a digital rights management policy associated with the event.

9. The system of claim 8, wherein overlaying the first signal onto the physical venue comprises broadcasting a digital audio signal that mixes with a plurality of audio signals generated at the event.

10. The system of claim 8, wherein overlaying the first signal onto the physical venue comprises projecting a digital image.

11. The system of claim 8, wherein overlaying the first signal onto the physical venue comprises modulating a light source in a detectable pattern.

12. The system of claim 8, wherein a format of the first signal is one of a digital audio signal, a digital image, and a pattern of modulated light.

13. The system of claim 12, wherein:

the signal generation component is further configured to generate a second signal that is detectable by a second recording device that is recording the event, the second signal having a format different from a format of the first signal;

the correlation component is further configured to;

create a second mapping that associates the second signal with the identifier; and

store the second mapping in the database; and

the output component is further configured to transmit the second signal at the physical venue during the event.

14. The system of claim 13, wherein the format of the second signal is one of a digital audio signal, a digital image, and a pattern of modulated light.

15. A device for fingerprinting live events, comprising:

a memory that stores computer executable components; and

a processor that executes computer executable components stored in the memory, the computer executable components comprising;

a signal generation component configured to generate a first signal for an event, the event occurring at a physical venue,

wherein the first signal is to be used as a fingerprint for identifying live recordings of the event,

wherein the first signal is to be overlaid, by an output component, onto the physical venue during a portion of the event,

wherein the signal generation component generates the first signal before time of the portion of the event, and

wherein a recording device capturing the portion of the event at the time of the portion of the event captures the first signal with the portion of the event;

a correlation component configured to;

create a first mapping that associates the first signal with an identifier that identifies the event; and

store the first mapping in a database; and

an output component configured to;

receive the first signal from the signal generation component;

overlay the first signal onto the physical venue instantaneous with the portion of the event and at a time that the recording device is capturing, at the physical venue, a recording of the portion of the event, wherein the output component overlays the first signal onto the physical venue during the portion of the event, and wherein the recording device captures the first signal in the recording of the portion of the event;

a reception component configured to receive, from a submitter, the recording of the portion of the event;

a matching component configured to determine whether the recording of the portion of the event includes the first signal; and

an action component configured to, in response to the matching component determining that the recording of the portion of the event includes the first signal, execute an action of a digital rights management policy associated with the event.

16. The device of claim 15, wherein overlaying the first signal onto the physical venue comprises broadcasting a digital audio signal that mixes with a plurality of audio signals generated at the event.

17. The device of claim 15, wherein overlaying the first signal onto the physical venue comprises projecting a digital image.

18. The device of claim 15, wherein overlaying the first signal onto the physical venue comprises modulating a light source in a detectable pattern.

19. The device of claim 15, wherein a format of the first signal is one of a digital audio signal, a digital image, and a pattern of modulated light.

20. The device of claim 19, wherein:

the signal generation component is further configured to generate a second signal that is detectable by a second recording device that is recording the event, the second signal having a format different from a format of the first signal;

the correlation component is further configured to;

create a second mapping that associates the second signal with the identifier; and

store the second mapping in the database; and

the output component is further configured to transmit the second signal at the physical venue during the event.