Digital fingerprinting of live events for automatic detection

• US 10,158,926 B1
• Filed: 08/11/2016
• Issued: 12/18/2018
• Est. Priority Date: 08/02/2012
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Hoffman, Michael Theodor
• Primary Examiner(s): Bali, Vikkram
• Application Number:
  US15/234,919
• Time in Patent Office: 859 Days
• Field of Search: None
• CPC Class Codes: H04N 21/21805 enabling multiple viewpoints, e.g. using a plurality of cameras
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/23109 by placing content in organized collections, e.g. EPG data repository details of retrieval of video data and associated meta data in video databases G06F16/739
• CPC Class Codes: H04N 21/2353 specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
• CPC Class Codes: H04N 21/2541 Rights Management protecting software against unauthorised usage in a vending or licensing environment G06F21/10; security in data switching network management H04L41/28; security management or policies for network security H04L63/20; access security in wireless networks H04W12/08
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/4627 Rights management associated to the content security in data switching network management H04L41/28; security management or policies for network security H04L63/20; access security in wireless networks H04W12/08
• CPC Class Codes: H04N 21/8358 involving watermark protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467

Abstract

Aspects relate to causing one or more signals to be detectable within a live event such that devices that record at least a portion of the event also record the one or more signals. The signals can be used for later processing and categorization of received recordings in order to associate the recordings with the event. Further actions can be performed based on the association. Such actions include digital rights management, crowd-sourced experiences, and categorization of the event for searching and retrieval purposes.

Claims

1. A system for identifying recordings of live events, comprising:

a memory that stores computer executable components; and

a processor that executes computer executable components, stored in the memory, comprising;

a reception component that receives a first recording of a live event occurring at a physical venue, the first recoding comprises at least one signal,

wherein the at least one signal is overlaid onto the physical venue during a portion of the live event,

wherein the first recoding is captured by a recording device,

wherein the at least one signal is to be used as a fingerprint for identifying recordings of the live event, and

wherein the recording device, capturing in the first recording the portion of the live event of the physical venue and at a time of the portion of the live event, captures the at least one signal with the portion of the live event;

a mapping component that matches the fingerprint to an identifier, wherein the identifier is associated with the live event and the at least one signal is associated to the live event; and

an implementation component that;

retrieves a digital rights management policy based on the at least one signal; and

applies at least one action based on the matching performed by the mapping component, wherein the at least one action is associated with the identifier and the digital rights management policy.

2. The system of claim 1, wherein the first recording of the live event comprises a second signal and the mapping component matches the second signal to the identifier.

3. The system of claim 1, wherein the reception component receives a second recording that comprises a second signal and the mapping component matches the second signal to the live event, the first recording and the second recording are in a same format or are in different formats.

4. The system of claim 3, wherein the implementation component aggregates the first recording and the second recording to create a social experience from at least two perspectives.

5. The system of claim 1, wherein the implementation component categorizes the first recording for searchable elements.

6. The system of claim 1, wherein the at least one signal is a digital audio signal that is mixed with a plurality of audio signals generated at the live event.

7. The system of claim 1, wherein the at least one signal is a digital image projected in a direction of the live event, the digital image is superimposed on a picture of the live event.

8. The system of claim 1, wherein the at least one signal is a light modulated in a detectable pattern aimed at the live event and captured in the first recording.

9. The system of claim 1, further comprising a confidence component that uses at least two signals to increase a level of confidence that the at least one signal is associated with the live event.

10. The system of claim 1, further comprising a confidence component that combines the at least one signal with global positioning system information or time information to increase a level of confidence that the at least one signal is associated with the live event.

11. The system of claim 1, wherein the first recording is at least one of an audio version of the live event, a still picture of the live event, and a video of the live event.

12. A method for identifying recordings of live events, comprising:

employing a processor to execute computer executable components stored within a memory to perform the following;

generating a first signal for a live event, the live event occurring at a physical venue,

wherein the first signal is to be used as a fingerprint for identifying recordings of the live event,

wherein the first signal is to be overlaid onto the physical venue during a portion of the live event, and

wherein a recording device, capturing in a recording the portion of the live event of the physical venue and at a time of the portion of the live event, captures the first signal with the portion of the live event;

receiving a first recording of the live event comprising the first signal, the first recoding captured by the recording device;

accessing a database comprising a plurality of signals, including the first signal, mapped to a plurality of identifiers associated with events;

matching the fingerprint to at least one of the plurality of signals to retrieve an identifier associated with the live event, wherein the at least one of the plurality of signals being the first signal;

associating the first recording to the identifier associated with the live event based on the matching; and

triggering an action as a function of the associating, the triggering comprising;

retrieving a digital rights management policy based on the at least one of the plurality of signals; and

triggering the action based on the digital rights management policy.

13. The method of claim 12, wherein the triggering comprises associating searchable elements with the first recording.

14. The method of claim 12, further comprising:

receiving a second recording that comprises a second signal;

matching the second signal to the live event; and

aggregating the first recording and the second recording.

15. The method of claim 14, wherein the aggregating comprises creating a social experience from at least two perspectives.

16. The method of claim 14, wherein the first recording and the second recording are a visual signal and an audio signal projecting on a same event.

17. A device for identifying recordings of live events, comprising:

a memory that stores computer executable components; and

a processor that executes computer executable components, stored in the memory, comprising;

a signal generation component configured to generate at least one signal for a live event, the live event occurring at a physical venue,

wherein the at least one signal is to be used as a fingerprint for identifying recordings of the live event,

wherein the at least one signal is to be overlaid onto the physical venue during a portion of the live event, and

wherein a recording device, capturing in a recording the portion of the live event of the physical venue and at a time of the portion of the live event, captures the at least one signal with the portion of the live event;

a reception component that receives a first recording of the live event, the first recording comprises the at least one signal and is in a first format, the first recoding captured by the recording device;

a mapping component that retrieves, based on the fingerprint, a predefined identifier associated with the live event, the predefined identifier comprises metadata related to the live event; and

an implementation component that;

retrieves a digital rights management policy based on the at least one signal; and

applies at least one action based on the matching performed by the mapping component and the digital rights management policy.

18. The device of claim 17, wherein the reception component receives a second recording of the live event, the second recording comprises a second signal and the mapping component matches the second signal to the predefined identifier associated with the live event, the device further comprising:

an aggregation component that combines the first recording and the second recording to create a collective social experience.