MEDIA STREAM CUE POINT CREATION WITH AUTOMATED CONTENT RECOGNITION

• US 20150341410A1
• Filed: 09/30/2014
• Published: 11/26/2015
• Est. Priority Date: 05/21/2014
• Status: Active Grant

• Current Assignee: Audible Magic Corporation
• Original Assignee: Audible Magic Corporation
• Inventors: Ikezoye, Vance, Wold, Erling, Edel, Alan, Schrempp, Jim, Williams, Rob, Avery, Dave
• Granted Patent: US 10,091,263 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06V 10/761 Proximity, similarity or dissimilarity measures
• CPC Class Codes: G06V 20/46 Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
• CPC Class Codes: H04L 65/61 for supporting one-way streaming services, e.g. Internet radio
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/75 Media network packet handling
• CPC Class Codes: H04L 65/756 adapting media to device capabilities
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355
• CPC Class Codes: H04L 65/765 intermediate
• CPC Class Codes: H04N 21/23424 involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
• CPC Class Codes: H04N 21/440245 the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment

Abstract

A media stream cue point creator receives a media stream comprising at least one of an audio portion or a video portion, wherein the media stream lacks at least one indicator of a content segment within the media stream. The media stream cue point creator identifies a first segment of the plurality of segments of the media stream, wherein the segment corresponds to a segment in a segment reference data store, and creates a cue point associated with the first segment, wherein the cue point identifies at least one of a beginning or an end of the first content segment in the media stream.

Claims

1. A method comprising:

receiving a media stream comprising at least one of an audio portion or a video portion, wherein the media stream lacks at least one indicator of a content segment within the media stream;

identifying, by a processing device, a first segment of the plurality of segments of the media stream, wherein the segment corresponds to a segment in a segment reference data store; and

creating a cue point associated with the first segment, wherein the cue point identifies at least one of a beginning or an end of the first segment in the media stream.

2. The method of claim 1, further comprising:

generating an alert signaling an operation to be performed on the first segment in the media stream.

3. The method of claim 2, wherein the operation is performed during at least one of playback of the media stream or a period prior to playback of the media stream.

4. The method of claim 2, wherein the operation comprises replacing the first segment in the media stream with a second segment.

5. The method of claim 4, further comprising:

identifying playback context information for playback of the media stream; and

identifying the second segment in view of the playback context information.

6. The method of claim 5, wherein the playback context information comprises at least one of a time when playback of the media stream is requested, a location where playback of the media stream is requested, or an indication of a requestor of playback of the media stream.

7. The method of claim 1, wherein identifying the first segment of the plurality of segments of the media stream comprises:

generating a fingerprint of at least a portion of the first segment;

comparing the fingerprint to a plurality of known segments in the segment reference data store; and

determining whether the fingerprint matches at least one of the plurality of known segments.

8. A system comprising:

a processing device;

a memory coupled to the processing device, the memory storing a media stream cue point creator, executable by the processing device from the memory, to;

receive a media stream comprising at least one of an audio portion or a video portion, wherein the media stream lacks at least one indicator of a content segment within the media stream;

identify a first segment of the plurality of segments of the media stream, wherein the segment corresponds to a segment in a segment reference data store; and

create a cue point associated with the first segment, wherein the cue point identifies at least one of a beginning or an end of the first segment in the media stream.

9. The system of claim 8, wherein the media stream cue point creator is further to:

generate an alert signaling an operation to be performed on the first segment in the media stream.

10. The system of claim 9, wherein the operation is performed during at least one of playback of the media stream or a period prior to playback of the media stream.

11. The system of claim 9, wherein the operation comprises replacing the first segment in the media stream with a second segment.

12. The method of claim 11, wherein the media stream cue point creator is further to:

identify playback context information for playback of the media stream; and

identify the second segment in view of the playback context information.

13. The system of claim 12, wherein the playback context information comprises at least one of a time when playback of the media stream is requested, a location where playback of the media stream is requested, or an indication of a requestor of playback of the media stream.

14. The system of claim 8, wherein to identify the first segment of the plurality of segments of the media stream, the media stream cue point creator is further to:

generate a fingerprint of at least a portion of the first segment;

compare the fingerprint to a plurality of known segments in the segment reference data store; and

determine whether the fingerprint matches at least one of the plurality of known segments.

15. A non-transitory computer-readable storage medium storing instructions which, when executed by a processing device, cause the processing device to perform operations comprising:

receiving a media stream comprising at least one of an audio portion or a video portion, wherein the media stream lacks at least one indicator of a content segment within the media stream;

identifying, by the processing device, a first segment of the plurality of segments of the media stream, wherein the segment corresponds to a known segment in a segment reference data store; and

creating a cue point associated with the first segment, wherein the cue point identifies at least one of a beginning or an end of the first segment in the media stream.

16. The non-transitory computer-readable storage medium of claim 15, wherein the operations further comprise:

generating an alert signaling an operation to be performed on the first segment in the media stream, wherein the operation is performed during at least one of playback of the media stream or a period prior to playback of the media stream.

17. The non-transitory computer-readable storage medium of claim 16, wherein the operation is performed by a first device that is different from a second device that created the cue point as is performed in response to an instruction received from the second device.

18. The non-transitory computer-readable storage medium of claim 17, wherein the operations further comprise:

identifying playback context information for playback of the media stream; and

identifying the second segment in view of the playback context information.

19. The non-transitory computer-readable storage medium of claim 18, wherein the playback context information comprises at least one of a time when playback of the media stream is requested, a location where playback of the media stream is requested, or an indication of a requestor of playback of the media stream.

20. The non-transitory computer-readable storage medium of claim 15, wherein identifying the first segment of the plurality of segments of the media stream comprises:

generating a fingerprint of at least a portion of the first segment;

comparing the fingerprint to a plurality of known segments in the segment reference data store; and

determining whether the fingerprint matches at least one of the plurality of known segments.

21. A method comprising:

receiving a media stream comprising at least one of an audio portion or a video portion, wherein the media stream has at least one indicator of a content segment within the media stream, wherein the at least one indicator is inaccurate;

identifying, by a processing device, a first segment of the plurality of segments of the media stream, wherein the segment corresponds to a segment in a segment reference data store; and

creating a cue point associated with the first segment, wherein the cue point identifies at least one of a beginning or an end of the first segment in the media stream.