SYSTEM AND METHOD FOR PROVIDING MATCHED MULTIMEDIA VIDEO CONTENT

• US 20140172961A1
• Filed: 12/18/2013
• Published: 06/19/2014
• Est. Priority Date: 09/09/2011
• Status: Abandoned Application

• Current Assignee: Elliot Allen Swan, Justin David Dunlap, Mathew David Polzin, Robert Bryce Clemmer, Sam Olusegun Oluwalana
• Original Assignee: Elliot Allen Swan, Justin David Dunlap, Mathew David Polzin, Robert Bryce Clemmer, Sam Olusegun Oluwalana
• Inventors: Clemmer, Robert Bryce, Oluwalana, Sam Olusegun, Swan, Elliot Allen, Polzin, Mathew David, Dunlap, Justin David
• Application Number:
  US14/133,583
• Publication Number:
  US 20140172961A1
• Time in Patent Office: Days
• US Class Current: 709/203
• CPC Class Codes: H04L 65/4015 where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference
• CPC Class Codes: H04L 65/611 for multicast or broadcast systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/765 intermediate
• CPC Class Codes: H04N 21/43076 of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/45457 applied to a time segment
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content

Abstract

A system for providing content to client computing devices. The system is configured to receive an audio feed that includes audio segments. Each audio segment includes either regular audio content or preemptory audio content. The system may determine whether each audio segment includes regular or preemptory audio content. For each audio segment determined to include preemptory audio content, the system may direct the client computing devices to preempt, with the preemptory audio content, any current content being presented by the client computing devices. For each audio segment determined to include regular audio content, the system may identify the regular audio content, match multimedia video content with the identified regular audio content, and direct the matched multimedia video content to the client computing devices for presentation thereby to users.

Claims

1. A method of providing content to a client computing device configured to present the content to a user, the method being performed by one or more computing devices connected to the client computing device, the method comprising:

receiving an audio feed having audio segments, each of the audio segments including either regular audio content or preemptory audio content;

determining whether each of the audio segments includes regular audio content or preemptory audio content;

for each of the audio segments determined to include preemptory audio content, directing the client computing device to preempt, with the preemptory audio content, any current content being presented by the client computing device; and

for each of the audio segments determined to include regular audio content, identifying the regular audio content, matching multimedia video content with the identified regular audio content, and directing the matched multimedia video content to the client computing device for presentation thereby to the user.

2. The method of claim 1, wherein identifying the regular audio content comprises parsing meta data from the regular audio content.

3. The method of claim 2, wherein identifying the regular audio content further comprises disambiguating that meta data to obtain a unique representation of the regular audio content.

4. The method of claim 3, wherein identifying the regular audio content further comprises identifying an audio object by searching an audio database for the unique representation of the regular audio content.

5. The method of claim 4, wherein matching multimedia video content with the identified regular audio content comprises searching a video storage for one or more multimedia video content objects that match the audio object, the one or more multimedia video content objects comprising the multimedia video content.

6. The method of claim 5, further comprising filtering the one or more multimedia video content objects to obtain the multimedia video content.

7. The method of claim 5, further comprising assigning a weight to each of the one or more multimedia video content objects;

and

selecting one of the one or more multimedia video content objects as the multimedia video content based on the weight assigned to each of the one or more multimedia video content objects.

8. The method of claim 7, wherein the weight assigned to each of the one or more multimedia video content objects is determined at least in part based on user feedback.

9. The method of claim 1, wherein the audio feed is received from a radio station, and identifying the regular audio content comprises receiving identifying information from the radio station, or parsing now playing information provided by a secondary source that is time synced with the audio feed.

10. The method of claim 1, wherein identifying the regular audio content comprises performing a fingerprinting operation on the regular audio content.

11. The method of claim 10, wherein performing the fingerprinting operation on the regular audio content comprises performing a Sim-Hash algorithm on the regular audio content.

12. The method of claim 1, further comprising:

when the matched multimedia video content is explicit content, requiring a confirmation from the client computing device before directing the matched multimedia video content to the client computing device.

13. The method of claim 1, wherein determining whether each of the audio segments includes regular audio content or preemptory audio content comprises attempting to identify audio content included in the audio segment, and determining the audio segment includes preemptory audio content if the attempt to identify the audio content is unsuccessful.

14. The method of claim 1, wherein the audio feed is received from an audio source, and determining whether each of the audio segments includes regular audio content or preemptory audio content comprises receiving an indicator from the audio source indicating whether the audio segment includes regular audio content or preemptory audio content.

15. A system for use with a plurality of client computing devices each configured to display audio and video content, the system comprising:

at least one update server computing device configured to receive an audio feed comprising audio segments, match at least a portion of the audio segments with video content, and construct an update for each of the audio segments, each update comprising the video content, if any, matched with the audio segment associated with the update; and

at least one communication server computing device connected to the plurality of client computing devices and the at least one update server computing device, the at least one communication server computing device being configured to receive the updates, and direct the updates to the plurality of client computing devices.

16. The system of claim 15, wherein the at least one communication server computing device comprises a plurality of communication server computing devices, and the system further comprises:

at least one long poll redirect server computing device configured to receive long poll requests from the plurality of client computing devices, and direct each of the requests to a selected one of the plurality of communication server computing devices, the requests indicating that the client computing devices would like to continue receiving updates.

17. A method for use with a server computing device and an audio stream received by the server computing device, the method comprising:

playing, by a client computing device connected to the server computing device, current content comprising either current video content or current audio only content;

while the current content is playing, receiving, by the client computing device, a first update from the server, the first update indicating whether first video content has been matched to first audio content in the audio stream; and

when the first update indicates that first video content has been matched to the first audio content, determining, by the client computing device, whether to preempt the current content with the first video content or wait to play the first video content until after the current content has finished playing.

18. The method of claim 17, further comprising:

when the first update indicates that first video content has not been matched to the first audio content, selecting, by the client computing device, a live content stream comprising live content, and playing the live content of the live content stream.

19. The method of claim 18, further comprising:

after starting to play the live content, receiving, by the client computing device, a second update from the server, the second update indicating a second video content has been matched to second audio content in the audio stream; and

preempting, by the client computing device, the live content with the second video content.

20. The method of claim 17, further comprising:

while playing the first video content, receiving, by the client computing device, a second update from the server, the second update indicating a second video content has been matched to second audio content in the audio stream; and

waiting to play the second video content until after the first video content has finished playing.

21. The method of claim 17, further comprising:

while playing the first video content, receiving, by the client computing device, a second update from the server, the second update indicating a second video content has not been matched to second audio content in the audio stream; and

preempting, by the client computing device, the first video content with the second audio content.

22. The method of claim 21, wherein the second audio content is a commercial.

23. The method of claim 17, further comprising:

receiving, by the client computing device, an indication that a first user operating the client computing device would like to share the first video content with a second user operating a different client computing device; and

sending a link to the first video content to the different client computing device that when selected by the second user causes the different computing device to play the first video content and begin receiving updates from the server computing device based on the audio feed.