Distributed live multimedia capture, feedback mechanism, and network

• US 8,250,616 B2
• Filed: 09/28/2007
• Issued: 08/21/2012
• Est. Priority Date: 09/28/2007
• Status: Active Grant

• Current Assignee: Verizon Patent and Licensing Incorporated (Verizon Communications Inc.)
• Original Assignee: Yahoo! Inc. (Apollo Global Management, Inc.)
• Inventors: Davis, Marc, O'Sullivan, Joseph, Higgins, Chris W., Martinez, Ron, Athsani, Athellina
• Primary Examiner(s): Jalil, Neveen Abel
• Assistant Examiner(s): KINSAUL, DANIEL W
• Application Number:
  US11/864,769
• Publication Number:
  US 20090089294A1
• Time in Patent Office: 1,789 Days
• Field of Search: None
• US Class Current: 725/87
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/25891 being end-user preferences retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/475 End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
• CPC Class Codes: H04N 21/6582 Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

Methods and systems for processing multimedia content captured from a plurality of locations via one or more capturing devices include obtaining multimedia content from one or more capturing devices. The capturing devices identify a type of content being captured and/or location of capture. An interest type for multimedia content is obtained from a consuming user. The multimedia content from the capturing devices are searched based on the interest type of the consuming user. A subset of the multimedia content conforming to the interest type is presented in substantial real-time at the receiving devices of the consuming users. Feedback regarding the presented multimedia content is obtained from consuming users and communicated to the capturing devices in substantial real-time so as to influence future capture of multimedia content.

Claims

1. A method for processing multimedia content captured from a plurality of locations via one or more capturing devices, comprising:

obtaining streams of multimedia content from one or more capturing devices, the capturing devices identifying a type of content being captured or location of capture, wherein the capturing devices are mobile capturing devices and the multimedia content captured by the capturing devices is of live content;

enabling search of the multimedia content;

presenting streams of the multimedia content conforming to the search at the receiving devices;

enabling substantial real-time feedback from the receiving devices to one or more capturing devices that provide the streams of multimedia content, the substantial real-time feedback configured to influence actions taken by selected ones of the capturing devices during capture, wherein the real-time feedback includes votes used to influence actions at the capturing devices that serve to modify the streams of the multimedia content presented at the receiving devices; and

aggregating the votes obtained from the receiving devices and communicating results from the aggregation to the capturing devices so as to influence modification of the stream captured by the capturing devices.

2. The method for processing multimedia content captured from a plurality of locations via one or more capturing devices of claim 1, wherein the capturing devices are configured to capture and transmit the multimedia content over a communication network and wherein the type of content includes content related to one of event, topic, people, location, time, activity, object, product, brand or service, the type of content identified through metadata provided by the capturing devices.

3. The method for processing multimedia content captured from a plurality of locations via one or more capturing devices of claim 1, wherein identifying location of capture is through one of a geo-locator mechanism associated with each of the capturing devices or metadata provided by the capturing devices.

4. The method for processing multimedia content captured from a plurality of locations via one or more capturing devices of claim 1, wherein enabling search further comprising:

obtaining a search preference, the search preference identifying search criteria of a user interested in the multimedia content;

identifying multimedia content available from the capturing devices based on the search preference; and

organizing the identified multimedia content into a plurality of related indices, the organizing of the multimedia content is by indexing, ranking, and ordering the multimedia content based on a ranking algorithm and the search preference.

5. The method for processing multimedia content captured from a plurality of locations via one or more capturing devices of claim 4, wherein presenting the multimedia streams further including:

filtering the organized multimedia content iteratively based on context of the multimedia content and the search preference;

formatting the filtered multimedia content based on presentation criteria for the receiving devices, and

providing access to the formatted multimedia content to the receiving devices, the access allowing rendering of the multimedia content on the receiving devices based on the presentation criteria.

6. The method for processing multimedia content captured from a plurality of locations via one or more capturing devices of claim 5, wherein the search preference includes any one or combination of consuming user preferences, preferences associated with hardware of receiving devices, location of the receiving device, network-affiliation of the receiving devices, demographic, and subscriber status.

7. The method for processing multimedia content captured from a plurality of locations via one or more capturing devices of claim 1, wherein enabling feedback further comprising:

capturing an action, an interaction or a communication event on each of the receiving devices, the actions, interactions and communications identifying the user feedback related to the multimedia content in substantial real-time; and

organizing the captured feedback from the receiving devices into a plurality of related indices associated with the event and users, the organizing of the feedback is by aggregating, filtering, summarizing, arbitrating and transcoding the feedback, the organized feedback presented at the capturing devices so as to effectively influence actions taken at the capturing devices.

8. The method for processing multimedia content captured from a plurality of locations via one or more capturing devices of claim 7, wherein the substantial real-time feedback between the receiving devices and capturing devices is by one of direct interaction or interaction through a feedback engine, the interaction being synchronous or asynchronous.

9. The method for processing multimedia content captured from a plurality of locations via one or more capturing devices of claim 1, wherein enabling substantial real-time feedback further including coordinating requests from consuming users, the coordination of requests comprising:

receiving requests from one or more consuming users for multimedia content for a specific event or topic, the request identifying the location of capture;

identifying a set of capturing devices associated with one or more generating users to service the request, wherein the capturing devices are located at one of the location of capture or location substantially close to the location of capture;

facilitating a substantial real-time communication call to the generating users associated with the identified set of capturing devices; and

communicating the response from the generating users associated with the identified set of capturing devices to the consuming users in response to the request, in substantial real-time.

10. The method for processing multimedia content captured from a plurality of locations via one or more capturing devices of claim 1, wherein the multimedia content captured by the capturing devices are dynamically updated in substantial real-time, and wherein the feedback obtained from the consuming users is dynamically changing in substantial real-time.

11. The method for processing multimedia content captured from a plurality of locations via one or more capturing devices of claim 1, wherein the multimedia content includes metadata for providing pertinent information related to multimedia content and the capturing device associated with the multimedia content, the multimedia content may be one of text, audio, video, vibrations, graphics, or any combinations thereof.

12. A method for managing multimedia content capture and access, comprising:

obtaining streams of multimedia content from one or more capturing devices, the capturing devices identifying a type of content being captured or location of capture, wherein the capturing devices are mobile capturing devices and the multimedia content captured by the capturing devices is of live content;

obtaining an interest type for multimedia content from a consuming user;

searching the multimedia content for a subset of multimedia content based on the interest type of the consuming user;

presenting the searched subset of the multimedia content to receiving devices;

obtaining feedback regarding the one or more multimedia content from consuming users that have access to the receiving devices, wherein the feedback includes votes used to influence actions at the capturing devices that serve to modify the streams of the multimedia content presented at the receiving devices; and

aggregating the votes obtained from the receiving devices and communicating results from the aggregation to the capturing devices to influence actions to be taken at the one or more capturing devices during capturing of multimedia content in substantial real-time, the influenced actions serving to modify the one or more multimedia content captured by the capturing devices in substantial real time.

13. The method for managing multimedia content capture and access of claim 12, wherein searching the multimedia content further comprising:

identifying a subset of multimedia content from the multimedia content captured by the capturing devices based on the interest type of the consuming user, wherein the multimedia content captured by the capturing devices is dynamically updated in substantial real-time; and

organizing the identified subset of multimedia content into a plurality of indices by indexing, ranking, ordering and filtering the subset of multimedia content based on a ranking algorithm and the interest type of consuming user.

14. The method for managing multimedia content capture and access of claim 13, wherein presenting the searched subset of the multimedia content further including:

identifying the appropriate subset of multimedia content for the consuming user;

formatting the multimedia content based on presentation criteria associated with a receiving device of the consuming user; and

providing access to the formatted subset of multimedia content to the receiving device, the multimedia content in the formatted subset defining the interest type of the consuming user.

15. The method for managing multimedia content capture and access of claim 12, wherein obtaining feedback further comprising:

capturing actions, interactions or communication events from the receiving device, the actions, interactions and communications identifying the user feedback related to the subset of multimedia content presented at the receiving device; and

organizing the captured feedback from the receiving devices into respective indices associated with the respective event and users by aggregating, filtering, summarizing, arbitrating and transcoding,

wherein the feedback obtained from the consuming users is dynamically changing in substantial real-time based on the multimedia content presented.

16. The method for managing multimedia content capture and access of claim 12, wherein communicating feedback further comprising:

identifying the appropriate feedback index associated with the capturing devices;

presenting the organized feedback from the identified feedback index at the capturing devices in substantial real-time so as to influence future capture content.

17. A method for managing interactive multimedia content, the method comprising:

receiving streams of multimedia content at a feedback engine, the multimedia content obtained from capturing devices associated with one or more generating users, each of the capturing devices communicatively connected to the feedback engine and configured to capture and transmit the multimedia content in substantial real-time over a communication network, wherein the capturing devices are mobile capturing devices and the multimedia content captured by the capturing devices is of live content;

processing the multimedia content by the feedback engine;

providing access to the multimedia content, the access being provided to receiving devices of consuming users in substantial real-time, each of the receiving devices being in communication with the feedback engine over the communication network, wherein the capturing devices operate independent of the receiving devices;

receiving feedback about or from one or more of the consuming users, the feedback being processed by the feedback engine in substantial real-time, wherein the feedback includes votes used to influence actions at the capturing devices that serve to modify the streams of multimedia content captured by the capturing devices, wherein the votes are aggregated and results from the aggregation communicated to the capturing devices so as to influence modification of the stream captured by the capturing devices; and

presenting certain multimedia content to the receiving devices based on search preference, such that each of the consuming users is presented with a dynamically changing subset of the plurality of multimedia content based on changes in content obtained from the plurality of capturing devices and based on the search preference.

18. The method for managing interactive multimedia content of claim 17, wherein processing the multimedia content by the feedback engine further comprising:

receiving the multimedia content captured by the capturing devices in substantial real-time; and

organizing the multimedia content into a plurality of indices by indexing, ranking, ordering and filtering the multimedia content based on a ranking algorithm and the content type of the captured multimedia.

19. The method for managing interactive multimedia content of claim 17, wherein providing access to the receiving devices further comprising:

receiving search preference for the multimedia content from the consuming users;

identifying a subset of organized multimedia content based on the search preference of each of the consuming users;

formatting the organized subset of multimedia content based on presentation criteria of each of the receiving devices and the search preference of each of the consuming users; and

presenting the formatted subset of multimedia content specific to each of the consuming users at the respective receiving devices in substantial real-time,

wherein the multimedia content is dynamically changing.

20. The method for managing interactive multimedia content of claim 17, wherein receiving feedback from the receiving devices further comprising:

capturing actions, interactions and communication events at each of the receiving devices in substantial real-time, the captured actions, interactions and communication events identifying consuming users feedback related to or about the multimedia content; and

organizing the feedback into plurality of indices by aggregating, filtering, summarizing, arbitrating and transcoding the feedback; and

presenting the appropriate organized feedback to the respective capturing devices to effectuate actions taken at the capturing devices.

21. The method for managing interactive multimedia content of claim 20, wherein presenting certain multimedia content to the receiving devices further comprising:

updating a plurality of related indices associated with the event and users of the multimedia content based on the appropriate feedback from the consuming users, the updating of the indices redefining the ranking and priority of the multimedia content;

identifying the multimedia content captured by the capturing devices based on the search preference and the redefined ranking and priority to determine certain multimedia content that fits the search preference;

organizing the multimedia content by indexing, ordering, ranking and filtering based on the search preference and presentation criteria; and

presenting the multimedia content to the receiving devices.

22. A system for managing interactive multimedia content, the system comprising:

a plurality of capturing devices handled by one or more generating users, each of the plurality of capturing devices configured to capture and transmit streams of multimedia content in substantial real-time over a communication network, wherein the plurality of capturing devices are mobile capturing devices and the multimedia content captured by the capturing devices is of live content;

a plurality of receiving devices associated with one or more consuming users, each of the plurality of receiving devices configured to receive the multimedia content in substantial real-time over the communication network and to provide feedback in substantial real-time, wherein the plurality of capturing devices operate independent of the receiving devices, wherein the real-time feedback includes votes used to influence actions at the capturing devices that serve to modify the streams of the multimedia content transmitted to the receiving devices; and

a feedback engine communicatively connected to the plurality of capturing devices and the plurality of receiving devices, the feedback engine including a stream management module and a feedback management module, wherein the stream management module is configured to process requests and multimedia content by at least one of validating, retrieving, indexing, formatting or presenting multimedia content to the receiving devices based on search preference and the feedback management module is configured to instrument rendering of multimedia content at the receiving devices, and at least one of gathering, reviewing, indexing, prioritizing or publishing feedback to the appropriate capturing devices to influence actions to be taken at selected ones of capturing devices, such that each of the receiving devices is presented with a dynamically changing subset of the multimedia content based on changes in content obtained over time from the plurality of capturing devices and based on the search preference, wherein gathering of feedback further includes aggregating the votes obtained from the receiving devices, and publishing of feedback further includes communicating results from the aggregation to the capturing devices so as to influence modification of the stream captured by the capturing devices.

23. The system for managing interactive multimedia content of claim 22, wherein the stream management module and the feedback management module are configured such that the stream management module and feedback management module are either integrated into a single feedback engine and executed concurrently or located in separate feedback engines that run complementary to each other, wherein the capturing devices further include a geo-locator mechanism to identify a location of capture of the multimedia content.

24. The system for managing interactive multimedia content of claim 22, wherein each of the plurality of capturing devices further including,

a) controls for capturing and transmitting multimedia content, wherein the capturing devices controls are defined through one of software or hardware;

b) a storage device to store the captured multimedia content and metadata associated with the multimedia content and Users for subsequent retrieval, the storage device available locally or remotely, wherein the remote storage device is accessed over the communication network, and

wherein, each of the plurality of receiving devices further including,

a) controls for receiving and providing feedback to multimedia content, wherein the receiving devices controls are defined through one of software or hardware;

b) a storage device to store the multimedia content and feedback associated with the multimedia content and Users for subsequent retrieval, the storage device available locally or remotely, wherein the remote storage device is accessed over the communication network.

25. A non-transitory computer readable storage medium storing program instructions for operating a computing system to process multimedia content captured from a plurality of locations via one or more capturing devices, comprising:

program instructions for obtaining streams of multimedia content from one or more capturing devices, the capturing devices identifying a type of content being captured or location of capture, wherein the capturing devices are mobile capturing devices and the multimedia content captured by the capturing devices is of live content;

program instructions for enabling search of the multimedia content;

program instructions for presenting streams of the multimedia content conforming to the search, the presenting being for at the receiving devices;

program instructions for enabling substantial real-time feedback from the receiving devices to one or more capturing devices that provide the streams of multimedia content, the substantial real-time feedback configured to influence actions taken by selected ones of the capturing devices during capture, wherein the real-time feedback includes votes used to influence actions at the capturing devices that serve to modify the streams of the multimedia content presented at the receiving devices; and

program instructions for aggregating the votes obtained from the receiving devices and communicating results from the aggregation to the capturing devices so as to influence modification of the stream by the capturing devices.