ANNOTATING AND INDEXING BROADCAST VIDEO FOR SEARCHABILITY

• US 20160127795A1
• Filed: 04/01/2015
• Published: 05/05/2016
• Est. Priority Date: 11/03/2014
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Mason, Joanna, Wheeler, Craig J., Av, Daniel, Smith, Gregory M., Siebert, Michael Ahmed Sengan, Garcia, Antonio Vargas
• Granted Patent: US 9,788,071 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/71 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/739 in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
• CPC Class Codes: G06F 16/7867 using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
• CPC Class Codes: H04N 21/25891 being end-user preferences retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/4828 for searching program descriptors retrieval of video data G06F16/739
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 21/8545 for generating interactive applications

Abstract

A method providing searchable streaming video broadcasts via an interactive media server, the interactive media server generates a live broadcast video stream for each of a plurality of interactive media sessions and a video provider server providing a connection to the live broadcast video stream for viewing, the method comprising receiving an interactive media events stream for each interactive media session from the interactive media server, generating statistics data for each interactive media session based upon the events stream, and generating a searchable index of a directory of the live broadcast video streams, the searchable index including a plurality of entries, each entry including (a) a link to the live broadcast video stream for a corresponding interactive media session provided by the video provider server, and (b) metadata associated with the corresponding interactive media session, the metadata generated based upon the statistics data for the corresponding interactive media session.

Claims

1. A method for providing searchable streaming video broadcasts generated from a plurality of interactive media sessions at an interactive media server, wherein the interactive media server generates a live broadcast video stream for each of the interactive media sessions and a video provider server providing a connection to the live broadcast video stream for viewing, the method comprising:

at a statistics server, receiving an interactive media interactive media events stream for each interactive media session from the interactive media server;

generating statistics data for each interactive media session based upon the events stream; and

at an indexing server, generating a searchable index of a directory of live broadcast video streams, the searchable index including a plurality of entries, each entry including (a) a link to the live broadcast video stream for a corresponding interactive media session provided by the video provider server, and (b) metadata associated with the corresponding interactive media session, the metadata being generated based upon the statistics data for the corresponding interactive media session.

2. The method of claim 1, further comprising, providing a search interface configured to:

receive a search query from a computing device;

look up one or more terms in the search query in the searchable index; and

send to the computing device a displayable list of one or more search results including at least one of the links corresponding to one of the live broadcast video streams provided by the video provider server.

3. The method of claim 2, where the search query includes filters and search options related to the metadata.

4. The method of claim 2, further comprising programmatically sending a list of links to live broadcast video streams based on user inputs generated via an interactive media device from the indexing server to the interactive media device.

5. The method of claim 1, where a portion of the statistics data that is generated is determined by applying statistics rules set by a developer.

6. The method of claim 5, further comprising altering the statistics rules in response to receiving a rule change request from a developer computing device.

7. The method of claim 1, where the live broadcast video stream includes at least one of microphone input data and video input data from an interactive media device.

8. The method of claim 1, where the metadata is time stamped corresponding to a temporal location in the live broadcast video stream.

9. The method of claim 1, further comprising maintaining on a directory server the directory of the live broadcast video stream provided by the video provider server for each interactive media session, the directory including a list of links to live broadcast video streams for each interactive media session on the video provider server.

10. The method of claim 1, where the step of generating the searchable index is implemented in near real-time.

11. A system for providing searchable video data generated from a plurality of interactive media sessions at an interactive media server, wherein the interactive media server generates a live broadcast video stream for each of the interactive media sessions and a video provider server provides connections to the video data for viewing, the system comprising:

one or more computing devices each having at least one processor and associated memory, the processor configured to execute the following software programs;

a statistics engine configured to;

receive an interactive media interactive media events stream for each interactive media session from the interactive media server;

generate statistics data for each interactive media session based upon the events stream; and

an indexing engine configured to generate a searchable index of a directory of the live broadcast video streams, the searchable index including a plurality of entries, each entry including (a) a link to the live broadcast video stream for a corresponding interactive media session provided by the video provider server, and (b) metadata associated with the corresponding interactive media session, the metadata being generated based upon the statistics data for the corresponding interactive media session.

12. The system of claim 11, where the indexing server is configured to provide a search interface configured to:

receive a search query from a computing device;

look up one or more terms in the search query in the searchable index; and

send to the computing device a displayable list of one or more search results including at least one of the links corresponding to one of the live broadcast video streams provided by the video provider server.

13. The system of claim 11, where the media statistics server is further configured to inhibit indexing of the selected portion of the statistics data when an interactive media session is discontinued.

14. The system of claim 11, where the metadata is time stamped corresponding to a temporal location in the corresponding live broadcast video stream.

15. The system of claim 11, further comprising a directory server configured to maintain the directory of the live broadcast video stream provided by the video provider server for each interactive media session, the directory including a list of links to live broadcast video streams for each interactive media session on the video provider server.

16. The system of claim 11, where the statistics data includes one or more of map type, weapon type, tool type, points data, and level data.

17. The system of claim 11, where the indexing engine is configured to update the searchable index periodically based on the live broadcast video streams.

18. A method for providing searchable streaming video broadcasts generated from a plurality of interactive media sessions at an interactive media server, wherein the interactive media server generates a live broadcast video stream for each of the interactive media sessions and a video provider server providing a connection to the live broadcast video stream for viewing, the method comprising:

maintaining on a directory server the directory of the live broadcast video stream provided by the video provider server for each interactive media session, the directory including a list of links to live broadcast video streams for each interactive media session on the video provider server;

at a media statistics server, receiving an interactive media interactive media events stream for each interactive media session from the interactive media server;

generating statistics data for each interactive media session based upon the events stream; and

at an indexing server, generating a searchable index of the directory, the searchable index including a plurality of entries, each entry including (a) a link to the live broadcast video stream for a corresponding interactive media session provided by the video provider server, and (b) metadata associated with the corresponding interactive media session, the metadata being generated based upon the statistics data for the corresponding interactive media session.

19. The method of claim 18, further comprising programmatically sending a list of links to live broadcast video streams based on user inputs generated via an interactive media device from the indexing server to the interactive media device.

20. The method of claim 18, where the metadata is time stamped corresponding to a temporal location in the live broadcast video stream.