LIVE VIDEO STREAMING SERVICES

• US 20160286244A1
• Filed: 03/28/2016
• Published: 09/29/2016
• Est. Priority Date: 03/27/2015
• Status: Active Grant

• Current Assignee: X Corp. (f/k/a Twitter, Inc.) (X Holdings Corp.)
• Original Assignee: X Corp. (f/k/a Twitter, Inc.) (X Holdings Corp.)
• Inventors: CHANG, Wayne, Sonwalkar, Suyash
• Granted Patent: US 10,721,499 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: H04N 21/21805 enabling multiple viewpoints, e.g. using a plurality of cameras
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/233 Processing of audio elementary streams monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/26603 for automatically generating descriptors from content, e.g. when it is not made available by its provider, using content analysis techniques
• CPC Class Codes: H04N 21/2668 Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063
• CPC Class Codes: H04N 21/2743 Video hosting of uploaded data from client
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/8133 specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 21/8549 Creating video summaries, e.g. movie trailer retrieval in video databases by using presentations in form of a video summary G06F16/739

Abstract

In some implementations, a system may include an interactive video broadcasting service, implemented on a server, configured to enable a plurality of source devices to broadcast live feed video streams, over a network, to a plurality of viewing devices. The interactive video broadcasting service includes a multi-perspective video sharing engine configured to determine that at least two of the live feed video streams relate to a same event. The multi-perspective video sharing engine provides a multi-perspective display, over the network, to at least one of the plurality of viewing devices in which the multi-perspective display concurrently streams the live feed video streams determined as related to the same event.

Claims

1. A system comprising:

an interactive video broadcasting service, implemented on a server, configured to enable a plurality of source devices to broadcast live feed video streams, over a network, to a plurality of viewing devices, the interactive video broadcasting service including,

a multi-perspective video sharing engine configured to determine that at least two of the live feed video streams relate to a same event,

the multi-perspective video sharing engine configured to provide a multi-perspective display, over the network, to at least one of the plurality of viewing devices, the multi-perspective display streaming the live feed video streams determined as related to the same event.

2. The system of claim 1, further comprising:

a replay generator configured to generate one or more replays of at least one of the two live feed video streams, the one or more replays including one or more video clips that capture past key activities of the event,

the replay generator configured to provide access to the one or more replays such that a replay can be selected to view the past key activities of the event instead of the whole live feed video stream.

3. The system of claim 1, wherein the multi-perspective video sharing engine includes a stream correlator configured to correlate two or more live feed video streams and replays to the same event based on one or more signals, the signals including user-provided engagements with the live feed video streams and the replays, location data, time information, and video analysis and audio analysis of the live feed video streams and the replays.

4. The system of claim 1, wherein the interactive video broadcasting service includes a video analyzer configured to analyze video of the live feed video streams,

wherein the multi-perspective video sharing engine is configured to determine that the live feed video streams relate to the same event based on results of the video analyzer.

5. The system of claim 1, wherein the interactive video broadcasting service includes an audio analyzer configured to analyze audio of the live feed video streams,

wherein the multi-perspective video sharing engine is configured to determine that the live feed video streams relate to the same event based on results of the audio analyzer.

6. The system of claim 1, wherein the multi-perspective video sharing engine is configured to detect and read a tag identifier of a physical object in one of the live feed video streams, the multi-perspective video sharing engine configured to identify the physical object based on the tag identifier,

wherein the multi-perspective video sharing engine is configured to use information from the tag identifier in the determination of whether the live feed video streams relate to the same event.

7. The system of claim 1, wherein the interactive video broadcasting service includes a contextual data inserter configured to insert contextual data about the event into one of the live feed video streams.

8. The system of claim 1, wherein the interactive video broadcasting service includes a video augmentation unit configured to augment one of the live feed video streams to insert contextual data about the event into frames of video.

9. The system of claim 1, wherein the interactive video broadcasting service includes a video remote controller configured to control an operation of a camera on one of the plurality of source devices that is broadcasting a live feed video stream, the video remote controller being configured to control the operation of the camera based on user-provided engagements with the live feed video stream provided by the plurality of viewing devices.

10. The system of claim 1, wherein the interactive video broadcasting service includes a stream and media promoter configured to insert a promoted broadcast stream into the multi-perspective display.

11. The system of claim 1, wherein the interactive video broadcasting service is configured to detect and read a tag identifier of a physical object captured in a live feed video stream, the multi-perspective video sharing engine configured to identify the physical object based on the tag identifier,

wherein the interactive video broadcasting service includes a video augmentation unit configured to augment the live feed video stream to include a selectable representation of the physical object.

12. A computer-implemented method comprising:

enabling, by an interactive video broadcasting service implemented on a server, a plurality of source devices to broadcast live feed video streams, over a network, to a plurality of viewing devices;

correlating multiple live feed video streams to a single event, the multiple live feed video streams including a first live feed video stream broadcast from a first source device and a second live feed video stream broadcast from a second source device; and

providing a multi-perspective display, over the network, to at least one of the plurality of viewing devices, the multi-perspective display streaming the first live feed video stream and the second live feed video stream at a same time or at different times.

13. The computer-implemented method of claim 12, wherein the correlating includes computing a score for each live feed video stream that indicates a level of similarity to another live feed video stream or the single event based on a combination of signals, and determining that a particular live feed video stream is correlated with another stream or the single event when the corresponding score is above or equal to a threshold value.

14. The computer-implemented method of claim 12, wherein the correlating includes computing a score for each live feed video stream that indicates a level of similarity to another live feed video stream or the single event using a weighted scoring algorithm that applies weights to a plurality of signals, and determining that a particular live feed video stream is correlated with another stream or the single event when the corresponding score is above or equal to a threshold value.

15. The computer-implemented method of claim 12, wherein the first live feed video stream is captured at a first location, and the second live feed video stream is captured at a second location, the first live feed video stream being displayed first, the method further comprising:

switching from the first live feed video stream to the second live feed video stream as the event progress.

16. The computer-implemented method of claim 12, further comprising:

automatically creating a replay from a broadcasted video stream, the replay being a shorter version of the broadcasted video stream; and

providing access to the replay in the multi-perspective display.

17. A non-transitory computer-readable medium storing executable code, that when executed by at least one processor, are configured to cause an interactive video broadcasting service implemented on a server to:

enable a plurality of source devices to broadcast live feed video streams, over a network, to a plurality of viewing devices;

automatically create a replay from a broadcasted video stream from one of the plurality of source devices, the replay being a shorter version of the broadcasted video stream;

correlate a live feed video stream and the replay to a single event, the live feed video stream originating from a first source device, the replay originating from a second source device; and

provide a multi-perspective display, over the network, to at least one of the plurality of viewing devices, the multi-perspective display identifying the live feed video stream and the replay.

18. The non-transitory computer-readable medium of claim 17, wherein the executable code to automatically create the replay includes executable code to automatically create the replay from the broadcasted video stream based on user engagements with various portions of the broadcasted video stream.

19. The non-transitory computer-readable medium of claim 17, wherein the executable code to automatically create the replay includes executable code to automatically create the replay to have two or more video clips relating to portions of the broadcasted video stream having a level of user engagements equal to or above a threshold level.

20. The non-transitory computer-readable medium of claim 17, wherein the executable code to correlate the live feed video stream and the replay to the single event includes executable code to compute a score for at least one of the live feed video stream and the replay using a weighted scoring algorithm that can dynamically adjust weights applied to a plurality of signals.