GENERATING A STITCHED DATA STREAM

• US 20180279016A1
• Filed: 03/27/2017
• Published: 09/27/2018
• Est. Priority Date: 03/27/2017
• Status: Active Grant

• Current Assignee: Snap, Inc.
• Original Assignee: Snap, Inc.
• Inventors: Tang, Kevin Dechau
• Granted Patent: US 10,582,277 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/487 using geographical or spatial information, e.g. location
• CPC Class Codes: G06F 16/489 using time information
• CPC Class Codes: G11B 27/036 Insert-editing
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04L 51/10 Multimedia information
• CPC Class Codes: H04L 51/222 using geographical location information, e.g. messages transmitted or received in proximity of a certain spot or area
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04N 21/434 Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream demultiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00
• CPC Class Codes: H04N 21/4828 for searching program descriptors retrieval of video data G06F16/739
• CPC Class Codes: H04N 21/632 using a connection between clients on a wide area network, e.g. setting up a peer-to-peer communication via Internet for retrieving video segments from the hard-disk of other client devices broadcast-related systems characterised by transmission among terminal devices H04H60/80; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/8113 comprising music, e.g. song in MP3 format
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

Systems and methods provide for receiving a request for an alternate data stream of a plurality of individual data streams than an active data stream currently being displayed on a computing device, during display on the computing device of a stitched data steam comprising the plurality of individual data streams associated with a common audio timeline. The systems and methods further providing for determining a subset of the plurality of individual data streams of the stitched data stream associated with a time period of the active data stream in the common audio timeline, selecting the alternate data stream from the subset of the plurality of individual data streams, and providing the alternate data stream to the computing device, wherein the display of the active data stream on the computing device transitions to the alternate data stream on the computing device in the common audio timeline.

Claims

1. A method performed by at least one processor, comprising:

during display on a computing device of a stitched data steam comprising a plurality of individual data streams associated with a common audio timeline, receiving a request for an alternate data stream of the plurality of individual data streams than an active data stream currently being displayed on the computing device;

determining a subset of the plurality of individual data streams of the stitched data stream associated with a time period of the active data stream in the common audio timeline;

selecting the alternate data stream from the subset of the plurality of individual data streams of the stitched data stream associated with the time period of the active data stream in the common audio timeline; and

providing the alternate data stream to the computing device, wherein the display of the active data stream on the computing device transitions to the alternate data stream on the computing device in the common audio timeline.

2. The method of claim 1, wherein the display of the stitched data stream continues from the alternate data stream and transitions to a next data stream of the plurality of data streams that occurs after the alternate data stream ends in the common audio timeline.

3. The method of claim 1, wherein selecting the alternate data stream from the subset of the plurality of data streams of the stitched data stream associated with the time period of the active data stream in the common audio timeline comprises:

determining a quality score for each data stream of the subset of the plurality of data streams of the stitched data stream associated with the time period of the active data stream; and

selecting the alternative data steam from the subset of the plurality of data streams of the stitched data stream associated with the time period of the active data stream based on the quality score for the alternate data stream.

4. The method of claim 3, wherein the quality score is based on at least one of a quality of video or images in the data stream and an interest score of the data stream to a plurality of users.

5. The method of claim 1, wherein selecting the alternate data stream from the subset of the plurality of data streams of the stitched data stream associated with the time period of the active data stream in the common audio timeline further comprises randomly selecting the alternate data stream from the subset of the plurality of data streams of the stitched data stream associated with the time period of the active data stream in the common audio timeline.

6. The method of claim 1, further comprising:

determining the time period of the active data stream based on data received in the request for the alternate data stream.

7. The method of claim 1, wherein determining the subset of the plurality of individual data streams of the stitched data stream associated with a time period of the active data stream in the common audio timeline, comprises:

analyzing the plurality of data streams to determine which of the plurality of data streams has a time period that overlaps with the time period of the active data stream.

8. The method of claim 1, further comprising:

receiving an indication from a user of the computing device to switch to an alternate data stream; and

sending the request for the alternate data stream.

9. The method of claim 1, wherein the plurality of data streams associated with the common audio timeline are received from a plurality of computing devices and stitched together to form the stitched data stream.

10. The method of claim 1, wherein the common audio timeline is for audio content that is an average of audio associated with the plurality of individual data streams of the stitched data stream.

11. A server computer comprising:

a processor; and

a computer readable medium coupled with the processor, the computer readable medium comprising instructions stored thereon that are executable by the processor to cause a computing device to perform operations comprising;

during display on a computing device of a stitched data steam comprising a plurality of individual data streams associated with a common audio timeline, receiving a request for an alternate data stream of the plurality of individual data streams than an active data stream currently being displayed on the computing device;

determining a subset of the plurality of individual data streams of the stitched data stream associated with a time period of the active data stream in the common audio timeline;

selecting the alternate data stream from the subset of the plurality of individual data streams of the stitched data stream associated with the time period of the active data stream in the common audio timeline; and

providing the alternate data stream to the computing device, wherein the display of the active data stream on the computing device transitions to the alternate data stream on the computing device in the common audio timeline.

12. The server computer of claim 11, wherein the display of the stitched data stream continues from the alternate data stream and transitions to a next data stream of the plurality of data streams that occurs after the alternate data stream ends in the common audio timeline.

13. The server computer of claim 11, wherein selecting the alternate data stream from the subset of the plurality of data streams of the stitched data stream associated with the time period of the active data stream in the common audio timeline comprises:

determining a quality score for each data stream of the subset of the plurality of data streams of the stitched data stream associated with the time period of the active data stream; and

selecting the alternative data steam from the subset of the plurality of data streams of the stitched data stream associated with the time period of the active data stream based on the quality score for the alternate data stream.

14. The server computer of claim 13, wherein the quality score is based on at least one of a quality of video or images in the data stream and an interest score of the data stream to a plurality of users.

15. The server computer of claim 11, wherein selecting the alternate data stream from the subset of the plurality of data streams of the stitched data stream associated with the time period of the active data stream in the common audio timeline further comprises randomly selecting the alternate data stream from the subset of the plurality of data streams of the stitched data stream associated with the time period of the active data stream in the common audio timeline.

16. The server computer of claim 11, further comprising:

determining the time period of the active data stream based on data received in the request for the alternate data stream.

17. The server computer of claim 11, wherein determining the subset of the plurality of individual data streams of the stitched data stream associated with a time period of the active data stream in the common audio timeline, comprises:

analyzing the plurality of data streams to determine which of the plurality of data streams has a time period that overlaps with the time period of the active data stream.

18. The server computer of claim 11, wherein the plurality of data streams associated with the common audio timeline are received from a plurality of computing devices and stitched together to form the stitched data stream.

19. The server computer of claim 11, wherein the common audio timeline is for audio content that is an average of audio associated with the plurality of individual data streams of the stitched data stream.

20. A non-transitory computer readable medium comprising instructions stored thereon that are executable by at least one processor to cause a computing device to perform operations comprising:

during display on the computing device of a stitched data steam comprising a plurality of individual data streams associated with a common audio timeline, receiving a request for an alternate data stream of the plurality of individual data streams than an active data stream currently being displayed on the computing device;

determining a subset of the plurality of individual data streams of the stitched data stream associated with a time period of the active data stream in the common audio timeline;

selecting the alternate data stream from the subset of the plurality of individual data streams of the stitched data stream associated with the time period of the active data stream in the common audio timeline; and

providing the alternate data stream to the computing device, wherein the display of the active data stream on the computing device transitions to the alternate data stream on the computing device in the common audio timeline.