Generating a stitched data stream

• US 10,582,277 B2
• Filed: 03/27/2017
• Issued: 03/03/2020
• Est. Priority Date: 03/27/2017
• Status: Active Grant

• Current Assignee: Snap, Inc.
• Original Assignee: Snap, Inc.
• Inventors: Tang, Kevin Dechau
• Primary Examiner(s): Blair, Douglas B
• Application Number:
  US15/470,025
• Publication Number:
  US 20180279016A1
• Time in Patent Office: 1,072 Days
• CPC Class Codes: G06F 16/487 using geographical or spatial information, e.g. location
• CPC Class Codes: G06F 16/489 using time information
• CPC Class Codes: G11B 27/036 Insert-editing
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04L 51/10 Multimedia information
• CPC Class Codes: H04L 51/222 using geographical location information, e.g. messages transmitted or received in proximity of a certain spot or area
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04N 21/434 Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream demultiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00
• CPC Class Codes: H04N 21/4828 for searching program descriptors retrieval of video data G06F16/739
• CPC Class Codes: H04N 21/632 using a connection between clients on a wide area network, e.g. setting up a peer-to-peer communication via Internet for retrieving video segments from the hard-disk of other client devices broadcast-related systems characterised by transmission among terminal devices H04H60/80; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/8113 comprising music, e.g. song in MP3 format
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

Systems and methods provide for receiving a request for an alternate data stream of a plurality of individual data streams than an active data stream currently being displayed on a computing device, during display on the computing device of a stitched data steam comprising the plurality of individual data streams associated with a common audio timeline. The systems and methods further providing for determining a subset of the plurality of individual data streams of the stitched data stream associated with a time period of the active data stream in the common audio timeline, selecting the alternate data stream from the subset of the plurality of individual data streams, and providing the alternate data stream to the computing device, wherein the display of the active data stream on the computing device transitions to the alternate data stream on the computing device in the common audio timeline.

Claims

1. A method performed by at least one processor, comprising:

generating a stitched data stream from a plurality of messages received from a plurality of computing devices that are associated with common audio content, the stitched data stream comprising a plurality of individual message data streams from the messages received and associated with a common audio timeline, the stitched data stream further comprising message data streams that overlap in time periods in the common audio timeline causing more than one message data stream for at least one time period in the stitched data stream;

causing display of the stitched data stream as a continuous data stream that transitions from one message data stream to a next message data stream to a continuous common audio stream;

during display of the stitched data steam, receiving a request for an alternate message data stream in the stitched data stream instead of a currently displayed active message data stream;

determining message data streams of the stitched data stream with a time period in the common audio timeline corresponding to a time period of the active message data stream;

selecting the alternate message data stream from the message data streams with the time period in the common audio timeline corresponding to the time period of the active message data stream; and

causing display of the alternate message data stream, wherein the display of the active message data stream transitions to the alternate message data stream of the stitched data stream in the common audio timeline and at the end of the alternate message data stream the display of the stitched data stream transitions to a next message data stream in the stitched data stream.

2. The method of claim 1, wherein selecting the alternate message data stream from the message data streams with the time period in the common audio timeline corresponding to the time period of the active message data stream comprises:

determining a quality score for each message data stream of the message data streams with the time period in the common audio timeline corresponding to the time period of the active message data stream; and

selecting the alternative message data steam from the message data streams with the time period in the common audio timeline corresponding to the time period of the active message data stream based on the quality score for the alternate message data stream.

3. The method of claim 2, wherein the quality score is based on at least one of a quality of video or images in the message data stream or an interest score of the message data stream to a plurality of users.

4. The method of claim 1, wherein selecting the alternate message data stream from the message data streams with the time period in the common audio timeline corresponding to the time period of the active message data stream further comprises randomly selecting the alternate message data stream from the message data streams with the time period in the common audio timeline corresponding to the time period of the active message data stream.

5. The method of claim 1, further comprising:

determining the time period of the active message data stream based on data received in the request for the alternate message data stream.

6. The method of claim 1, wherein determining message data streams of the stitched data stream with a time period in the common audio timeline corresponding to a time period of the active message data stream, comprises:

analyzing the message data streams of the stitched data stream to determine which of the message data streams has a time period that overlaps with the time period of the active message data stream.

7. The method of claim 1, further comprising:

receiving an indication from a user viewing the stitched data stream to switch to an alternate message data stream; and

sending the request for the alternate message data stream.

8. The method of claim 1, wherein the common audio timeline is for audio content that is an average of audio associated with the plurality of individual message data streams of the stitched data stream.

9. The method of claim 1, wherein the time period is a range of time from the start of the active message data stream to the end of the active message data stream.

10. The method of claim 1, wherein the continuous audio stream comprises original audio received in each of the plurality of messages.

11. The method of claim 1, wherein determining message data streams of the stitched data stream with a time period in the common audio timeline corresponding to a time period of the active message data stream, further comprises:

determining a time period in the common audio timeline for the active message data stream; and

determining which of the plurality of message data streams in the stitched data stream have a time period that overlaps with the time period of the active message data stream.

12. A server computer comprising:

a processor; and

a computer readable medium coupled with the processor, the computer readable medium comprising instructions stored thereon that are executable by the processor to cause a computing device to perform operations comprising;

generating a stitched data stream from a plurality of messages received from a plurality of computing devices that are associated with common audio content, the stitched data stream comprising a plurality of individual message data streams from the messages received and associated with a common audio timeline, the stitched data stream further comprising message data streams that overlap in time periods in the common audio timeline causing more than one message data stream for at least one time period in the stitched data stream;

causing display of the stitched data stream as a continuous data stream that transitions from one message data stream to a next message data stream to a continuous common audio stream;

during display of the stitched data steam, receiving a request for an alternate message data stream in the stitched data stream instead of a currently displayed active message data stream;

determining message data streams of the stitched data stream with a time period in the common audio timeline corresponding to a time period of the active message data stream;

selecting the alternate message data stream from the message data stream with the time period in the common audio timeline corresponding to the time period of the active message data stream; and

causing display of the alternate message data stream, wherein the display of the active message data stream transitions to the alternate message data stream of the stitched data stream in the common audio timeline and at the end of the alternate message data stream the display of the stitched data stream transitions to a next message data stream in the stitched data stream.

13. The server computer of claim 12, wherein selecting the alternate message data stream from the message data streams with the time period in the common audio timeline corresponding to the time period of the active message data stream comprises:

determining a quality score for each message data stream of the message data streams with the time period in the common audio timeline corresponding to the time period of the active message data stream; and

selecting the alternative message data steam from the message data streams with the time period in the common audio timeline corresponding to the time period of the active message data stream based on the quality score for the alternate message data stream.

14. The server computer of claim 13, wherein the quality score is based on at least one of a quality of video or images in the message data stream or an interest score of the message data stream to a plurality of users.

15. The server computer of claim 12, wherein selecting the alternate message data stream from the message data streams with the time period in the common audio timeline corresponding to the time period of the active message data stream further comprises randomly selecting the alternate message data stream from the message data streams with the time period in the common audio timeline corresponding to the time period of the active message data stream.

16. The server computer of claim 12, the operations further comprising:

determining the time period of the active message data stream based on data received in the request for the alternate message data stream.

17. The server computer of claim 12, wherein determining message data streams of the stitched data stream with a time period in the common audio timeline corresponding to a time period of the active message data stream, comprises:

analyzing the message data streams of the stitched data stream to determine which of the message data streams has a time period that overlaps with the time period of the active message data stream.

18. The server computer of claim 12, wherein the common audio timeline is for audio content that is an average of audio associated with the plurality of individual message data streams of the stitched data stream.

19. The server computer of claim 12, wherein the continuous audio stream comprises original audio received in each of the plurality of messages.

20. A non-transitory computer readable medium comprising instructions stored thereon that are executable by at least one processor to cause a computing device to perform operations comprising:

generating a stitched data stream from a plurality of messages received from a plurality of computing devices that are associated with common audio content, the stitched data stream comprising a plurality of individual message data streams from the messages received and associated with a common audio timeline, the stitched data stream further comprising message data streams that overlap in time periods in the common audio timeline causing more than one message data stream for at least one time period in the stitched data stream;

causing display of the stitched data stream as a continuous data stream that transitions from one message data stream to a next message data stream to a continuous common audio stream;

during display of the stitched data steam, receiving a request for an alternate message data stream in the stitched data stream instead of a currently displayed active message data stream;

determining message data streams of the stitched data stream with a time period in the common audio timeline corresponding to a time period of the active message data stream;

selecting the alternate message data stream from the message data streams with the time period in the common audio timeline corresponding to the time period of the active message data stream; and

causing display of the alternate message data stream, wherein the display of the active message data stream device transitions to the alternate message data stream of the stitched data stream in the common audio timeline and at the end of the alternate message data stream the display of the stitched data stream transitions to a next message data stream in the stitched data stream.