GENERATING A STITCHED DATA STREAM

• US 20180278562A1
• Filed: 03/27/2017
• Published: 09/27/2018
• Est. Priority Date: 03/27/2017
• Status: Active Grant

• Current Assignee: Snap, Inc.
• Original Assignee: Snap, Inc.
• Inventors: Tang, Kevin Dechau
• Granted Patent: US 10,581,782 B2
• Time in Patent Office: Days
• CPC Class Codes: H04L 51/10 Multimedia information
• CPC Class Codes: H04L 51/216 Handling conversation history, e.g. grouping of messages in sessions or threads
• CPC Class Codes: H04L 51/222 using geographical location information, e.g. messages transmitted or received in proximity of a certain spot or area
• CPC Class Codes: H04L 51/52 for supporting social networking services
• CPC Class Codes: H04L 63/107 wherein the security policies are location-dependent, e.g. entities privileges depend on current location or allowing specific operations only from locally connected terminals
• CPC Class Codes: H04L 65/61 for supporting one-way streaming services, e.g. Internet radio
• CPC Class Codes: H04L 65/765 intermediate
• CPC Class Codes: H04N 21/2743 Video hosting of uploaded data from client
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/4524 involving the geographical location of the client retrieval from the Internet by querying based on geographical locations G06F16/9537; systems specially adapted for using geographical information in broadcast systems H04H60/70; protocols in which the network application is adapted for the location of the user terminal in communication control or processing H04L67/52; services making use of the location of users or terminals in wireless networks H04W4/02; locating users or terminals in wireless networks H04W64/00
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104

Abstract

Systems and methods provide for a server computer to receive a plurality of messages from a plurality of user computing devices, each message of the plurality of messages comprising a data stream, determine a subset of messages of the plurality of messages associated with a similar geolocation and time period, determine a set of messages of the subset of messages based on a match score for each pair of messages, and stitch together the set of messages to generate a stitched data stream from the data streams for each message of the set of messages based on a time period for each message, wherein the stitched data stream comprises messages with data streams that overlap in time periods such that there may be more than one data stream for a given time period.

Claims

1. A method comprising:

receiving, at a server computer, a plurality of messages from a plurality of user computing devices, each message of the plurality of messages comprising a data stream;

determining, by the server computer, a subset of messages of the plurality of messages associated with a similar geolocation and time period;

extracting, by the server computer, an audio fingerprint for each message in the subset of messages;

grouping, by the server computer, the subset of messages into a plurality of pairs of messages, each pair of messages comprising a first message and a second message;

comparing, by the server computer, audio fingerprints of the first message and the second message in each pair of messages to determine a match score for each pair of messages;

determining, by the server computer, a set of messages of the subset of messages associated with a common audio timeline based on the match score for each pair of messages;

stitching together, by the server computer, the set of messages to generate a stitched data stream from the data streams for each message of the set of messages based on a time period for each message;

wherein the stitched data stream comprises messages with data streams that overlap in time periods such that there may be more than one data stream for a given time period; and

providing, by the server computer, the stitched data stream to one or more user computing devices.

2. The method of claim 1, wherein determining a subset of messages of the plurality of messages associated with a similar geolocation comprises determining that a geolocation for each of the subset of messages is associated with the same predetermined region of global positioning system (GPS) coordinates.

3. The method of claim 1, further comprising:

determining a start message that is a message occurring first in the common audio timeline; and

wherein the set of messages are stitched together starting with the start message.

4. The method of claim 3, wherein determining the start message that is the message occurring first in a timeline for the subset of messages comprises selecting the start message from a plurality of messages with similar periods of time in the timeline based on a quality score.

5. The method of claim 3, wherein determining the start message that is the message occurring first in a timeline for the subset of messages comprises randomly selecting the start message from a plurality of messages with similar periods of time in the timeline.

6. The method of claim 1, wherein the stitched data stream comprises messages that are prioritized based on a quality score for an order of display in the timeline.

7. The method of claim 1, wherein the stitched data stream comprises messages that are prioritized based on a random selection for an order of display in the timeline.

8. The method of claim 1, wherein audio associated with the stitched data stream comprises audio that is an average of audio associated with each data stream in the stitched data stream.

9. A server computer comprising:

a processor; and

a computer readable medium coupled with the processor, the computer readable medium comprising instructions stored thereon that are executable by the processor to cause a computing device to perform operations comprising;

receiving a plurality of messages from a plurality of user computing devices, each message of the plurality of messages comprising a data stream;

determining a subset of messages of the plurality of messages associated with a similar geolocation and time period;

extracting an audio fingerprint for each message in the subset of messages;

grouping the subset of messages into a plurality of pairs of messages, each pair of messages comprising a first message and a second message;

comparing audio fingerprints of the first message and the second message in each pair of messages to determine a match score for each pair of messages;

determining a set of messages of the subset of messages associated with a common audio timeline based on the match score for each pair of messages;

stitching together the set of messages to generate a stitched data stream from the data streams for each message of the set of messages based on a time period for each message;

wherein the stitched data stream comprises messages with data streams that overlap in time periods such that there may be more than one data stream for a given time period; and

providing the stitched data stream to one or more user computing devices.

10. The server computer of claim 9, wherein determining the subset of messages of the plurality of messages associated with the similar geolocation comprises determining that a geolocation for each of the subset of messages is associated with the same predetermined region of global positioning system (GPS) coordinates.

11. The server computer of claim 9, the operations further comprising:

determining a start message that is a message occurring first in the common audio timeline; and

wherein the set of messages are stitched together starting with the start message.

12. The server computer of claim 11, wherein determining the start message that is the message occurring first in a timeline for the subset of messages comprises selecting the start message from a plurality of messages with similar periods of time in the timeline based on a quality score.

13. The server computer of claim 11, wherein determining a start message that is a message occurring first in a timeline for the subset of messages comprises randomly selecting the start message from a plurality of messages with similar periods of time in the timeline.

14. The server computer of claim 9, wherein the stitched data stream comprises messages that are prioritized based on a quality score for an order of display in the timeline.

15. The server computer of claim 9, wherein the stitched data stream comprises messages that are prioritized based on a random selection for an order of display in the timeline.

16. The server computer of claim 9, wherein audio associated with the stitched data stream comprises audio that is an average of audio associated with each data stream in the stitched data stream.

17. A non-transitory computer readable medium comprising instructions stored thereon that are executable by at least one processor to cause a computing device to perform operations comprising:

receiving a plurality of messages from a plurality of user computing devices, each message of the plurality of messages comprising a data stream;

determining a subset of messages of the plurality of messages associated with a similar geolocation and time period;

extracting an audio fingerprint for each message in the subset of messages;

grouping the subset of messages into a plurality of pairs of messages, each pair of messages comprising a first message and a second message;

comparing audio fingerprints of the first message and the second message in each pair of messages to determine a match score for each pair of messages;

determining a set of messages of the subset of messages associated with a common audio timeline based on the match score for each pair of messages;

stitching together the set of messages to generate a stitched data stream from the data streams for each message of the set of messages based on a time period for each message;

wherein the stitched data stream comprises messages with data streams that overlap in time periods such that there may be more than one data stream for a given time period; and

providing the stitched data stream to one or more user computing devices.

18. The non-transitory computer readable medium of claim 17, the operations further comprising:

determining a start message that is a message occurring first in the common audio timeline; and

wherein the set of messages are stitched together starting with the start message.

19. The non-transitory computer readable medium of claim 18, wherein determining the start message that is the message occurring first in a timeline for the subset of messages comprises selecting the start message from a plurality of messages with similar periods of time in the timeline based on a quality score.

20. The non-transitory computer readable medium of claim 18, wherein determining the start message that is the message occurring first in a timeline for the subset of messages comprises randomly selecting the start message from a plurality of messages with similar periods of time in the timeline.