Method and system for aggregating content streams based on sensor data

• US 10,574,715 B2
• Filed: 08/03/2017
• Issued: 02/25/2020
• Est. Priority Date: 08/03/2017
• Status: Active Grant

• Current Assignee: Streaming Global, Inc.
• Original Assignee: Streaming Global, Inc.
• Inventors: Oesterreicher, Richard, Hessing, Jonathan, Ukani, Zunair, Schmidt, Austin
• Primary Examiner(s): Fiorillo, James N
• Application Number:
  US15/668,540
• Publication Number:
  US 20190044988A1
• Time in Patent Office: 936 Days
• Field of Search: 709203, 709217, 709231
• CPC Class Codes: H04L 51/52 for supporting social networking services
• CPC Class Codes: H04L 65/1069 Session establishment or de-establishment
• CPC Class Codes: H04L 65/611 for multicast or broadcast systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/25841 involving the geographical location of the client retrieval from the Internet by querying based on geographical locations G06F16/9537; arrangements for identifying locations of receiving stations in broadcast systems H04H60/51; location of the user terminal in data switching networks H04L67/52; services making use of the location of users or terminals in wireless networks H04W4/02; locating users or terminals in wireless networks H04W64/00
• CPC Class Codes: H04N 21/2668 Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063
• CPC Class Codes: H04N 21/2743 Video hosting of uploaded data from client
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104

Abstract

Disclosed is a method of aggregating content streams. The method may include receiving, using a communication unit, a plurality of content streams from a plurality of mobile devices. Further, each of the plurality of mobile devices may include at least one recorder configured to generate a content stream. Furthermore, each of the plurality of content streams may be associated with at least one metadata. Additionally, the method may include analyzing, using a processing unit, the at least one metadata. Further, the method may include aggregating, using the processing unit, the plurality of content streams into an aggregated content stream container based on a result of the analyzing.

Claims

1. A method for organizing a plurality of content streams, the method comprising:

receiving the plurality of content streams and a metadata associated with each of the plurality of content streams;

analyzing the metadata associated with each of the plurality of content streams for at least one of the following;

geo-location data in order to determine which of the plurality of content streams comprise content captured in spatial proximity, and

timing data in order to determine which of the plurality of content streams comprise content captured in temporal proximity

grouping at least two content streams of the plurality of content streams based on the analyzed metadata associated with each content stream when at least one of the following occur;

the at least two content streams are determined to be captured in the spatial proximity,

the at least two content streams are determined to be captured in the temporal proximity;

analyzing the metadata associated with each of the at least two content streams for orientation data in order to determine a point of view associated with each of the at least two content streams, wherein a statistical analysis of the metadata is employed to derive statistical data for each of the at least two content streams;

establishing a multiple stream container for aggregating the at least two content streams, and

arranging the presentation of the grouped content streams based on the analyzed metadata for layout within the multiple stream container, wherein;

the presentation comprises displaying a visual representation of the at least two content streams within the multiple stream container, and includes the statistical data associated with the aggregated content streams in the multiple screen container; and

the visual representation for each content stream is based on the metadata associated with each content stream, the metadata comprising the orientation data.

2. The method of claim 1, wherein establishing the multiple stream container comprises:

receiving information associated with a criteria for content streams to be placed into the multiple stream container.

3. The method of claim 2, further comprising:

comparing the criteria to data points within the metadata associated with each content stream, and

adding, into the multiple stream container, each content stream that meets the criteria into the content stream.

4. The method of claim 2, wherein analyzing the metadata associated with each of the plurality of content streams for the timing data comprises matching the timing data with the criteria established for the multiple stream container.

5. The method of claim 2, wherein analyzing the metadata associated with each of the plurality of content streams for the geo-location data comprises matching the geo-location data with the criteria established for the multiple stream container.

6. The method of claim 1, wherein analyzing the metadata associated with each of the plurality of content streams further comprises at least one of the following:

employing the statistical analysis based on analyzing the metadata to determine a frequency of content captured in at least one of the following, the spatial proximity, and the temporal proximity; and

deriving statistical data based on the statistical analysis.

7. The method of claim 6, further comprising:

presenting the multiple stream container; and

presenting the statistical data associated with the aggregated content streams in the multiple stream container.

8. The method of claim 6, further comprising:

presenting the multiple stream container; and

presenting data associated with the event in the proximal space and time.

9. The method of claim 1, wherein establishing the multiple stream container comprises:

labeling each aggregated content streams within the multiple stream container, wherein labeling the content within the multiple stream container comprises employing at least one identifier associated with computing devices used to capture the content.

10. The method of claim 9, wherein employing the at least one identifier in labeling the multiple stream container comprises employing at least one of the following:

participant name, account ID, device ID,

a location of capture associated with each content stream,

a time of capture associated with each content stream,

orientation data associated with each content stream, and

statistical data associated with each content stream.

11. The method of claim 10, wherein labeling the content streams is configured to enable indexing, searching, and discovery of each content stream based on, at least in part, the identifiers.

12. The method of claim 1, wherein establishing the multiple stream container comprises establishing the multiple stream container prior to receiving content into the multiple stream container.

13. The method of claim 1, wherein establishing the multiple stream container comprises establishing the multiple stream container after receiving content for the multiple stream container.

14. The method of claim 1, wherein analyzing the metadata associated with each of the plurality of content streams for the timing data comprises determining which of the plurality of content streams were captured at a moment of interest.

15. The method of claim 1, wherein analyzing the metadata associated with each of the plurality of content streams for the geo-location data comprises determining which of the plurality of content streams were captured at a location of interest.

16. The method of claim 1, further comprising:

determining that the content streams comprising content captured in the spatial proximity and the temporal proximity correspond to an event in proximal space and time.