REAL-TIME ANALYTICS, COLLABORATION, FROM MULTIPLE VIDEO SOURCES

• US 20150082203A1
• Filed: 07/08/2014
• Published: 03/19/2015
• Est. Priority Date: 07/08/2013
• Status: Abandoned Application

• Current Assignee: Truestream, LLC
• Original Assignee: Truestream Kabushiki Kaisha
• Inventors: James, Paul Daniel, Milliken, Arthur Wayne, Kinnear, Robert Jack Jr., Hooker, Robert Perry
• Application Number:
  US14/326,297
• Publication Number:
  US 20150082203A1
• Time in Patent Office: Days
• US Class Current: 715/756
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/23424 involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02

Abstract

A system is engineered to analyze, process, and manipulate streaming content in real time including analyzing, interacting with, and embedding streaming video images based on the content of the images or on collaborative interactions and information. Among many, many examples, one can create advertisements dynamically overlaid within live video based upon characteristics within the live video, as well as have the ability to interact with live video in a social network. Various other examples include, among others, advertising, security analysis, and live special effects. The system performs analytics of data as it is collected to determine features and patterns in the data and use the resulting analysis to alter the streaming content as it occurs.

Claims

1. A system comprising:

multiple video feeds, the hardware structures of which are suitable for sourcing streaming content;

pieces of real-time processing hardware, the hardware structures of which are capable of processing streaming content during a streaming process and not as a post-processing step on stored data; and

pieces of real-time collaboration hardware, the hardware structures of which have the capacity to facilitate social interactions resulting in modifications to the streaming content.

2. The system of claim 1, wherein the pieces of real-time processing hardware include real-time analytics hardware, the hardware structure of which is capable of performing analytics on the multiple video feeds to find meaningful patterns from which knowledge about the streaming content is formed.

3. The system of claim 2, wherein the pieces of real-time processing hardware include real-time manipulation hardware, the hardware structure of which is suitable for facilitating modification of the streaming content including the capability to add to or replace content.

4. The system of claim 3, further comprising command controller hardware, the hardware structure of which is capable of parsing commands from data and feeding them back to the real-time analytics hardware and the real-time manipulation hardware.

5. The system of claim 4, further comprising streaming hardware, the hardware structure of which is suitable for generating the streaming content for broadcasting or recording or for collaboration.

6. A method comprising:

receiving multiple video feeds in the form of streaming content;

real-time processing of streaming content during a streaming process and not as a post-processing step on stored data; and

facilitating real-time social collaborations resulting in modifications to the streaming content.

7. The method of claim 6, wherein real-time processing includes performing real-time analytics on the streaming content selected from a group consisting essentially of facial recognition, object detection, edge detection, background detection, foreground detection, statistical frequency calculation, color detection, predictive extrapolation, and video frame change.

8. The method of claim 7, wherein real-time processing includes performing real-time manipulation on the streaming content selected from a group consisting essentially of embedding shapes, embedding text, insertion of an advertisement, user interaction, chat, provenance labeling, reconstitution, social media integration, security analysis, live special effects, alternative source selection, and same source selection.

9. The method of claim 8, wherein real-time processing includes performing real-time analytics on the streaming content to determine patterns in the streaming content and use the patterns to perform real-time manipulation by altering the streaming content as it occurs.

10. The method of claim 7, wherein performing real-time analytics includes representing pixels in the streaming content as a digital elevation model which is displayed in a continuous three-dimensional model of one of the multiple video feeds involving no storage to pre-process the streaming content.

11. The method of claim 9, wherein facilitating real-time social collaborations is selected from a group consisting essentially of logging into a social network web site to interact with the streaming content, interacting on the streaming content between known parties or unknown parties, drawing on the streaming content, locating embedded content to avoid disrupting a chat dialog window in the streaming content, and bringing multiple observers to a same instance of the streaming content.

12. The method of claim 8, providing a feedback loop to couple real-time social collaborations with performing real-time analytics and performing real-time manipulation to facilitate ongoing inclusion of time-based analytics or trending analytics.

13. The method of claim 8, further comprising performing real-time analytics to object-recognize a basketball, generating a heat map of areas where the basketball is spending most of its time on a court, and performing real-time manipulation by embedding an advertisement on the court where the basketball is likely to occur without obscuring basketball players or the basketball.

14. The method of claim 8, further comprising performing real-time analytics to facially recognize security patrols and ignore a video feed containing security patrols and perform background detection, foreground detection, and change in a video frame to identify suspect video feeds, as well as facilitate real-time social collaborations to review the suspect video feeds.

15. The method of claim 8, further comprising performing real-time analytics to object-recognize together with predictive extrapolation to identify a sports subject that is likely to win, and performing real-time manipulation to place an advertisement video instead of an advertisement image proximate to the sports subject that is likely to win.

16. The method of claim 8, further comprising performing real-time analytics to object-recognize a boom microphone while filming video contents and performing real-time manipulation to remove the boom microphone.

17. The method of claim 8, further comprising performing real-time analytics for an augmented reality system to facially recognize people.

18. The method of claim 8, further comprising performing real-time manipulation to add the GPS location of a guard and performing real-time analytics to identify movement in a location near the GPS location of the guard.

19. The method of claim 8, further comprising performing real-time analytics on a microblogging service to educe negative public sentiment within proximity to police officers in the streaming content.

20. A computer-readable medium, which is non-transitory, having computer-executable instructions stored thereon to implement a method, comprising:

receiving multiple video feeds in the form of streaming content;

real-time processing streaming content during a streaming process and not as a post-processing step on stored data; and

facilitating real-time social collaborations resulting in modifications to the streaming content.