ENHANCING A LIVE VIDEO

• US 20180146223A1
• Filed: 11/22/2016
• Published: 05/24/2018
• Est. Priority Date: 11/22/2016
• Status: Abandoned Application

• Current Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Original Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Inventors: Kedenburg, III, George Lewis
• Application Number:
  US15/359,092
• Publication Number:
  US 20180146223A1
• Time in Patent Office: Days
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/23892 involving embedding information at multiplex stream level, e.g. embedding a watermark at packet level
• CPC Class Codes: H04N 21/2407 Monitoring of transmitted content, e.g. distribution time, number of downloads arrangements for monitoring programmes for broadcast or for distribution combined with broadcast H04H20/14
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/437 Interfacing the upstream path of the transmission network, e.g. for transmitting client requests to a VOD server flow control in data networks H04L47/10; streaming protocols, e.g. RTP or RTCP, H04L65/65; scheduling or organising the servicing of application requests in data packet switching networks H04L67/60
• CPC Class Codes: H04N 21/44 Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/44226 on social networks
• CPC Class Codes: H04N 21/4516 involving client characteristics, e.g. Set-Top-Box type, software version or amount of memory available
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• CPC Class Codes: H04N 21/4854 for modifying image parameters, e.g. image brightness, contrast
• CPC Class Codes: H04N 21/632 using a connection between clients on a wide area network, e.g. setting up a peer-to-peer communication via Internet for retrieving video segments from the hard-disk of other client devices broadcast-related systems characterised by transmission among terminal devices H04H60/80; distributed application using peer-to-peer [P2P] networks H04L67/104

Abstract

The present disclosure is directed toward systems and methods for enhancing a live video stream. For example, systems and methods described herein enable a broadcaster to select various settings associated with a live video stream enhancement. Systems and methods described herein apply one or more live video stream enhancements to a live video stream in accordance with the broadcaster'"'"'s settings. Furthermore, systems and methods described herein also automatically delete one or more live video stream enhancements in accordance with one or more of the broadcaster'"'"'s deletion settings.

Claims

1. A method comprising:

detecting a broadcasted live video stream;

identifying one or more video enhancement settings, the one or more video enhancement settings indicating one or more deletion triggers that cause automatic deletion of video enhancement display elements;

embedding, in response to a detected user interaction in accordance with at least one of the one or more video enhancement settings, a video enhancement display element into the broadcasted live video stream;

detecting deletion trigger associated with the video enhancement display element; and

deleting, based on the detected deletion trigger and without user input, the video enhancement display element from the broadcasted live video stream.

2. The method as recited in claim 1, wherein the one or more video enhancement settings further indicate enhancement appearance settings.

3. The method as recited in claim 2, wherein the enhancement appearance settings comprise one or more of color settings, style settings, opacity settings, or user interaction settings.

4. The method as recited in claim 2, wherein the one or more deletion trigger comprise one or more of a time expiration deletion trigger, a motion deletion trigger, or a tracking deletion trigger.

5. The method as recited in claim 1, further comprising, in response to identifying one or more video enhancement settings:

analyzing the broadcasted live video stream to identify an object displayed in the broadcasted live video stream that has a spatial association with the video enhancement display element;

detecting movement associated with the identified object; and

repositioning the video enhancement display element such that the spatial association between the video enhancement display element and the identified object is retained.

6. The method as recited in claim 1, wherein detecting the deletion trigger associated with the video enhancement display element comprises one or more of:

detecting the expiration of a threshold amount of time from when the video enhancement display element was embedded into the broadcasted live video stream;

detecting more than a threshold amount of motion within the broadcasted live video stream;

or

detecting an exit of a tracked object from the broadcasted live video stream.

7. The method as recited in claim 6, further comprising, in response to detecting a re-appearance of a tracked object into the broadcasted live video stream, re-embedding the video enhancement display element into the broadcasted live video stream.

8. The method as recited in claim 1, wherein deleting the video enhancement display element comprises progressively deleting line segments associated with the video enhancement display element.

9. A system comprising:

at least one processor; and

at least one non-transitory computer-readable storage medium storing instructions thereon that, when executed by the at least one processor, cause the system to;

detect a broadcasted live video stream;

identify one or more video enhancement settings, the one or more video enhancement setting indicating one or more deletion triggers that cause automatic deletion of video enhancement display elements;

embed, in response to a detected user interaction in accordance with at least one of the one or more video enhancement settings, a video enhancement display element into the broadcasted live video stream;

detect a deletion trigger associated with the video enhancement display element; and

delete, based on the detected deletion trigger and without user input, the video enhancement display element from the broadcasted live video stream.

10. The system as recited in claim 9, wherein the one or more video enhancement settings further indicate enhancement appearance settings.

11. The system as recited in claim 10, wherein the enhancement appearance settings comprise one or more of color settings, style settings, opacity settings, or user interaction settings.

12. The system as recited in claim 11, wherein the deletion triggers comprise one or more of a time expiration deletion trigger, a motion deletion trigger, or a tracking deletion trigger.

13. The system as recited in claim 12, further comprising instructions thereon that, when executed by the at least one processor, cause the system to, in response to identifying one or more video enhancement settings:

analyze the broadcasted live video stream to identify an object displayed in the broadcasted live video stream that is has a spatially association with the video enhancement display element;

detect movement associated with the identified object;

reposition the video enhancement display element such that the spatially association between the video enhancement display element and the identified object is retained.

14. The system as recited in claim 13, wherein the instructions thereon, when executed by the at least one processor, cause the system to detect the deletion trigger associated with the video enhancement display element by performing one or more of:

detecting the expiration of a threshold amount of time from when the video enhancement display element was embedded into the broadcasted live video stream;

detecting more than a threshold amount of motion within the broadcasted live video stream;

or

detecting the exit of a tracked object from the broadcasted live video stream.

15. The system as recited in claim 14, further comprising instructions thereon that, when executed by the at least one processor, cause the system to, in response to detecting a re-appearance of a tracked object into the broadcasted live video stream, re-embed the video enhancement display element into the broadcasted live video stream.

16. The system as recited in claim 15, wherein the instructions thereon, when executed by the at least one processor, cause the system to delete the video enhancement display element by progressively deleting line segments associated with the video enhancement display element.

17. A non-transitory computer-readable medium storing instructions thereon that, when executed by at least one processor, cause a computer system to:

detect a broadcasted live video stream;

identify one or more video enhancement settings, the one or more video enhancement settings indicating one or more deletion triggers that cause automatic deletion of video enhancement display elements;

embed, in response to a detected user interaction in accordance with at least one of the one or more video enhancement settings, a video enhancement display element into the broadcasted live video stream;

detect a deletion trigger associated with the video enhancement display element; and

delete, based on the detected deletion trigger and without user input, the video enhancement display element from the broadcasted live video stream.

18. The non-transitory computer-readable medium as recited in claim 17, wherein the one or more video enhancement settings further indicate enhancement appearance settings.

19. The non-transitory computer-readable medium as recited in claim 18, wherein the enhancement appearance settings comprise one or more of color settings, style settings, opacity settings, or user interaction settings.

20. The non-transitory computer-readable medium as recited in claim 19, wherein the deletion triggers comprise one or more of a time expiration deletion trigger, a motion deletion trigger, or a tracking deletion trigger.