REMOTE CLOUD-BASED VIDEO PRODUCTION SYSTEM IN AN ENVIRONMENT WHERE THERE IS NETWORK DELAY

• US 20190313163A1
• Filed: 03/29/2019
• Published: 10/10/2019
• Est. Priority Date: 04/05/2018
• Status: Active Grant

• Current Assignee: TVU Networks Corporation
• Original Assignee: TVU Networks Corporation
• Inventors: Shen, Paul
• Granted Patent: US 10,966,001 B2
• Time in Patent Office: Days
• CPC Class Codes: H04N 21/21805 enabling multiple viewpoints, e.g. using a plurality of cameras
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/23406 involving management of server-side video buffer
• CPC Class Codes: H04N 21/242 Synchronization processes, e.g. processing of PCR [Program Clock References] arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18
• CPC Class Codes: H04N 21/2665 Gathering content from different sources, e.g. Internet and satellite
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• CPC Class Codes: H04N 21/64322 IP
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content
• CPC Class Codes: H04N 5/222 Studio circuitry; Studio devices; Studio equipment cameras or camera modules comprising electronic image sensors, or control thereof H04N23/00

Abstract

A cloud-based video production system, methods, and apparatus are provided. Video sources are in communication with a cloud-based video production server and a remote user interface via a network. A control unit, which is located at or in communication with video production server, is in communication with the remote user interface. A buffer, corresponding to each of the video sources, is disposed between each of the video sources and the control unit to account for network delays. Commands for selecting and manipulating video content from the video sources are sent from the user interface to the control unit, each of the commands containing a command timestamp corresponding to the video timestamp of the video frame displayed on the user interface when the command is issued. The control unit executes each command at a time when the video timestamp at an output of the corresponding buffer corresponds to the command timestamp. The control unit outputs a video program in accordance with the commands.

Claims

1. A cloud-based video production system, comprising:

a cloud-based video production server;

a remote user interface running on a user device;

one or more video sources in communication with the cloud-based video production server and the remote user interface via a network;

a control unit, located at or in communication with the cloud-based video production server, in communication with the remote user interface via the network; and

a buffer, corresponding to each of the one or more video sources, disposed between each of the one or more video sources and the control unit to account for network delays;

wherein;

each frame of video content is provided with a video timestamp;

commands for selecting and manipulating video content from the one or more video sources are sent from the user interface to the control unit, each of the commands containing a command timestamp corresponding to the video timestamp of the video frame displayed on the user interface when the command is issued;

the control unit executes each command at a time when the video timestamp at an output of the corresponding buffer corresponds to the command timestamp; and

the control unit outputs a video program in accordance with the commands.

2. A cloud-based video production system in accordance with claim 1, wherein the user interface comprises one of an application or a web browser running on an Internet-enabled device.

3. A cloud-based video production system in accordance with claim 1, wherein the user device comprises one of a computer, a laptop computer, a portable computer, a tablet computer, a smart phone, a smart watch, a personal computing device, and an Internet-enabled device.

4. A cloud-based video production system in accordance with claim 1, wherein the content from the one or more video sources is viewable on the user interface.

5. A cloud-based video production system in accordance with claim 1, wherein the commands comprise commands for selecting from among the video content or portions of the video content provided by the one or more video sources, commands for combining the video content or portions of the video content, commands for switching between the one or more video sources, commands for manipulating the video content or portions of the video content, commands for providing a graphics overlay, commands for turning on or off the graphics overlay, and commands for adjusting an audio level for the video content or the portions of the video content.

6. A cloud-based video production system in accordance with claim 1, wherein each of the one or more video sources comprises one of a video camera, a camcorder, a television camera, a movie camera, a portable electronic device, a tablet computer, a smart phone, and an IP or web camera.

7. A cloud-based video production system in accordance with claim 1, wherein the video program is output for at least one of live broadcast, distribution to one or more social media platforms, and distribution to a digital media distribution platform.

8. A cloud-based video production system in accordance with claim 1, wherein:

the video program is downloaded to the user device;

the downloaded video program is one of distributed to media outlets or social media platforms in an original downloaded form, or modified at the user device prior to such distribution.

9. A cloud-based video production system in accordance with claim 1, the video program comprises one of a news program, a sports program, a weather program, a live event program, and an entertainment program.

10. A cloud-based video production system in accordance with claim 1, wherein the corresponding buffer delays the video content to account for network delay in carrying out the commands.

11. A cloud-based video production system in accordance with claim 1, wherein:

instructions for the commands are sent via an API; and

the instructions are scriptable.

12. A method for cloud-based video production, comprising:

providing a cloud-based video production server;

providing a remote user interface running on a user device;

providing video content from one or more video sources to the cloud-based video production server and the remote user interface via a network;

providing a control unit located at or in communication with the cloud-based video production server which is in communication with the remote user interface via the network; and

buffering the video content via a corresponding buffer for each of the one or more video sources, the corresponding buffer being disposed between each of the one or more video sources and the control unit to account for network delays;

providing each frame of video content with a video timestamp;

sending commands from the user interface to the control unit for selecting and manipulating video content from the one or more video sources, each of the commands containing a command timestamp corresponding to the video timestamp of the video frame displayed on the user interface when the command is issued;

executing each command at the control unit at a time when the video timestamp at an output of the corresponding buffer corresponds to the command timestamp; and

outputting a video program in accordance with the commands.

13. A method in accordance with claim 12, wherein the user interface comprises one of an application or a web browser running on an Internet-enabled device.

14. A method in accordance with claim 12, wherein the user device comprises one of a computer, a laptop computer, a portable computer, a tablet computer, a smart phone, a smart watch, a personal computing device, and an Internet-enabled device.

15. A method in accordance with claim 12, wherein the content from the one or more video sources is viewable on the user interface.

16. A method in accordance with claim 12, wherein the commands comprise commands for selecting from among the video content or portions of the video content provided by the one or more video sources, commands for combining the video content or portions of the video content, commands for switching between the one or more video sources, commands for manipulating the video content or portions of the video content, commands for providing a graphics overlay, commands for turning on or off the graphics overlay, and commands for adjusting an audio level for the video content or the portions of the video content.

17. A method in accordance with claim 12, wherein each of the one or more video sources comprises one of a video camera, a camcorder, a television camera, a movie camera, a portable electronic device, a tablet computer, a smart phone, and an IP or web camera.

18. A method in accordance with claim 12, wherein the video program is output for at least one of live broadcast, distribution to one or more social media platforms, and distribution to a digital media distribution platform.

19. A method in accordance with claim 12, further comprising:

downloading the video program to the user device; and

one of distributing the downloaded video program to media outlets or social media platforms in an original downloaded form, and modifying the downloaded video program at the user device prior to such distribution.

20. A method in accordance with claim 12, the video program comprises one of a news program, a sports program, a weather program, a live event program, and an entertainment program.

21. A method in accordance with claim 12, wherein the corresponding buffer delays the video content to account for network delay in carrying out the commands.

22. A method in accordance with claim 12, wherein:

instructions for the commands are sent via an API; and

the instructions are scriptable.