CREATION OF VIRTUAL CAMERAS FOR VIEWING REAL-TIME EVENTS

• US 20170094326A1
• Filed: 09/30/2015
• Published: 03/30/2017
• Est. Priority Date: 09/30/2015
• Status: Active Grant

• Current Assignee: Kevin Kumar Arimilli, Nathan Dhilan Arimilli, Shivani Kumar Arimilli
• Original Assignee: Nathan Dhilan Arimilli, Shivani Kumar Arimilli
• Inventors: ARIMILLI, NATHAN DHILAN, ARIMILLI, KEVIN KUMAR, ARIMILLI, SHIVANI KUMAR
• Granted Patent: US 10,419,788 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: H04N 21/21805 enabling multiple viewpoints, e.g. using a plurality of cameras
• CPC Class Codes: H04N 21/23439 for generating different versions
• CPC Class Codes: H04N 21/2393 involving handling client requests scheduling or organising the servicing of application requests H04L67/60
• CPC Class Codes: H04N 21/47202 for requesting content on demand, e.g. video on demand
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 21/816 involving special video data, e.g 3D video
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content

Abstract

A video processing system receives a custom view request specifying a virtual camera perspective from which a dynamic scene in a physical environment is to be viewed. The video processing system generates a custom view of the scene from the virtual camera perspective, where generating the custom view includes generating the custom view based on both video content captured by one or more physical cameras and a dynamic three dimensional scene model of the scene residing within data storage. The video processing system records the custom view within on-demand video content and transmits the on-demand video content to a video presentation system.

Claims

1. A method of video processing in a video processing system, the method comprising:

the video processing system receiving a custom view request specifying a virtual camera perspective from which a dynamic scene in a physical environment is to be viewed;

the video processing system generating a custom view of the dynamic scene from the virtual camera perspective, wherein generating the custom view from the virtual camera perspective includes generating the custom view by blending both video content captured by one or more physical cameras and video content from the virtual camera perspective generated from a dynamic three dimensional scene model of the dynamic scene residing within data storage;

the video processing system recording the custom view within on-demand video content; and

the video processing system transmitting the on-demand video content to a video presentation system.

2. The method of claim 1, wherein generating the custom view includes generating the custom view in substantially real time.

3. The method of claim 1, wherein generating the custom view includes generating the custom view in response to the custom view request.

4. The method of claim 1, and further comprising building the three dimensional scene model within the data storage by processing video content captured by the one or more physical cameras.

5. The method of claim 1, wherein the transmitting the on-demand video content comprises transmitting the on-demand video content interspersed within a transmission of a video program depicting the scene.

6. The method of claim 1, wherein the generating includes preferentially filling a video frame with image content captured by the one or more physical camera(s) and filling a coverage gap in the image content captured by the one or more physical camera(s) with image data from the scene model.

7. The method of claim 1, wherein:

the three dimensional scene model comprises a plurality of different states each corresponding to a respective one of a plurality of different chronological times;

the custom view request further includes a timing indication; and

the video processing system generates the custom view based upon a particular one of the plurality of different states of the three dimensional scene model corresponding to the timing indication.

8. A program product for video processing, the program product comprising:

a data storage device; and

program code stored within the data storage device, wherein the program code, when executed by a processor of a video processing system, causes the video processing system to perform;

the video processing system receiving a custom view request specifying a virtual camera perspective from which a dynamic scene in a physical environment is to be viewed;

the video processing system generating a custom view of the dynamic scene from the virtual camera perspective, wherein generating the custom view from the virtual camera perspective includes generating the custom view by blending both video content captured by one or more physical cameras and video content from the virtual camera perspective generated from a dynamic three dimensional scene model of the dynamic scene residing within data storage;

the video processing system recording the custom view within on-demand video content; and

the video processing system transmitting the on-demand video content to a video presentation system.

9. The program product of claim 8, wherein generating the custom view includes generating the custom view in substantially real time.

10. The program product of claim 8, wherein generating the custom view includes generating the custom view in response to the custom view request.

11. The program product of claim 8, wherein the program code, when executed, further causes the video processing system to perform building the three dimensional scene model within the data storage by processing video content captured by the one or more physical cameras.

12. The program product of claim 8, wherein the transmitting the on-demand video content comprises transmitting the on-demand video content interspersed within a transmission of a video program depicting the scene.

13. The program product of claim 8, wherein the generating includes preferentially filling a video frame with image content captured by the one or more physical camera(s) and filling a coverage gap in the image content captured by the one or more physical camera(s) with image data from the scene model.

14. The program product of claim 8, wherein:

the three dimensional scene model comprises a plurality of different states each corresponding to a respective one of a plurality of different chronological times;

the custom view request further includes a timing indication; and

the program code, when executed, further causes the video processing system to generate the custom view based upon a particular one of the plurality of different states of the three dimensional scene model corresponding to the timing indication.

15. A video processing system, the video processing system comprising:

a processor;

data storage communicatively coupled to the processor; and

program code stored within the data storage, wherein the program code, when executed by the processor, causes the video processing system to perform;

the video processing system receiving a custom view request specifying a virtual camera perspective from which a dynamic scene in a physical environment is to be viewed;

the video processing system generating a custom view of the dynamic scene from the virtual camera perspective, wherein generating the custom view from the virtual camera perspective includes generating the custom view by blending both video content captured by one or more physical cameras and video content from the virtual camera perspective generated from a dynamic three dimensional scene model of the dynamic scene residing within data storage;

the video processing system recording the custom view within on-demand video content; and

the video processing system transmitting the on-demand video content to a video presentation system.

16. The video processing system of claim 15, wherein generating the custom view includes generating the custom view in substantially real time.

17. The video processing system of claim 15, wherein generating the custom view includes generating the custom view in response to the custom view request.

18. The video processing system of claim 15, wherein the program code, when executed, further causes the video processing system to perform building the three dimensional scene model within the data storage by processing video content captured by the one or more physical cameras.

19. The video processing system of claim 15, wherein the transmitting the on-demand video content comprises transmitting the on-demand video content interspersed within a transmission of a video program depicting the scene.

20. The video processing system of claim 15, wherein the generating includes preferentially filling a video frame with image content captured by the one or more physical camera(s) and filling a coverage gap in the image content captured by the one or more physical camera(s) with image data from the scene model.

21. The video processing system of claim 15, wherein:

the three dimensional scene model comprises a plurality of different states each corresponding to a respective one of a plurality of different chronological times;

the custom view request further includes a timing indication; and

the program code, when executed, further causes the video processing system to generate the custom view based upon a particular one of the plurality of different states of the three dimensional scene model corresponding to the timing indication.