System and method for processing digital video

• US 10,297,086 B2
• Filed: 01/24/2017
• Issued: 05/21/2019
• Est. Priority Date: 07/04/2016
• Status: Active Grant

• Current Assignee: Liquid Cinema Inc.
• Original Assignee: Liquid Cinema Inc.
• Inventors: Wallner, Thomas, Hildgen, Franz
• Primary Examiner(s): Chen, Frank S
• Application Number:
  US15/414,073
• Publication Number:
  US 20180005449A1
• Time in Patent Office: 847 Days
• Field of Search: None
• CPC Class Codes: G06T 15/04 Texture mapping
• CPC Class Codes: G06T 15/205 Image-based rendering
• CPC Class Codes: G06T 17/20 Finite element generation, e.g. wire-frame surface description, tesselation
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2210/22 Cropping

Abstract

A computer-implemented method of displaying frames of digital video is provided. The method includes processing contents in one or more predetermined regions of the frames to detect predetermined non-image data. In the event that the predetermined non-image data is undetected within the one or more predetermined regions of a particular frame being processed, subjecting the particular frame to a predetermined texture-mapping onto a predetermined geometry and displaying the texture-mapped frame; and otherwise subjecting the particular frame to cropping to remove the non-image data, flat-projecting the cropped frame and displaying the flat-projected cropped frame. A computer-implemented method of processing digital video is also provided. The method includes causing frames of the digital video to be displayed; for a period beginning prior to an estimated time of display of an event-triggering frame: processing contents in one or more predetermined regions of the frames to detect predetermined non-image data therefrom. In the event that the predetermined non-image data is undetected within the one or more predetermined regions in a particular frame being processed, deeming the particular frame to be the event-triggering frame and executing one or more events associated with the event-triggering frame at the time of display of the event-triggering frame.

Claims

1. A computer-implemented method of displaying frames of digital video, the method comprising:

processing contents in one or more predetermined image data regions of the frames to detect any non-image data of a predetermined format;

in the event that no non-image data of the predetermined format is detected within the one or more predetermined regions of a particular frame being processed, subjecting the particular frame to a predetermined texture-mapping onto a predetermined geometry and displaying the texture-mapped frame; and

otherwise;

subjecting the particular frame to cropping to remove detected non-image data of the predetermined format, flat-projecting the cropped frame and displaying the flat-projected cropped frame.

2. The computer-implemented method of claim 1, wherein the predetermined geometry is a spherical mesh.

3. The computer-implemented method of claim 1, wherein the predetermined format is a predetermined frame identifier format, wherein each of at least one frame identifier uniquely identifies a respective frame.

4. The computer-implemented method of claim 3, further comprising:

determining a metadata file associated with the digital video;

identifying any events associated in the metadata file with the at least one frame identifier; and

for each of the plurality of frames of the digital video, while causing the frame to be displayed;

executing, in accordance with event parameters stored in the metadata file, each of any events that is/are associated in the metadata file with the frame identifier for the frame.

5. A computer-implemented method of processing digital video, the method comprising:

causing frames of the digital video to be displayed;

for a period beginning prior to an estimated time of display of an event-triggering frame;

processing contents in one or more predetermined image data regions of the frames to detect any non-image data of a predetermined format therefrom; and

in the event that no non-image data of the predetermined format is detected within the one or more predetermined regions in a particular frame being processed, deeming the particular frame to be the event-triggering frame and executing one or more events associated with the event-triggering frame at the time of display of the event-triggering frame.

6. The computer-implemented method of claim 5, wherein the one or more events comprise a projection switch, the method further comprising:

beginning with the event-triggering frame, texture-mapping frames of the digital video to a predetermined geometry prior to being displayed.

7. The computer-implemented method of claim 6, wherein the deeming and executing are conducted only in the event that the event-triggering frame is associated with a projection switch event.

8. The computer-implemented method of claim 7, wherein the frame identifier corresponds to the subsequent event-triggering frame in the event that it matches or exceeds the event-triggering frame.

9. The computer-implemented method of claim 7, wherein the one or more additional events comprise:

a forced perspective wherein, upon display of the subsequent event-triggering frame, the view is forced to a predetermined visual perspective.

10. The computer-implemented method of claim 9, further comprising:

determining a metadata file associated with the digital video; and

determining from information in the metadata file the location in the frames at which the one or more predetermined regions may be detected.

11. The computer-implemented method of claim 10, wherein the location in the frames of the one or more predetermined region changes during the digital video.

12. The computer-implemented method of claim 11, wherein the location of the one or more predetermined region is outside of the predetermined visual perspective to which the view is forced thereby to render the frame identifier unviewable.

13. The computer-implemented method of claim 10, further comprising:

for each of the plurality of frames of the digital video, while causing the frame to be displayed;

executing, in accordance with event parameters stored in the metadata file, each of any events that is/are associated in the metadata file with the frame identifier for the frame.

14. The computer-implemented method of claim 7, wherein the one or more additional events comprise a projection switch from a geometrical projection to a flat projection, the method further comprising:

beginning with the event-triggering frame, flat-projecting the digital video prior to display.

15. The computer-implemented method of claim 14, further comprising:

beginning with the event-triggering frame, cropping out an area encompassing the one or more predetermined regions prior to display.

16. The computer-implemented method of claim 6 wherein, while frames are to be texture-mapped prior to being displayed:

for a period beginning prior to an estimated time of display of a subsequent event-triggering frame;

processing contents in one or more predetermined regions of each frame to detect a frame identifier uniquely identifying each frame;

in the event that a frame identifier is detected within the one or more predetermined regions in a particular frame being processed that corresponds to the subsequent event-triggering frame, executing one or more additional events associated with the subsequent event-triggering frame at the time of display of the subsequent event-triggering frame.

17. The computer-implemented method of claim 5, further comprising:

for the period beginning prior to an estimated time of display of the event-triggering frame;

in the event that a frame identifier is detected within the one or more predetermined regions in a particular frame being processed, cropping out an area encompassing the one or more predetermined regions prior to display.

18. The computer-implemented method of claim 5, wherein each frame identifier comprises:

a repeated series of blocks of uniformly-coloured pixels inserted into respective ones of a plurality of the predetermined regions.

19. The computer-implemented method of claim 5, further comprising:

determining location and dimension of the predetermined regions from data within a file associated with the digital video.

20. A non-transitory processor-readable medium embodying a computer program for processing frames of digital video, the computer program comprising:

program code that processes contents in one or more predetermined image data regions of the frames to detect any non-image data of a predetermined format; and

program code that;

in the event that no non-image data of the predetermined format is detected within the one or more predetermined regions of a particular frame being processed, subjects the particular frame to a predetermined texture-mapping onto a predetermined geometry and causes the texture-mapped frame to be displayed; and

otherwise;

subjects the particular frame to cropping to remove detected non-image data of the predetermined format, flat-projects the cropped frame and causes the flat-projected cropped frame to be displayed.

21. A non-transitory processor-readable medium embodying a computer program for processing frames of digital video, the computer program comprising:

program code that causes frames of the digital video to be displayed; and

program code that, for a period beginning prior to an estimated time of display of an event-triggering frame;

processes contents in one or more predetermined image data regions of the frames to detect any non-image data of a predetermined format therefrom; and

in the event that no non-image data of the predetermined format is detected within the one or more predetermined regions in a particular frame being processed, deems the particular frame to be the event-triggering frame and executes one or more events associated with the event-triggering frame at the time of display of the event-triggering frame.

22. A system for displaying frames of digital video, comprising:

processing structure configured to process contents in one or more predetermined image data regions of the frames to detect any non-image data of a predetermined format;

the processing structure further configured to;

in the event that no non-image data of the predetermined format is detected within the one or more predetermined regions of a particular frame being processed, subject the particular frame to a predetermined texture-mapping onto a predetermined geometry and cause the texture-mapped frame to be displayed; and

otherwise;

subject the particular frame to cropping to remove detected non-image data of the predetermined format, flat-project the cropped frame and cause the flat-projected cropped frame to be displayed.

23. A system for processing digital video, the system comprising:

processing structure configured to causing frames of the digital video to be displayed;

the processing structure further configured to;

for a period beginning prior to an estimated time of display of an event-triggering frame;

process contents in one or more predetermined image data regions of the frames to detect any non-image data of a predetermined format therefrom; and

in the event that no non-image data of the predetermined format is detected within the one or more predetermined regions in a particular frame being processed, deem the particular frame to be the event-triggering frame and execute one or more events associated with the event-triggering frame at the time of display of the event-triggering frame.