Methods and systems for converting 2D motion pictures for stereoscopic 3D exhibition

• US 9,282,313 B2
• Filed: 12/14/2012
• Issued: 03/08/2016
• Est. Priority Date: 06/23/2006
• Status: Active Grant

• Current Assignee: IMAX Corporation
• Original Assignee: IMAX Corporation
• Inventors: Zhou, Samuel, Judkins, Paul, Ye, Ping
• Primary Examiner(s): Allison, Andrae S
• Application Number:
  US13/714,503
• Publication Number:
  US 20130169749A1
• Time in Patent Office: 1,180 Days
• Field of Search: 382/100, 382/107, 382/154, 382/232, 382/236, 382/103, 382168-172, 348/42, 348/45, 348/46, 348/47, 348/48, 348/65, 348/66, 348/79, 348/80, 375/240.21, 375/240.29, 375/240.16, 375/240.02, 375/240.25, 375/240.26
• US Class Current: 1/1
• CPC Class Codes: H04N 13/139 Format conversion, e.g. of frame-rate or size
• CPC Class Codes: H04N 13/261 with monoscopic-to-stereoscopic image conversion

Abstract

The present invention discloses methods of digitally converting 2D motion pictures or any other 2D image sequences to stereoscopic 3D image data for 3D exhibition. In one embodiment, various types of Image data cues can be collected from 2D source images by various methods and then used for producing two distinct stereoscopic 3D views. Embodiments of the disclosed methods can be implemented within a highly efficient system comprising both software and computing hardware. The architectural model of some embodiments of the system is equally applicable to a wide range of conversion, re-mastering and visual enhancement applications for motion pictures and other image sequences, including converting a 2D motion picture or a 2D image sequence to 3D, re-mastering a motion picture or a video sequence to a different frame rate, enhancing the quality of a motion picture or other image sequences, or other conversions which facilitate further improvement in visual image quality within a projector to produce the enhanced images.

Claims

1. A method, comprising:

collecting a first set of processing information from a before-picture-lock version of an image data sequence that includes frames associated with each other temporally to form a motion picture with content that is changeable;

storing the first set of processing information in a render data record;

performing, using the render data record, initial conversion on the before-picture-lock version of the image data sequence to an enhanced image data sequence of the motion picture;

subsequent to performing at least part of the initial conversion, detecting changes between the before-picture-lock version of the image data sequence and a final or substantially final version of the image data sequence by comparing the before-picture-lock version to the final or substantially final version, the final or substantially final version being generated subsequently to the before-picture-lock version being generated; and

(A) in response to determining that the changes impact the render data record;

(i) generating an updated render data record to include a second set of processing information collected from the final or substantially final version of the image data sequence; and

(ii) completing conversion to the enhanced image data sequence of the motion picture using the updated render data record;

or

(B) in response to determining that the changes do not impact the render data record, completing conversion to the enhanced image data sequence of the motion picture using the render data record.

2. The method of claim 1, wherein the final or substantially final version of the image data sequence is the final version that is a picture-lock version that includes frames associated with each other temporally to form the motion picture with content that is unchangeable.

3. The method of claim 1, wherein completing conversion to the enhanced image data sequence of the motion picture using the updated render data record also includes using the final or substantially final version of the image data sequence.

4. The method of claim 3, wherein completing conversion to the enhanced image data sequence of the motion picture using the updated render data record and the final or substantially final version of the image data sequence also includes using at least part of initial results from the initial conversion.

5. The method of claim 1, wherein determining that the changes impact the render data record include determining that the changes are other than, or in addition to, changes resulting from color timing in the image data sequence,

wherein determining that the changes do not impact the render data record includes determining that the changes only include the changes resulting from color timing in the image data sequence.

6. The method of claim 1, wherein the final or substantially final version of the image data sequence and the before-picture-lock version of the image data sequence are two-dimensional image data sequences, wherein the enhanced image data sequence is a three-dimensional image data sequence that is the motion picture for display in three-dimensional form.

7. The method of claim 1, wherein the enhanced image data sequence has enhanced resolution and enhanced image quality as compared to the final or substantially final version of the image data sequence and the before-picture-lock version of the image data sequence.

8. The method of claim 1, wherein the enhanced image data sequence has a different frame rate than the final or substantially final version of the image data sequence and the before-picture-lock version of the image data sequence.

9. The method of claim 1, further comprising:

rendering the enhanced image data sequence for viewing and verification.

10. The method of claim 1, wherein the first set of processing information and the second set of processing information are color independent and comprise computing instructions and parameters.

11. The method of claim 1, wherein collecting the first set of processing information from the before-picture-lock version of the image data sequence comprises:

dividing the before-picture-lock version of the image data sequence into scenes and objects that are associated together temporally; and

analyzing the scenes and the objects to collect the first set of processing information.

12. The method of claim 11, wherein analyzing the scenes comprises temporal analysis, scene separation, scene layout planning, and scene automation analysis,

wherein analyzing the objects comprises layer analysis, layer conversion, and scene compositing.

13. The method of claim 1, where the before-picture-lock version of the image data sequence is a color source image data sequence.

14. A system, comprising:

a front-end system comprising a front-end system processor device, the front-end system being configured for collecting a first set of processing information from a before-picture-lock version of an image data sequence that includes frames associated with each other temporally to form a motion picture with content that is changeable;

a backend system comprising a backend processor device, the backend system being configured for;

storing the first set of processing information in a render data record;

performing, using the render data record, initial conversion on the before-picture-lock version of the image data sequence to an enhanced image data sequence of the motion picture;

subsequent to performing at least part of the initial conversion, detecting changes between the before-picture-lock version of the image data sequence and a final or substantially final version of the image data sequence by comparing the before-picture-lock version to the final or substantially final version, wherein the final or substantially final version is configured to be generated subsequently to the before-picture-lock version being generated;

in response to determining that the changes impact the render data record;

(i) generating an updated render data record to include a second set of processing information collected from the final or substantially final version of the image data sequence; and

(ii) completing conversion to the enhanced image data sequence of the motion picture using the updated render data record; and

in response to determining that the changes do not impact the render data record, completing conversion to the enhanced image data sequence of the motion picture using the render data record.

15. The system of claim 14, wherein the final or substantially final version of the image data sequence is the final version that is a picture-lock version that includes frames associated with each other temporally to form the motion picture with content that is unchangeable.

16. The system of claim 14, wherein the backend system is configured for completing conversion to the enhanced image data sequence of the motion picture using the updated render data record by also using the final or substantially final version of the image data sequence.

17. The system of claim 16, wherein the backend system is configured for completing conversion to the enhanced image data sequence of the motion picture using the updated render data record and the final or substantially final version of the image data sequence by also using at least part of initial results from the initial conversion.

18. The system of claim 14, wherein the backend system is configured for determining that the changes impact the render data record by determining that the changes are other than, or in addition to, changes resulting from color timing in the image data sequence,

wherein the backend system is configured for determining that the changes do not impact the render data record by determining that the changes only include the changes resulting from color timing in the image data sequence.

19. The system of claim 14, wherein the final or substantially final version of the image data sequence and the before-picture-lock version of the image data sequence are two-dimensional image data sequences, wherein the enhanced image data sequence is a three-dimensional image data sequence that is the motion picture for display in three-dimensional form.

20. The system of claim 14, wherein the enhanced image data sequence has enhanced resolution and enhanced image quality as compared to the final or substantially final version of the image data sequence and the before-picture-lock version of the image data sequence.

21. The system of claim 14, wherein the enhanced image data sequence has a different frame rate than the final or substantially final version of the image data sequence and the before-picture-lock version of the image data sequence.

22. The system of claim 14, wherein the backend system is configured for rendering the enhanced image data sequence for viewing and verification.

23. The system of claim 14, wherein the first set of processing information and the second set of processing information are color independent and comprise computing instructions and parameters.

24. The system of claim 14, wherein the front-end system is configured for collecting the first set of processing information from the before-picture-lock version of the image data sequence by dividing the before-picture-lock version of the image data sequence into scenes and objects that are associated together temporally and analyzing the scenes and the objects to collect the first set of processing information.

25. The system of claim 24, wherein the front-end system is configured for analyzing the scenes by temporal analysis, scene separation, scene layout planning, and scene automation analysis,

wherein the front-end system is configured for analyzing the objects by layer analysis, layer conversion, and scene compositing.

26. The system of claim 14, where the before-picture-lock version of the image data sequence is a color source image data sequence.