Method to convert two dimensional motion pictures for three-dimensional systems

• US 4,925,294 A
• Filed: 12/17/1986
• Issued: 05/15/1990
• Est. Priority Date: 12/17/1986
• Status: Expired due to Term

• Current Assignee: Three-Dimensional Media Group Limited
• Original Assignee: David M. Geshwind
• Inventors: Handal, Anthony H., Geshwind, David M.
• Primary Examiner(s): Hix, L. T.
• Assistant Examiner(s): RUTLEDGE, DELLA J
• Application Number:
  US07/227,403
• Time in Patent Office: 1,245 Days
• Field of Search: 355/40, 355/52, 355/77, 352/43, 352/57, 352/85, 352/86, 352/129, 358/88, 358/89, 358/22, 358/81, 358/160
• US Class Current: 352/57
• CPC Class Codes: H04L 69/16 Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
• CPC Class Codes: H04N 13/111 Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
• CPC Class Codes: H04N 13/122 Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues H04N13/128 takes precedence
• CPC Class Codes: H04N 13/15 for colour aspects of image signals
• CPC Class Codes: H04N 13/161 Encoding, multiplexing or demultiplexing different image signal components for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 13/189 Recording image signals; Reproducing recorded image signals
• CPC Class Codes: H04N 13/194 Transmission of image signals
• CPC Class Codes: H04N 13/221 using the relative movement between cameras and objects
• CPC Class Codes: H04N 13/257 Colour aspects
• CPC Class Codes: H04N 13/261 with monoscopic-to-stereoscopic image conversion
• CPC Class Codes: H04N 13/289 Switching between monoscopic and stereoscopic modes
• CPC Class Codes: H04N 13/324 Colour aspects
• CPC Class Codes: H04N 13/334 using spectral multiplexing
• CPC Class Codes: H04N 13/337 using polarisation multiplexing
• CPC Class Codes: H04N 13/339 using spatial multiplexing H04N13/337 takes precedence
• CPC Class Codes: H04N 13/341 using temporal multiplexing
• CPC Class Codes: H04N 13/361 Reproducing mixed stereoscopic images; Reproducing mixed monoscopic and stereoscopic images, e.g. a stereoscopic image overlay window on a monoscopic image background
• CPC Class Codes: H04N 13/363 using image projection screens volumetric display H04N13/388
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding
• CPC Class Codes: H04N 2013/0081 : Depth or disparity estimation from stereoscopic image signals
• CPC Class Codes: H04N 2013/0092 : Image segmentation from stereoscopic image signals

Abstract

The present invention relates to the computer-assisted processing of standard two-dimensional motion pictures to generate processed image sequences which exhibit some three-dimensional depth effects when viewed under appropriate conditions.

Claims

1. A method of converting a two-dimensional image frame into a three-dimensional image frame consisting of the steps of:

a. inputing a frame of a two-dimensional image into a computer;

b. specifying at least two individual image elements in the two-dimensional image;

c. separating the two-dimensional image into said image elements;

d. specifying three-dimensional information for at least one of said image elements;

e. processing at least one of said image elements to incorporate said three-dimensional information and create at least one processed image element;

f. generating at least one processed image frame comprising at least one of said processed image elements.

2. A method as in claim 1 wherein said step f results in the generation of a left and right pair of processed image frames.

3. A method as in claim 2 comprising the additional step of:

g. combining said left and right image pair into a single processed image.

4. A method as in claim 2 comprising the additional step of:

g. encoding said left and right processed image pair for viewing, by coloring each of said pair different colors.

5. A method as in claim 2 comprising the additional step of:

g. encoding said left and right processed image pair for viewing, by passing each of said pair through mutually perpendicularly polarized filters.

6. A method as in claim 2 comprising the additional step of:

g. encoding said left and right processed image pair for viewing, by incorporating said image pair into a video signal suitable for displaying each of said pair alternately on a video display.

7. As method as in claim 1, wherein said step f results in a processed image frame such that, when viewed through glasses with one dark and one light lens, 3-dimensional effects are perceived.

8. A method as in claim 1 comprising the additional step of:

g. recording said processed image frame.

9. A method as in claim 7 comprising the additional step of:

g. recording said processed image frame.

10. A method as in claim 1 wherein said steps are applied to successive frames in a motion picture sequence.

11. A method as in claim 2 wherein said steps are applied to successive frames in a motion picture sequence.

12. A product produced by the method described in claim 7.

13. A product produced by the method described in claim 10.

14. A product produced by the method described in claim 11.

15. A product produced by the method described in claim 1.

16. A method as in claim 1 wherein at least one of said processed image elements produced in step e is a shadow element.

17. A method as in claim 1 wherein at least one of said image elements in step e is processed to include additional two-dimensional image information not contained in the original unprocessed two-dimensional image.

18. A method as in claim 17 wherein said additional two-dimensional image information is derived from another image.

19. A method as in claim 1 wherein said processed image elements in step f are combined with at least one additional 3-D image element not derived from the source image to create said processed image frame.

20. A method as in claim 19 wherein said additional 3-D image element is derived from a 3-D photograph.

21. A method as in claim 19 wherein said additional 3-D image element is derived from a computer generated 3-D image.

22. A method as in claim 1 wherein said three-dimensional information for at least one of said image elements in step d is specified only at certain points and is interpolatively derived for other points on said image element.

23. A method as in claim 10 wherein said three-dimensional information for at least one of said image elements in step d is specified only for certain frames and is temporally interpolated for frames between said certain frames.

24. A method as in claim 10 wherein said specification of at least one of said image elements in step b is specified only for certain frames and is temporally interpolated for frames between said certain frames.

25. A method as in claim 1 wherein random noise is added to the three-dimensional information specified in step d.

26. A method as in claim 1 wherein at least some of said three-dimensional information specified in step d is derived from the measurement of at least one aspect of an image element.

27. A method as in claim 26 wherein said aspect pertains to geometry.

28. A method as in claim 26 wherein said aspect pertains to illumination.

29. A method as in claim 10 wherein at least some of said three-dimensional information specified in step d is derived from the measurement of the change of at least one aspect of an image element in successive frames.

30. A method as in claim 29 wherein said aspect pertains to geometry.

31. A method as in claim 29 wherein said aspect pertains to illumination.

32. A method as in claim 1 wherein said two-dimensional image frame is a black and white image frame, said image elements are black and white image elements, and said processing includes the process of adding color to at least one of said black and white image elements.

33. A method as in claim 32 wherein said steps are applied to successive frames in a motion picture sequence.

34. A product produced by the method of claim 33.

39. A method as in claim 33 comprising the additional step:

g. recording of said three-dimensional image sequence.

35. An apparatus for converting a two-dimensional image frame into a three-dimensional image frame comprising, in combination:

a. a means for scanning said two-dimensional image frame into a computer;

b. a means for specifying individual image elements in said frame;

c. a means for separating said frame into said individual elements;

d. a means for specifying three-dimensional information for said individual image elements;

e. a means for processing said individual image elements to create processed image elements;

f. a means for creating said three-dimensional image frame comprising at least one of said processed image elements;

g. a means for outputing said three-dimensional image frame.

36. An apparatus for converting a two-dimensional image sequence into a three-dimensional image sequence and producing a three-dimensional image recording comprising, in combination:

a. a means for scanning said sequence into a computer;

b. a means for specifying individual image elements in said sequence;

c. a means for separating said sequence into said individual image elements;

d. a means for specifying three-dimensional information for said individual image elements;

e. a means for processing said individual image elements to create processed image elements;

f. a means for combining said processed image elements into a processed image sequence;

g. a means for outputing said three-dimensional image sequence;

h. a means for recording said three-dimensional image sequence.

37. A method of converting a two-dimensional image frame into a three-dimensional image frame consisting of the steps of:

a. inputing frames of a two-dimensional image sequence into a computer;

b. specifying at least two individual image elements in the two-dimensional image sequence;

c. separating the two-dimensional images into said image elements;

d. specifying three-dimensional information for at least one of said image elements;

e. processing at least one of said image elements to incorporate said three-dimensional information and create at least one processed image elements;

f. generating a sequence of processed image frames comprising at least one of said processed image elements said generation to be of such a nature so as to exhibit three-dimensional depth characteristics when viewed using a complementary display system.

38. A method as in claim 37 comprising the additional step:

g. transmission of said three-dimensional image sequence.

40. A method as in claim 37 wherein said two-dimensional image sequence is a black and white image sequence, said image elements are black and white image elements, and said processing includes the process of adding color to at least one of said black and white image elements.

41. A product produced by the method of claim 40.

42. A method of converting a two-dimensional image frame into a three-dimensional image frame consisting of the steps of:

a. inputing frames of a two-dimensional image sequence into a computer, each of said frames consisting of at least two individual image elements;

b. specifying three-dimensional information for at least one of said image elements;

c. processing at least one of said image elements to incorporate said three-dimensional information and create at least one processed image element;

d. generating a sequence of processed image frames comprising at least one of said processed image elements.

43. A method as in claim 42 wherein said individual image elements in step a are derived from sub-components of an animated film.

44. A product produced by the method described in claim 42.