Real—time stereo 3D and autostereoscopic 3D video and image editing

• US 10,158,847 B2
• Filed: 06/18/2015
• Issued: 12/18/2018
• Est. Priority Date: 06/19/2014
• Status: Active Grant

• Current Assignee: VEFXi Corporation
• Original Assignee: VEFXi Corporation
• Inventors: Peterson, Craig
• Primary Examiner(s): Broome, Said
• Assistant Examiner(s): Cofino, Jonathan M
• Application Number:
  US14/743,793
• Publication Number:
  US 20150371450A1
• Time in Patent Office: 1,279 Days
• Field of Search: 345419, 715716, 715719, 715720, 715722, 715723
• CPC Class Codes: H04N 13/122 Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues H04N13/128 takes precedence
• CPC Class Codes: H04N 13/128 Adjusting depth or disparity
• CPC Class Codes: H04N 13/261 with monoscopic-to-stereoscopic image conversion
• CPC Class Codes: H04N 13/271 wherein the generated image signals comprise depth maps or disparity maps

Abstract

A system for creating a three dimensional image using a processor that includes receiving a digital two dimensional input image and the processor processing the two dimensional input image to determine a depth map further based upon receiving input from a user interface. The processor generates a three dimensional image based upon the two dimensional input image and the depth map.

Claims

1. A method for creating a three dimensional image using a processor comprising:

(a) receiving a digital two dimensional input image;

(b) said processor processing said two dimensional input image to determine a depth map further based upon receiving input from a user interface, where said input from said user interface defines at least one first region of said two dimensional input image that is to be rendered as a two dimensional region;

(c) said processor generating a three dimensional image for at least one second region of said two dimensional input image based upon said two dimensional input image and said depth map, and said processor generating a two dimensional image for said at least one first region of said two dimensional input image that is to be rendered as said two dimensional region based upon said two dimensional input image, where (i) said three dimensional image for said at least one second region of said two dimensional input image and (ii) said two dimensional image for said at least one first region of said two dimensional input image that is to be rendered as said two dimensional region, are non-overlapping with one another;

(d) at least one of;

(i) wherein a display selectively presents within said user interfaced (a) CPU performance;

(b) memory performance;

(c) buffer level;

(d) progress of input;

(e) progress of export; and

(f) storage parameters; and

(ii) wherein a display selectively presents within said user interface at least a group import selections of (a) clip details selection;

(b) position field selection;

(c) start field selection;

(d) end field selection;

(e)picon field selection;

(f) import single frame selection;

(g) import video clip selection;

(h) compression selection; and

(i) cancel import selection.

2. The method of claim 1 wherein said depth map is determined based upon control parameters received from said user input.

3. The method of claim 1 further comprising receiving a video stream that includes a series of said two dimensional input images and automatically determining a set of key frames within said video stream representative of a set of segments of said two dimensional input images and automatically applying the same control parameters used to determine said depth map to a first segment of said set of segments associated with a first one of said key frames and to a second segment of said set of segments associated with a second one of said key frames.

4. The method of claim 3 further comprising a display presenting a representation of said video stream within said user interface that further identifies said first and second one of said key frames.

5. The method of claim 4 wherein said control parameters applied to said first and second segments automatically varies said depth map.

6. The method of claim 5 wherein said automatically varied depth map is linear variation.

7. The method of claim 5 wherein said automatically varied depth map is a segmentation step.

8. The method of claim 5 wherein said automatically varied depth map is log variation.

9. The method of claim 5 wherein said automatically varied depth map is an inverse log variation.

10. The method of claim 3 further comprising at least one executable function associated with each of said first and second key frames that modifies aid first and second segments based upon said respective at least one executable function.

11. The method of claim 10, wherein said executable function is a group including (a) three dimensional text titles;

(b) motion blur;

(c) path of blur;

(d) length of blur; and

(e) depth of field.

12. The method of claim 1 wherein said depth map is determined based upon receiving input from an operations section of said user interface that includes controls and displays information on said user interface specific to the operation being performed.

13. The method of claim 12 wherein said operations section includes an operations selector that receives a selection of that comprises input, output, and setup.

14. The method of claim 13 wherein said operations selector indicates which operations it is currently set to.

15. The method of claim 1 wherein a display selectively presents within said user interface at least (a) play;

(b) stop;

(c) pause;

(d) fast forward;

(e) LTC information;

(f) VITC information;

(g) current time code information;

(h) video display information;

(i) fast reverse; and

(j) loop.

16. The method of claim 1 wherein a display selectively presents within said user interface at least a group of export selections of (a) file saving location;

(b) type of export data list;

(c) file type;

(d) compression setting;

(e) bit depth;

(f) range;

(g) translation.

17. The method of claim 16 wherein said display selectively presents within said user interface at least a group of profile selections of (a) file type;

(b) codec selection;

(c) width of frame;

(d) height of frame;

(e) bit depth;

(f) data rate;

(g) key frame;

(h) quality; and

(i) audio settings.

18. The method of claim 1 further comprising receiving a video stream that includes a series of said two dimensional input images and determining a set of key frames within said video stream representative of a set of segments of said two dimensional input images and applying control parameters to a first segment of said set of segments associated with a first one of said key frames based upon a set of adjustments received from said user interface, wherein a first one of said set of adjustments includes a dynamic range control that selects an overall depth volume of said three dimensional image.

19. The method of claim 18 wherein a second one of said set of adjustments includes a zero plane position within said overall depth volume.

20. The method of claim 19 wherein a third one of said set of adjustments includes a segmentation break which defines another depth position within said overall depth volume which results in a modified said three dimensional image relative to said segmentation break.

21. The method of claim 20 wherein a fourth one of said set of adjustments includes a segmentation step which operates in conjunction with said segmentation break to move three dimensional content away from said segmentation break.

22. The method of claim 21 wherein a fifth one of said set of adjustments includes a segmentation scale which operates in conjunction with said segmentation break to stretch three dimensional content away from said segmentation break.

23. The method of claim 1 further comprising receiving from said user interface a segmentation of said two dimensional image for at least one region to be rendered in two dimensions and at least one region to be rendered as said three dimensional image.

24. The method of claim 23 further comprising receiving from said user interface a plurality of regions to be rendered in as said three dimensional image.

25. The method of claim 24 wherein said user interface selects a first set of control parameters for rendering one of said plurality of regions as said three dimensional image and a second set of control parameters for rendering another one of said plurality of regions as said three dimensional image, where said first set of control parameters are different from said second set of control parameters in the amount of depth of field.

26. The method of claim 1 further comprising receiving from said user interface a segmentation of said two dimensional image for said first region and modifying said generating said three dimensional image based upon said two dimensional input image and said depth map based upon said segmentation.

27. The method of claim 1 further comprising receiving from said user interface a right eye and left eye swap of said determine said depth map.

28. The method of claim 1 further comprising receiving from said user interface an artifact suppression that includes an intensity selector that selects a range of intensities and modifying said generating said three dimensional image based upon said two dimensional input image and said depth map based upon said range of intensities.

29. The method of claim 1 further comprising receiving from said user interface an artifact suppression that includes a hue selector that selects a range of hues and modifying said generating said three dimensional image based upon said two dimensional input image and said depth map based upon said range of hues.

30. The method of claim 1 further comprising receiving from said user interface an artifact suppression that includes a saturation selector that selects a range of saturations and modifying said generating said three dimensional image based upon said two dimensional input image and said depth map based upon said range of saturations.

31. The method of claim 1 further comprising receiving from said user interface an artifact suppression that includes a depth selector that selects a depth offset based upon a selected region and modifying said generating said three dimensional image based upon said two dimensional input image and said depth map based upon said depth offset.

32. The method of claim 1 further comprising receiving from said user interface an artifact suppression that includes an attenuation selector that selects an attenuation based upon a selected region and modifying said generating said three dimensional image based upon said two dimensional input image and said depth map based upon said attenuation.