System and method for match move quality control

• US 9,251,578 B2
• Filed: 10/11/2012
• Issued: 02/02/2016
• Est. Priority Date: 07/02/2012
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.), Sony Pictures Technologies Incorporated (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.), Sony Pictures Technologies Incorporated (Sony Group Corp.)
• Inventors: Hendricks, Benjamin
• Primary Examiner(s): Du, Haixia
• Application Number:
  US13/649,628
• Publication Number:
  US 20140002446A1
• Time in Patent Office: 1,209 Days
• US Class Current: 1/1
• CPC Class Codes: G01B 11/2545 with one projection direction and several detection directions, e.g. stereo
• CPC Class Codes: G06T 2207/10021 Stereoscopic video; Stereoscopic image sequence
• CPC Class Codes: G06T 2207/30168 Image quality inspection
• CPC Class Codes: G06T 7/0002 Inspection of images, e.g. flaw detection
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 2013/0081 Depth or disparity estimation from stereoscopic image signals

Abstract

Systems and methods are provided for managing depths in stereo images. In one implementation, systems and methods are provided for using a procedural shader and automated rendering to match depths of computer-generated images with that of native stereo images, i.e., images recorded using two cameras for stereo imaging. The system and method may employ a checkerboard and a tri-planar shader, and may further employ a texture reference object to make more convenient and intuitive the depth matching.

Claims

1. A method of performing quality control during a match move process, comprising:

a. displaying a first series of images pertaining to first and second stereographic views of native stereo plates, the native stereo plates having at least one feature thereon;

b. projecting on a computer-generated object a second series of images pertaining to respective first and second stereographic views, the second series match moved to the first series and including a repeating pattern;

c. corresponding a point of the feature with a point on the patterned object; and

d. evaluating a depth of the second series relative to a feature on the native stereo plates, wherein the evaluating includes detecting a first distance from a viewing plane of the feature in the native stereo plate, and detecting a second distance from the viewing plane of the corresponding point on the patterned object, and providing an output indicating a difference between the first and second distances.

2. The method of claim 1, wherein the repeating pattern is a checkerboard pattern.

3. The method of claim 1, further comprising:

calculating an optimized spacing for the repeating pattern based on a size of the computer-generated object or a distance of the computer-generated object from a viewing plane; and

projecting on the computer-generated object the second series of images with the optimized spacing.

4. The method of claim 1, wherein the repeating pattern is projected by a tri-planar shader.

5. The method of claim 1, wherein the repeating pattern is projected on a surface of the computer-generated object within the second series of images, and further comprising locking the repeating pattern onto the computer-generated object by creating a texture reference object for the surface.

6. The method of claim 1, wherein the evaluating is performed automatically.

7. The method of claim 1, wherein the evaluating is performed for a plurality of points on the patterned object and corresponding points on the feature, and wherein the providing an output is performed graphically by providing an output indicating difference values for each point in the plurality of points.

8. The method of claim 1, wherein the evaluating is performed with user input.

9. The method of claim 8, further comprising providing a user interface for displaying the first and second series of images and for accepting user input on resolving unsatisfactory match moves.

10. The method of claim 9, wherein the accepting user input includes accepting user input altering a position or orientation of the patterned object.

11. The method of claim 9, wherein the accepting user input includes accepting user input altering a camera parameter.

12. The method of claim 11, wherein the camera parameter includes a degree of rotation or a position.

13. A non-transitory computer-readable medium, comprising instructions for causing a computing environment to perform the method of claim 1.

14. A method of assisting quality control during a match move process, comprising:

a. capturing a first series of images pertaining to first and second stereographic views of native stereo plates;

b. calculating a disparity map from the first and second stereographic views;

c. from the disparity map and camera data including intraocular distance calculating depths for a plurality of points in the first and second stereographic views;

d. comparing the calculated depths to rendered depths from a computer-generated match move geometry to compare the locations of points in the geometry to corresponding points in the first and second stereographic views; and

e. outputting a result of the comparing step.