Stereo correspondence smoothness tool

• US 9,208,547 B2
• Filed: 12/19/2012
• Issued: 12/08/2015
• Est. Priority Date: 12/19/2012
• Status: Active Grant

• Current Assignee: Adobe Inc.
• Original Assignee: Adobe Systems Incorporated (Adobe Inc.)
• Inventors: Cohen, Scott D., Price, Brian L., Zhang, Chenxi
• Primary Examiner(s): Chawan, Sheela
• Application Number:
  US13/720,258
• Publication Number:
  US 20140169660A1
• Time in Patent Office: 1,084 Days
• Field of Search: 382/154, 382/285, 382/294, 382/106, 382/153, 382/107, 382/284, 382/260, 382/195, 382/205, 382/181, 382/190, 382/254, 348/14.16, 348/42, 348/E13.014, 348/E13.008, 348/51, 348/14.08, 348/14.09, 348/E13.025, 348/E13.016, 348/47, 348/E13.067, 348/E13.065, 348/E7.08, 348/48, 345/419, 345/420, 345/418, 356/2, 396/89
• US Class Current: 1/1
• CPC Class Codes: G06T 2207/10012 Stereo images
• CPC Class Codes: G06T 2207/20104 Interactive definition of region of interest [ROI]
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 5/70 Denoising; Smoothing

Abstract

Stereo correspondence smoothness tool techniques are described. In one or more implementations, an indication is received of a user-defined region in at least one of a plurality of stereoscopic images of an image scene. Stereo correspondence is calculated of image data of the plurality of stereoscopic images of the image scene, the calculation performed based at least in part on the user-defined region as indicating a smoothness in disparities to be calculated for pixels in the user-defined region.

Claims

1. A method implemented by one or more computing devices, the method comprising:

receiving an indication of a user-defined region in at least one of a plurality of stereoscopic images of an image scene, the receiving including detecting user interaction with a smoothness tool in a user interface that is used to display the at least one of the plurality of stereoscopic images; and

calculating stereo correspondence of image data of the plurality of stereoscopic images of the image scene, the calculating performed based at least in part on the user-defined region as indicating a smoothness in disparities to be calculated for pixels in the user-defined region.

2. A method as described in claim 1, wherein the detecting of the indication includes detecting movement of a cursor control device or an object detectable as part of a gesture to indicate the user-defined region through use of corresponding movement of the smoothness tool over the display of the at least one of the plurality of stereoscopic images.

3. A method as described in claim 1, further comprising outputting one or more indications in the user interface that corresponds to the detected user interaction that indicate the user-defined region in reference to the at least one of the plurality of stereoscopic images.

4. A method as described in claim 1, wherein the receiving of the indication includes detecting user interaction that is used to generate the indication of the user-defined region.

5. A method as described in claim 1, wherein the calculating of the stereo correspondence of the image using the user-defined region includes increasing a weight of a corresponding smoothness cost for one or more pairs of pixels that are included in the user-defined region.

6. A method as described in claim 5, further comprising outputting a control in the user interface that is manipulable by a user to specify the weight.

7. A method as described in claim 5, wherein the pixels are neighbors within the user-defined region.

8. One or more computer-readable storage media comprising instructions that are stored thereon that, responsive to execution by a computing device, causes the computing device to perform operations comprising:

calculating stereo correspondence of a plurality of stereoscopic images;

outputting a user interface that includes a result of the calculation of the stereo correspondence;

receiving an indication, formed via interaction with the user interface, to increase smoothness in disparities of pixels in a user-defined region; and

recalculating stereo correspondence of image data of the plurality of stereoscopic images using the user-defined region to increase smoothness of the disparities of the pixels in the user-defined region.

9. One or more computer-readable storage media as described in claim 8, wherein the result is a disparity map or three-dimensional model.

10. One or more computer-readable storage media as described in claim 8, wherein the receiving of the indication includes detecting user interaction with at least one of the plurality of stereoscopic images in the user interface.

11. One or more computer-readable storage media as described in claim 8, wherein the receiving of the indication includes detecting user interaction with a disparity map or three-dimensional model.

12. One or more computer-readable storage media as described in claim 8, wherein the recalculating of the stereo correspondence of the image using the user-defined region includes increasing a weight of a corresponding smoothness cost for one or more pairs of pixels that are included in the user-defined region.

13. One or more computer-readable storage media as described in claim 12, further comprising outputting a control in a user interface that is manipulable by a user to specify the weight.

14. One or more computer-readable storage media as described in claim 12, wherein the pixels are neighbors within the user-defined region.

15. A computing device comprising:

one or more processors; and

one or more computer readable storage media embodying computer readable instructions which, when executed by the one or more processors perform operations comprising;

receiving an indication of a user-defined region in at least one of a plurality of stereoscopic images of an image scene, the receiving including detecting user interaction with a smoothness tool in a user interface that is used to display the at least one of the plurality of stereoscopic images; and

modifying stereo correspondences calculated for image data of a plurality of stereoscopic images of the image scene, the correction performed based at least in part on the user-defined region as indicating a smoothness in disparities to be calculated for pixels in the user-defined region.

16. A computing device as described in claim 15, the operations further comprising outputting one or more indications in the user interface that correspond to the detected user interaction that indicate the user-defined region in reference to the at least one of the plurality of stereoscopic images.

17. A computing device as described in claim 15, wherein the modification of the stereo correspondence using the user-defined region includes increasing a weight of a corresponding smoothness cost for one or more pairs of pixels that are included in the user-defined region.

18. A computing device as described in claim 17, the operations further comprising outputting a control in a user interface that is manipulable by a user to specify the weight.

19. One or more computer-readable storage media as described in claim 17, wherein the pixels are neighbors within the user-defined region.

20. One or more computer-readable storage media as described in claim 15, wherein the detecting of the user interaction includes detecting movement of a cursor control device or an object detectable as part of a gesture to indicate the user-defined region through use of corresponding movement of the smoothness tool over the display of the at least one of the plurality of stereoscopic images.