IMAGE PROCESSING DEVICE, IMAGE PROCESSING METHOD, AND STORAGE MEDIUM

• US 20150279073A1
• Filed: 03/17/2015
• Published: 10/01/2015
• Est. Priority Date: 03/26/2014
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: INABA, SEIJIRO, IKEDA, NOBUHO, SHIMAUCHI, KAZUHIRO
• Granted Patent: US 9,836,668 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06T 2207/10012 Stereo images
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 5/73 Deblurring; Sharpening
• CPC Class Codes: G06T 7/97 Determining parameters from multiple pictures depth or shape recovery from multiple images G06T7/55; stereo camera calibration G06T7/85

Abstract

There is provided an image processing device including a spatial frequency characteristic adjusting unit configured to perform an adjustment on at least one of first image data corresponding to a first image and second image data corresponding to a second image to match a spatial frequency characteristic of the first image data with a spatial frequency characteristic of the second image data, the second image having an overlapping area that overlaps with an overlapping area of the first image, and an image processing unit configured to perform a process using the first image data and the second image data, on at least one of which the adjustment has been performed in the spatial frequency characteristic adjusting unit.

Claims

1. An image processing device comprising:

a spatial frequency characteristic adjusting unit configured to perform an adjustment on at least one of first image data corresponding to a first image and second image data corresponding to a second image to match a spatial frequency characteristic of the first image data with a spatial frequency characteristic of the second image data, the second image having an overlapping area that overlaps with an overlapping area of the first image; and

an image processing unit configured to perform a process using the first image data and the second image data, on at least one of which the adjustment has been performed in the spatial frequency characteristic adjusting unit.

2. The image processing device according to claim 1,

wherein the image processing unit detects a feature amount in each of the overlapping areas of the first image and the second image on the basis of the first image data and the second image data, on which the adjustment has been performed, and performs a process using the feature amount.

3. The image processing device according to claim 1,

wherein the spatial frequency characteristic adjusting unit filters the first image data and the second image data by using a low-pass filter or a band-pass filter.

4. The image processing device according to claim 1,

wherein the spatial frequency characteristic adjusting unit detects the spatial frequency characteristics of the first image data and the second image data, and matches the spatial frequency characteristics of the first image data and the second image data with a spatial frequency characteristic obtained on the basis of a result obtained by detecting the spatial frequency characteristics of the first image data and the second image data.

5. The image processing device according to claim 1,

wherein the image processing unit obtains positional disagreement between the overlapping areas of the first image and the second image on the basis of the first image data and the second image data, on which the adjustment has been performed, and generates panoramic image data by combining the first image data with the second image data on the basis of information on the positional disagreement.

6. The image processing device according to claim 1,

wherein the image processing unit determines whether or not an identical object is present in the overlapping areas of the first image and the second image, on the basis of the first image data and the second image data, on which the adjustment has been performed.

7. The image processing device according to claim 1,

wherein the first image data is left-eye image data, and the second image data is right-eye image data, and

wherein the image processing unit obtains positional disagreement between the overlapping areas of the first image and the second image, on the basis of the first image data and the second image data, on which the adjustment has been performed, and performs a disparity adjustment on the first image data and the second image data on the basis of the positional disagreement.

8. An image processing method comprising the steps of:

performing an adjustment on at least one of first image data corresponding to a first image and second image data corresponding to a second image to match a spatial frequency characteristic of the first image data with a spatial frequency characteristic of the second image data, the second image having an overlapping area that overlaps with an overlapping area of the first image; and

performing a process using the first image data and the second image data, on at least one of which the adjustment has been performed.

9. The image processing method according to claim 8,

wherein the process includes detecting a feature amount in each of the overlapping areas of the first image and the second image on the basis of the first image data and the second image data, on which the adjustment has been performed.

10. The image processing method according to claim 8,

wherein the adjustment includes filtering the first image data and the second image data by using a low-pass filter or a band-pass filter.

11. The image processing method according to claim 8,

wherein the adjustment includes detecting the spatial frequency characteristics of the first image data and the second image data, and matching the spatial frequency characteristics of the first image data and the second image data with a spatial frequency characteristic obtained on the basis of a result obtained by detecting the spatial frequency characteristics of the first image data and the second image data.

12. The image processing method according to claim 8,

wherein the process includes obtaining positional disagreement between the overlapping areas of the first image and the second image on the basis of the first image data and the second image data, on which the adjustment has been performed, and generating panoramic image data by combining the first image data with the second image data on the basis of information on the positional disagreement.

13. The image processing method according to claim 8,

wherein the process includes determining whether or not an identical object is present in the overlapping areas of the first image and the second image, on the basis of the first image data and second image data, on which the adjustment has been performed.

14. The image processing method according to claim 8,

wherein the first image data is left-eye image data, and the second image data is right-eye image data, and

wherein the process includes obtaining positional disagreement between the overlapping areas of the first image and the second image, on the basis of the first image data and the second image data, on which the adjustment has been performed, and performing a disparity adjustment on the first image data and the second image data on the basis of the positional disagreement.

15. A non-transitory computer-readable storage medium storing computer-readable instructions thereon, which, when executed by a computer, cause the computer to perform an image processing method comprising the steps of:

performing an adjustment on at least one of first image data corresponding to a first image and second image data corresponding to a second image to match a spatial frequency characteristic of the first image data with a spatial frequency characteristic of the second image data, the second image having an overlapping area that overlaps with an overlapping area of the first image; and

performing a process using the first image data and the second image data, on at least one of which the adjustment has been performed.

16. The non-transitory computer-readable storage medium according to the claim 15,

wherein the process includes detecting a feature amount in each of the overlapping areas of the first image and the second image on the basis of the first image data and the second image data, on which the adjustment has been performed.

17. The non-transitory computer-readable storage medium according to claim 15,

wherein the adjustment includes filtering the first image data and the second image data by using a low-pass filter or a band-pass filter.

18. The non-transitory computer-readable storage medium according to claim 15,

wherein the adjustment includes detecting the spatial frequency characteristics of the first image data and the second image data, and matching the spatial frequency characteristics of the first image data and the second image data with a spatial frequency characteristic obtained on the basis of a result obtained by detecting the spatial frequency characteristics of the first image data and the second image data.

19. The non-transitory computer-readable storage medium according to claim 15,

wherein the process includes obtaining positional disagreement between the overlapping areas of the first image and the second image on the basis of the first image data and the second image data, on which the adjustment has been performed, and generating panoramic image data by combining the first image data with the second image data on the basis of information on the positional disagreement.

20. The non-transitory computer-readable storage medium according to claim 15,

wherein the process includes determining whether or not an identical object is present in the overlapping areas of the first image and the second image, on the basis of the first image data and the second image data, on which the adjustment has been performed.

21. The non-transitory computer-readable storage medium according to claim 15,

wherein the first image data is left-eye image data, and the second image data is right-eye image data, and

wherein the process includes obtaining positional disagreement between the overlapping areas of the first image and the second image, on the basis of the first image data and the second image data, on which the adjustment has been performed, and performing a disparity adjustment on the first image data and the second image data on the basis of the positional disagreement.