CALIBRATION METHODS FOR THICK LENS MODEL

• US 20160227206A1
• Filed: 02/04/2015
• Published: 08/04/2016
• Est. Priority Date: 02/04/2015
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Tu, Xue, Li, Pingshan, Berestov, Alexander
• Granted Patent: US 9,781,412 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06T 7/80 Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
• CPC Class Codes: H04N 17/002 for television cameras

Abstract

The thick lens calibration method enables better calibration of complex camera devices such as devices with thick lens systems. The thick lens calibration method includes a two step process of calibrating using the distance between a second nodal point and an image sensor, and calibrating using the distance between the first and second nodal point.

Claims

1. A method programmed in a non-transitory memory of a device comprising:

a. calibrating the device using a first distance between a second nodal point and an image sensor; and

b. calibrating the device using a second distance between a first nodal point and the second nodal point.

2. The method of claim 1 wherein the calibrating further comprises taking a picture of a checkerboard pattern.

3. The method of claim 1 wherein the calibrating further comprises calculating a magnification factor by measuring a distance of two corner points on a real checkerboard and an image of the checkerboard.

4. The method of claim 3 wherein corner detection is used to locate a rough position of the corners.

5. The method of claim 1 wherein calibrating further comprises calculating the first distance between the second nodal point and the image sensor using the magnification factor.

6. The method of claim 1 wherein calibrating further comprises fitting a linear curve to calibrate all of the sensor distances corresponding to each depth of field.

7. The method of claim 1 wherein calibrating further comprises utilizing a distance relationship, where there is a same object position but different lens settings.

8. The method of claim 7 wherein calibrating further comprises utilized a magnification factor, a distance to an object, and calibration information.

9. The method of claim 8 wherein the magnification factor is calculated using a checkerboard object at a certain distance and taking pictures with different lens settings, and the magnification factor is calculated by measuring distances between circle centers.

10. The method of claim 9 wherein measuring the distances between circle centers includes cropping out a patch that contains a circle, the patch is convolved with itself, a position of the maximal convolution result is determined, and a distance between the circle centers is measured.

11. The method of claim 1 wherein calibrating further comprises calculating the second distance between the first nodal point and the second nodal point using a distance of an object, a calibrated quantity and a calculated quantity.

12. The method of claim 11 wherein calibrating further comprises taking an average of second distances calculated and generating a final result.

13. A system comprising:

a. a lens;

b. an image sensor configured for acquiring an image; and

c. a processing component configured for calibrating the system using a first distance between a second nodal point and the image sensor, and calibrating the system using a second distance between a first nodal point and the second nodal point.

14. The system of claim 13 wherein the calibrating further comprises taking a picture of a checkerboard pattern.

15. The system of claim 13 wherein the calibrating further comprises calculating a magnification factor by measuring a distance of two corner points on a real checkerboard and an image of the checkerboard.

16. The system of claim 15 wherein corner detection is used to locate a rough position of the corners.

17. The system of claim 13 wherein calibrating further comprises calculating the first distance between the second nodal point and the image sensor using the magnification factor.

18. The system of claim 13 wherein calibrating further comprises fitting a linear curve to calibrate all of the sensor distances corresponding to each depth of field.

19. The system of claim 13 wherein calibrating further comprises utilizing a distance relationship, where there is a same object position but different lens settings.

20. The system of claim 19 wherein calibrating further comprises utilized a magnification factor, a distance to an object, and calibration information.

21. The system of claim 20 wherein the magnification factor is calculated using a checkerboard object at a certain distance and taking pictures with different lens settings, and the magnification factor is calculated by measuring distances between circle centers.

22. The system of claim 21 wherein measuring the distances between circle centers includes cropping out a patch that contains a circle, the patch is convolved with itself, a position of the maximal convolution result is determined, and a distance between the circle centers is measured.

23. The system of claim 13 wherein calibrating further comprises calculating the second distance between the first nodal point and the second nodal point using a distance of an object, a calibrated quantity and a calculated quantity.

24. The system of claim 23 wherein calibrating further comprises taking an average of second distances calculated and generating a final result.

25. A camera device comprising:

a. a lens;

b. a sensor configured for acquiring an image;

c. a non-transitory memory for storing an application, the application for;

i. calibrating the system using a first distance between a second nodal point and the image sensor; and

ii. calibrating the system using a second distance between a first nodal point and the second nodal point; and

d. a processing component coupled to the memory, the processing component configured for processing the application.

26. The camera device of claim 25 wherein the calibrating further comprises taking a picture of a checkerboard pattern.

27. The camera device of claim 25 wherein the calibrating further comprises calculating a magnification factor by measuring a distance of two corner points on a real checkerboard and an image of the checkerboard.

28. The camera device of claim 27 wherein corner detection is used to locate a rough position of the corners.

29. The camera device of claim 25 wherein calibrating further comprises calculating the first distance between the second nodal point and the image sensor using the magnification factor.

30. The camera device of claim 25 wherein calibrating further comprises fitting a linear curve to calibrate all of the sensor distances corresponding to each depth of field.

31. The camera device of claim 25 wherein calibrating further comprises utilizing a distance relationship, where there is a same object position but different lens settings.

32. The camera device of claim 31 wherein calibrating further comprises utilized a magnification factor, a distance to an object, and calibration information.

33. The camera device of claim 32 wherein the magnification factor is calculated using a checkerboard object at a certain distance and taking pictures with different lens settings, and the magnification factor is calculated by measuring distances between circle centers.

34. The camera device of claim 33 wherein measuring the distances between circle centers includes cropping out a patch that contains a circle, the patch is convolved with itself, a position of the maximal convolution result is determined, and a distance between the circle centers is measured.

35. The camera device of claim 25 wherein calibrating further comprises calculating the second distance between the first nodal point and the second nodal point using a distance of an object, a calibrated quantity and a calculated quantity.

36. The camera device of claim 35 wherein calibrating further comprises taking an average of second distances calculated and generating a final result.