Wide-Field Image Input Method And Device

• US 20080031543A1
• Filed: 07/01/2005
• Published: 02/07/2008
• Est. Priority Date: 07/07/2004
• Status: Active Grant

• Current Assignee: NEC Corporation
• Original Assignee: NEC Corporation
• Inventors: Iketani, Akihiko, Nakajima, Noboru
• Granted Patent: US 7,978,930 B2
• Time in Patent Office: Days
• US Class Current: 382/284
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: H04N 1/195 the array comprising a two-dimensional array or a combination of two-dimensional arrays
• CPC Class Codes: H04N 1/19594 using a television camera or a still video camera
• CPC Class Codes: H04N 1/3876 Recombination of partial images to recreate the original image
• CPC Class Codes: H04N 2201/0414 Scanning an image in a series of overlapping zones
• CPC Class Codes: H04N 2201/04739 by detecting the scanning head or scanning carriage
• CPC Class Codes: H04N 2201/04743 by detecting the image directly detecting reference images H04N2201/04717
• CPC Class Codes: H04N 5/2624 for obtaining an image which is composed of whole input images, e.g. splitscreen
• CPC Class Codes: H04N 5/2625 for obtaining an image which is composed of images from a temporal image sequence, e.g. for a stroboscopic effect sequence generated by event triggered capturing H04N7/188
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation

Abstract

A wide-field image input device that joins a series of partial images obtained by continuously imaging an imaging object by an imaging device while the imaging device is manually scanned by a user, thereby generating a wide-field image, includes: a camera position/posture estimation unit for receiving a partial image series and calculating a change state of three-dimensional position and posture of the imaging device as time-series camera position/posture information; a deformation parameter estimation unit for calculating a geometrical deformation parameter between adjacent partial images from the camera position/posture information; an image joining unit for joining the partial images by using the geometrical deformation parameter so as to generate a wide-field image; and a camera scan error detection unit for detecting motion of the imaging device according to the camera position/posture information and outputting a camera scan error detection signal when an error is detected.

Claims

1. A wide-field image input device that joins a series of partial images obtained by continuously imaging an imaging object by an imaging device while the imaging device is manually scanned by a user, thereby generating a wide-field image, the device comprising:

camera position/posture estimation means for receiving a partial image series including said series of partial images, and calculating a change state of three-dimensional position and posture of said imaging device as time-series camera position/posture information;

deformation parameter estimation means for calculating a geometrical deformation parameter between adjacent partial images in said partial image series from said camera position/posture information;

image joining means for joining said partial images while a deformation between said partial images is corrected by using said geometrical deformation parameter so as to generate a wide-field image; and

camera scan error detection means for detecting motion of said imaging device according to said camera position/posture information, and outputting a camera scan error detection signal when an error is detected in the motion of said imaging device.

2. The device according to claim 1, further comprising camera position/posture indication means, based on said camera position/posture information from said camera position/posture estimation means, for performing one or more of the processes consisting of:

(a) visually indicating a change in a relative position between said imaging device and the imaging object or a change of posture of said imaging device, or the change in the relative position and the change of posture;

(b) displaying warning when said relative position and/or said posture are in levels of having effects on deterioration in a quality of images;

(c) visually displaying a correction amount to indicate which direction and angle and how much said imaging device is corrected for desirable imaging; and

(d) indicating a change amount of said relative position or a change amount of the posture, or both by a tone at a pitch.

3. The device according to claim 1 or 2, further comprising:

absolute distance acquirement means for measuring a distance from said imaging object and outputting distance information to said camera scan error detection means,

wherein said camera scan error detection means is configures so as to judge a resolution of said partial image in accordance with said distance information, and to output said camera scan error signal to the camera position/posture indication means when the resolutions does not reach a predetermined value.

4. The device according to claim 1, further comprising blurring correction means for estimating a blurring function included in a partial image taken by said imaging device based on said camera position/posture information, and for correcting said partial image supplied from said imaging device in accordance with said blurring function that is estimated to output the partial image to the image joining means.

10. The device according to any one of claims 1 to 9, wherein said image joining means is configured, when a initial camera posture is unknown, to obtain posture information from said partial image series, to obtain a object orientation suitable for ex post facto viewing a object, and to adjust an orientation of a joined image in accordance with the object orientation that is obtained.

5. A wide-field image input device comprising:

an imaging device for continuously imaging an imaging object while the imaging device is manually scanned by a user, and for obtaining a partial image series including a series of partial images;

camera position/posture estimation means, based on the partial image series, for calculating a change state of three-dimensional position and posture of said imaging device as time-series camera position/posture information;

deformation parameter estimation means for calculating a geometrical deformation parameter between adjacent partial images in said partial image series from said camera position/posture information;

image joining means for joining said partial images while a deformation between said partial images is corrected by using said geometrical deformation parameter so as to generate a wide-field image; and

camera scan error detection means for detecting motion of said imaging device according to said camera position/posture information and outputting a camera scan error detection signal when an error is detected in the motion of said imaging device.

6. The device according to claim 5, further comprising camera position/posture indication means, based on said camera position/posture information from said camera position/posture estimation means, for performing one or more of the processes consisting of:

(a) visually indicating a change in a relative position between said imaging device and the imaging object or a change of posture of said imaging device, or the change in the relative position and the change of posture;

(b) displaying warning when said relative position and/or said posture are in levels of having effects on deterioration in a quality of images;

(c) visually displaying a correction amount to indicate which direction and angle and how much said imaging device is corrected for desirable imaging; and

(d) indicating a change amount of said relative position or a change amount of the posture, or both by a tone at a pitch.

7. The device according to claim 5 or 6, wherein said deformation parameter estimation means outputs an imaging available signal to said imaging device when a deformation amount between partial images is within a predetermined value,

wherein said camera scan error detection means outputs said camera scan error detection signal to said imaging device, and

wherein said imaging device is configured so as to perform imaging automatically when said imaging available signal is received and said camera scan error signal is not supplied.

8. The device according to claim 5 or 6, further comprising:

absolute distance acquirement means for measuring a distance from said imaging object and outputting distance information to said camera scan error detection means,

wherein said camera scan error detection means is configured so as to judge a resolution of said partial image in accordance with said distance information, and to output said camera scan error signal to the camera position/posture indication means when the resolutions does not reach a predetermined value.

9. The device according to claim 5, further comprising blurring correction means for estimating a blurring function included in a partial image taken by said imaging device based on said camera position/posture information, and for correcting said partial image supplied from said imaging device in accordance with said blurring function that is estimated to output the partial image to the image joining means.

11. A wide-field image input method that joins a series of partial images obtained by continuously imaging an imaging object by an imaging device while the imaging device is manually scanned by a user, thereby generating a wide-field image, the method comprising the steps of:

receiving a partial image series including said series of partial images, and calculating a change state of three-dimensional position and posture of said imaging device as time-series camera position/posture information;

calculating a geometrical deformation parameter between adjacent partial images in said partial image series from said camera position/posture information;

joining said partial images while a deformation between the partial images is corrected by using said geometrical deformation parameter so as to generate a wide-field image; and

detecting motion of said imaging device according to said camera position/posture information, and outputting a camera scan error detection signal when an error is detected in the motion of said imaging device.

12. A program for making a computer that receives as an inputs a series of partial images obtained by continuously imaging an imaging object by an imaging device while the imaging device is manually scanned by a user, making the computer execute the processes of:

receiving a partial image series including said series of partial images, and calculating a change state of three-dimensional position and posture of said imaging device as time-series camera position/posture information;

calculating a geometrical deformation parameter between adjacent partial images in said partial image series from said camera position/posture information;

joining said partial images while a deformation between the partial images is corrected by using said geometrical deformation parameter so as to generate a wide-field image; and

detecting motion of said imaging device according to said camera position/posture information and outputting a camera scan error detection signal when an error is detected in the motion of said imaging device.

13. A storage medium readable by a computer that receives as inputs a series of partial images obtained by continuously imaging an imaging object by an imaging device while the imaging device is manually scanned by a user, the storage medium stored with a program to make the computer execute processes of:

receiving a partial image series including said series of partial images, and calculating a change state of three-dimensional position and posture of said imaging device as time-series camera position/posture information;

calculating a geometrical deformation parameter between adjacent partial images in said partial image series from said camera position/posture information;

joining said partial images while a deformation between the partial images is corrected by using said geometrical deformation parameter so as to generate a wide-field image; and

detecting motion of said imaging device according to said camera position/posture information and outputting a camera scan error detection signal when an error is detected in the motion of said imaging device.