Image processing method and apparatus therefor

• US 5,727,093 A
• Filed: 02/06/1996
• Issued: 03/10/1998
• Est. Priority Date: 02/07/1995
• Status: Expired due to Term

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Yamamoto, Hiroyuki, Uchiyama, Shinji
• Primary Examiner(s): COUSO, YON JUNG
• Application Number:
  US08/597,699
• Time in Patent Office: 763 Days
• Field of Search: 382/293, 382/294, 382/284, 382/154, 358/450, 348/48, 348/36
• US Class Current: 382/294
• CPC Class Codes: G06T 3/147 using affine transformations

Abstract

In order to obtain a field angle wider than that determined by a lens of a photographing apparatus by means of image processing, a given image is selected as a reference image from a still image train acquired by photographing an object by time-serially changing the visual point position and direction, a procedure for coordinate-transforming specific points in the respective images onto a two-dimensional coordinate system identical to that of the reference image is derived, a two-dimensional space is Voronoi-divided in correspondence with the specific points based on the derived procedure, the respective images are coordinate-transformed using a coordinate transform procedure for transforming the respective images to the reference images, and the coordinate information of each of the coordinate-transformed images is inserted in one of the Voronoi domains including the specific points of the respective images.

Claims

1. An image processing method executing:

image input processing for inputting a still image train obtained by photographing an object while time-serially changing a visual point position and direction;

reference image determination processing for determining one image of the still image train input by the image input processing as a reference image;

specific point selection processing for selecting, as specific points, identical points photographed in two adjoining images of images constituting the still image train;

first procedure derivation processing for deriving a procedure for coordinate-transforming one of the adjoining images to the other image so that the specific points selected in the specific point selection processing match each other between the adjoining images;

second procedure derivation processing for deriving a procedure for coordinate-transforming the specific points transformed by the procedure derived by the first procedure derivation processing onto a two-dimensional coordinate system identical to a two-dimensional coordinate system of the reference image;

division processing for dividing a two-dimensional space to which the reference image belongs into a plurality of domains in correspondence with the specific points transformed by the procedure derived by the second procedure derivation processing;

coordinate transformation processing for coordinate-transforming the images of the still image train onto the two-dimensional space to which the reference image belongs; and

wide angle image production processing for producing a single image as a whole by inserting coordinate information of each of the images coordinate-transformed onto the two-dimensional space to which the reference image belongs into each of the divided domains divided in correspondence with the specific points of the images.

2. An image processing method comprising:

the first step of inputting a still image train obtained by photographing an object while time-serially changing a visual point position and direction;

the second step of selecting one image from the still image train as a reference image;

the third step of deriving a coordinate transformation procedure for transforming one of adjoining images to the other image so that pixels correspond to each other between the adjoining images in the still image train;

the fourth step of deriving a coordinate transformation procedure for transforming the respective images to the reference image using the coordinate transformation procedure derived in the third step;

the fifth step of transforming specific points in the respective images to a two-dimensional coordinate system identical to a two-dimensional coordinate system of the reference image using the coordinate transformation procedure derived in the fourth step;

the sixth step of Voronoi-dividing a two-dimensional space on the basis of the specific points which are transformed to the two-dimensional coordinate system identical to the two-dimensional coordinate system of the reference image;

the seventh step of coordinate-transforming the respective images using a coordinate transformation procedure for transforming the respective images to the reference image; and

the eighth step of producing a single image by inserting coordinate information of each of the coordinate-transformed images into each of Voronoi domains including specific points of the images.

3. A method according to claim 2, wherein a distance used upon calculation of territories of the respective divided domains in the sixth step is a two-dimensional Euclidean distance.

4. A method according to claim 2, wherein a distance used upon calculation of territories of the respective divided domains in the sixth step is a distance derived from a calculation formula taking elements other than a two-dimensional Euclidean distance into consideration.

5. An image processing apparatus comprising:

image input means for inputting a still image train obtained by photographing an object while time-serially changing a visual point position and direction;

reference image selection means for selecting one image from the still image train as a reference image;

first derivation means for deriving a coordinate transformation procedure for transforming one of adjoining images to the other image so that pixels correspond to each other between the adjoining images in the still image train;

second derivation means for deriving a coordinate transformation procedure for transforming the respective images to the reference image using the coordinate transformation procedure derived by said first derivation means;

first coordinate transformation means for transforming specific points in the respective images to a two-dimensional coordinate system identical to a two-dimensional coordinate system of the reference image using the coordinate transformation procedure derived by said second derivation means;

Voronoi division means for Voronoi-dividing a two-dimensional space on the basis of the specific points which are transformed to the two-dimensional coordinate system identical to the two-dimensional coordinate system of the reference image;

second coordinate transformation means for coordinate-transforming the respective images using a coordinate transformation procedure for transforming the respective images to the reference image; and

wide angle image production means for producing a single image by inserting coordinate information of each of the coordinate-transformed images into each of Voronoi domains including specific points of the images.

6. An apparatus according to claim 5, wherein a distance used upon calculation of territories of the respective divided domains in said Voronoi division means is a two-dimensional Euclidean distance.

7. An apparatus according to claim 5, wherein a distance used upon calculation of territories of respective divided domains in said Voronoi division means is a distance derived from a calculation formula taking elements other than a two-dimensional Euclidean distance into consideration.