Image processing apparatus, method of processing images, and storage medium

• US 6,810,152 B2
• Filed: 03/21/2001
• Issued: 10/26/2004
• Est. Priority Date: 01/11/2001
• Status: Expired due to Fees

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Endo, Takaaki, Katayama, Akihiro
• Primary Examiner(s): Patel, Kanji
• Application Number:
  US09/812,676
• Publication Number:
  US 20020090143A1
• Time in Patent Office: 1,315 Days
• Field of Search: 382/103, 382/104, 382/106, 382/206, 382/282, 382/284, 382/285, 382/291, 382/294, 382/305, 345/418, 345/653, 345/654, 348/36, 348/39, 348/149, 348/169, 701/25
• US Class Current: 382/284
• CPC Class Codes: G06T 1/00 General purpose image data processing

Abstract

Video cameras capture surrounding images, and time code generated by a time code generator is attached to the images. Likewise, when the respective images are captured, the position and inclination of the car are measured by a GPS, a three-axis angle sensor, and a geomagnetic angle sensor, and attached to the respective images. A panoramic image can be produced by connecting together images having the same time code. Performing the aforementioned signal processing for a plurality of routes provides a series of panoramic images. When presenting a panoramic image to a viewer, a panoramic image that is captured at a point closest to a viewpoint of the viewer is identified so that images can be presented to the viewer according to a view direction of the viewer.

Claims

1. An image processing apparatus, comprising:

a storing unit adapted to store positions where images are captured at each of routes on multidimensional grids using a plurality of imaging units, each of which captures a predetermined view, and a reference direction with respect to which the images are captured, the positions and the reference direction being stored corresponding to the images;

a generating unit adapted to generate a panoramic image using a plurality of images which have been captured by the plurality of imaging units at each of the positions on each of the routes;

a designation unit adapted to designate a desired viewpoint of a viewer and a desired view direction of the viewer; and

a presentation unit adapted to determine an image region according to the view direction of the viewer within a panoramic image corresponding to a point closest to the viewpoint of the viewer, by using the reference direction, and to present to the viewer an image that falls in the image region.

2. The image processing apparatus according to claim 1, further comprising a sync signal generating unit adapted to provide a sync signal to the plurality of imaging units,

wherein the plurality of imaging units capture the images in synchronism with the sync signal.

3. The image processing apparatus according to claim 1, further comprising an index generating unit adapted to generate an index for each of the images captured by each of the plurality of imaging units,

wherein images having a common index are stitched together to form a wide-angle image.

4. The image processing apparatus according to claim 1, wherein the multidimensional grids are two-dimensional grids.

5. The image processing apparatus according to claim 1, wherein said designation unit is a joystick.

6. The image processing apparatus according to claim 1, wherein the positions are determined by a global positioning system.

7. The image processing apparatus according to claim 1, wherein the reference direction with respect to which the images are captured is determined through the use of a geomagnetic angle sensor and a three-axis angle sensor.

8. An image processing method, comprising the steps of:

storing positions where images are captured at each of routes on multidimensional grids using a plurality of imaging units, each of which captures a predetermined view, and a reference direction with respect to which the images are captured, the positions and the reference direction being stored corresponding to the images;

generating a panoramic image using a plurality of images which have been captured by the plurality of imaging units at each of the positions on each of the routes;

designating a desired viewpoint of a viewer and a desired view direction of the viewer; and

determining an image region according to the view direction of the viewer within a panoramic image corresponding to a point closest to the viewpoint of the viewer, by using the reference direction, and presenting to the viewer an image that falls in the image region.

9. A computer readable storage medium storing a program for making a computer implement the image processing method of claim 8.