System and method for displaying an image indicating a positional relation between partially overlapping images

• US 7,529,430 B2
• Filed: 01/30/2007
• Issued: 05/05/2009
• Est. Priority Date: 09/10/1997
• Status: Expired due to Fees

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Haike, Guan, Sakamoto, Takuji, Ejiri, Koichi, Aoki, Shin, Saitoh, Takashi
• Primary Examiner(s): Kassa; Yosef
• Application Number:
  US11/668,511
• Publication Number:
  US 20070122059A1
• Time in Patent Office: 826 Days
• Field of Search: 382/284, 382/293, 382/294, 382/296, 358/538, 358/450, 358/453, 348/50, 348/94, 348/95, 348/36
• US Class Current: 382/284
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2200/32 involving image mosaicing
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/20021 Dividing image into blocks, subimages or windows
• CPC Class Codes: G06T 7/223 using block-matching
• CPC Class Codes: G06T 7/30 Determination of transform parameters for the alignment of images, i.e. image registration
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure
• CPC Class Codes: H04N 5/907 using static stores, e.g. storage tubes or semiconductor memories H04N5/91 takes precedence

Abstract

A device includes a display monitor configured to display on a screen of the display monitor at least one of a current image and a preceding image taken by an optical unit, a storage unit configured to store the preceding image, and a control unit configured to display a part of the preceding image on the screen when the current image is displayed on the screen, the displayed part of the preceding image indicating a positional relationship between the current image and the preceding image. The current image is taken when the displayed part of the preceding image substantially overlaps a corresponding portion of the current image such that the current image and the preceding image can be processed to form a panoramic image.

Claims

1. A camera, comprising:

a display monitor configured to display on a screen of the display monitor at least one of a current image and a preceding image taken by an optical unit;

a storage unit configured to store the preceding image;

a control unit configured to display a part of the preceding image on the screen when the current image is displayed on the screen, the displayed part of the preceding image indicating a positional relationship between the current image and the preceding image, the control unit further configured to display a vector indicating a magnitude and direction on the display monitor which is determined using a displacement between the preceding image and the current image; and

a housing configured to support the display monitor, the storage unit, and the control unit which are part of the camera,

wherein the current image is taken when the displayed part of the preceding image substantially overlaps a corresponding portion of the current image such that the current image and the preceding image can be processed to form a panoramic image.

2. A camera according to claim 1, wherein the control unit is configured to display the vector on the display monitor which indicates a positional relationship between the current image and the preceding image.

3. A camera, comprising:

a display monitor configured to display on a screen of the display monitor at least one of a current image and a preceding image taken by an optical unit;

a storage unit configured to store the preceding image;

a control unit configured to display a part of the preceding image on the screen when the current image is displayed on the screen, the displayed part of the preceding image indicating a positional relationship between the current image and the preceding image, the control unit further configured to display a vector indicating a magnitude and direction on the display monitor which is determined using a displacement between the preceding image and the current image;

a mode selection switch configured to allow selection between operational modes of the device; and

a housing configured to support the display monitor, the storage unit, the control unit, and the mode selection switch.

4. The camera of claim 3, wherein the mode selection switch allows selection between a normal shooting mode and a divisional shooting mode.

5. A camera according to claim 3, wherein the control unit is configured to display the vector on the display monitor which indicates a positional relationship between the current image and the preceding image.

6. A camera, comprising:

a display monitor configured to display on a screen of the display monitor at least one of a current image and a preceding image taken by an optical unit;

a storage unit configured to store the preceding image;

a control unit configured to display a part of the preceding image on the screen when the current image is displayed on the screen, the displayed part of the preceding image indicating a positional relationship between the current image and the preceding image, the control unit further configured to display a vector indicating a magnitude and direction on the display monitor which is determined using a displacement between the preceding image and the current image; and

a housing configured to support the display monitor, the storage unit, and the control unit, wherein,

the preceding image is captured when the camera is in a first position, and

the camera is panned in a desired direction such that the camera is in a second position to capture the current image.

7. The camera of claim 6, wherein the second position is selected such that the displayed part of the preceding image overlaps a corresponding portion of the current image.

8. A camera according to claim 6, wherein the control unit is configured to display the vector on the display monitor which indicates a positional relationship between the current image and the preceding image.

9. A method of capturing overlapping images using a camera, comprising:

capturing a first image when a lens of the camera is in a first position;

storing the first image;

moving the lens to a second position;

displaying on a display of the camera at least a part of the first image aligned with at least a part of a second image;

displaying a vector indicating a magnitude and direction on the display monitor which is determined using a displacement between the preceding image and the current image; and

capturing the second image.

10. The method of claim 9, wherein the step of moving the lens includes panning the lens from the first position to the second position.

11. The method of claim 9, wherein the step of moving the lens includes moving the lens up, down, right, left, or in a slanted direction from the first position to the second position.

12. A camera according to claim 9, wherein the means for processing is for displaying the vector on the display which indicates a positional relationship between the first image and the second image.

13. A camera, comprising:

an image sensor;

a display;

a memory, connected to the image sensor, for storing images from the image sensor;

a processing system, connected to the display, the memory, and the image sensor, configured to display at least part of a first image from the memory on the display while simultaneously displaying at least part of a second image on the display so that a user can align the displayed at least part of the second image with the displayed at least part of the first image, the processing system further configured to display a vector indicating a magnitude and direction on the display which is determined using a displacement between the first image and the second image;

a shutter release button configured to allow the user to capture the second image while the displayed at least part of the first image and the displayed part of the at least second image are simultaneously displayed; and

a housing of the camera which is configured to support the image sensor, the display, the memory, and the processing system,

wherein the processing system is further configured to process the first and second images into a panoramic image, after the first and second images are captured.

14. The camera according to claim 13, further comprising:

a mode selection input device which indicates to the processing system that images are to be captured which will subsequently be processed to create a panoramic image.

15. A camera according to claim 13, wherein the processing system is configured to display the vector on the display which indicates a positional relationship between the first image and the second image.

16. A camera, comprising:

an image sensor;

a display;

a memory, connected to the image sensor, for storing images from the image sensor;

means for processing, connected to the display, the memory, and the image sensor, for generating a display of at least part of a first image from the memory on the display while simultaneously generating a display of at least part of a second image on the display so that a user can align the displayed at least part of the second image with the displayed at least part of the first image, the means for processing further for displaying a vector indicating a magnitude and direction on the display which is determined using a displacement between the first image and the second image;

a shutter release button configured to allow the user to capture the second image while the displayed at least part of the first image and the displayed part of the at least second image are simultaneously displayed;

means for processing the first and second images into a panoramic image, after the first and second images are captured; and

a housing of the camera which is configured to support the image sensor, the display, the memory, and the means for processing.

17. The camera according to claim 16, further comprising:

a mode selection input device which indicates to the processing system that images are to be captured which will subsequently be processed to create a panoramic image.

18. A camera according to claim 16, wherein the means for processing is for displaying the vector on the display which indicates a positional relationship between the first image and the second image.

19. A method of operating a digital camera, comprising:

viewing a first image;

capturing the first image;

displaying at least part of the first image;

setting, prior to displaying at least part of a second image, a mode to indicate that images which are to form a composite panoramic image are to be captured;

displaying, simultaneous to the displaying of the at least part of the first image, at least part of the second image so that the at least part of the second image can be aligned with the displayed at least part of the first image, and displaying a vector indicating a magnitude and direction on the display which is determined using a displacement between the preceding image and the current image, the displaying being done a display of the digital camera which is supported by a housing of the digital camera;

capturing the second image and

processing, by the digital camera, the captured first and second images into the composite panoramic image.

20. A method according to claim 19, wherein the displaying a vector on the display monitor comprises:

displaying a vector which indicates a positional relationship between the first image and the second image.