System and method for displaying an image indicating a positional relation between partially overlapping images

• US 8,681,228 B2
• Filed: 03/27/2009
• Issued: 03/25/2014
• Est. Priority Date: 09/10/1997
• Status: Expired due to Fees

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Ejiri, Koichi, Aoki, Shin, Saitoh, Takashi, Haike, Guan, Sakamoto, Takuji
• Primary Examiner(s): Tran, Sinh
• Assistant Examiner(s): Peterson, Christopher K
• Application Number:
  US12/413,053
• Publication Number:
  US 20090185054A1
• Time in Patent Office: 1,824 Days
• Field of Search: 348/239, 348/208.3, 348/231.3
• US Class Current: 348/208.3
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2200/32 involving image mosaicing
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/20021 Dividing image into blocks, subimages or windows
• CPC Class Codes: G06T 7/223 using block-matching
• CPC Class Codes: G06T 7/30 Determination of transform parameters for the alignment of images, i.e. image registration
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure
• CPC Class Codes: H04N 5/907 using static stores, e.g. storage tubes or semiconductor memories H04N5/91 takes precedence

Abstract

A device includes a display monitor configured to display on a screen of the display monitor at least one of a current image and a preceding image taken by an optical unit, a storage unit configured to store the preceding image, and a control unit configured to display a part of the preceding image on the screen when the current image is displayed on the screen, the displayed part of the preceding image indicating a positional relationship between the current image and the preceding image. The current image is taken when the displayed part of the preceding image substantially overlaps a corresponding portion of the current image such that the current image and the preceding image can be processed to form a panoramic image.

Claims

1. An image capture device, comprising:

a video control unit configured to store a digital image with corresponding auxiliary data;

a control unit configured to display a part of the digital image on a screen of a display monitor when a second digital image is displayed on the screen, the displayed part of the digital image indicating a positional relationship between the second digital image and the digital image; and

a processing unit configured to add a frame number and a displacement vector indicating the positional relationship between the second digital image and the digital image, associated with the digital image to the auxiliary data, the displacement vector corresponding to a panning of the image capture device, the frame number identifying the digital image among a plurality of digital images stored in an image memory, and configured to generate a synthesized image based on the digital image, the second digital image, and the auxiliary data,

wherein, after the digital image is stored with the auxiliary data, the processing unit causes the control unit to display on the screen of the display monitor the displacement vector and a shifted position of the digital image which is determined by a magnitude and direction of the displacement vector which corresponds to the panning.

2. The image capture device of claim 1, wherein the video control unit includes,

a first frame buffer configured to store the digital image, and

a second frame buffer configured to store the auxiliary data.

3. The image capture device of claim 1, wherein at least two of the plurality of the digital images stored in the image memory include corresponding, overlapping portions.

4. The image capture device of claim 1, wherein the image capture device is a camera.

5. The image capture device of claim 1, wherein:

the positional relationship between the second digital image and the digital image is displayed as an arrow indicating a desired movement of the image capture device.

6. The image capture device of claim 1, wherein the shifted position of the digital image displayed on the screen of the display monitor by the control unit is an image of a peripheral boundary of the digital image at said shifted position.

7. A method of processing images, comprising:

storing a digital image with corresponding auxiliary data;

displaying a part of the digital image on a monitor, a second digital image, and a positional relationship between the second digital image and the digital image;

generating auxiliary data which includes a displacement vector indicating the positional relationship between the second digital image and the digital image, and which includes a frame number identifying digital image among a plurality of digital images stored in a memory, the displacement vector corresponding to a panning of an image capture device performed by an operator; and

generating a synthesized image using the digital image, the second digital image, and the auxiliary data,

wherein, after the digital image is stored with the auxiliary data, there is a display on the monitor of the displacement vector and of a shifted position of the digital image which is determined by a magnitude and direction of the displacement vector which correspond to the panning.

8. The method of claim 7, further comprising:

storing the digital image in a first frame buffer; and

storing the auxiliary data in a second frame buffer.

9. The method of claim 7, wherein the digital image and the second digital image overlap each other.

10. The method of claim 7, further comprising:

capturing the digital image and the second digital image using a camera,

wherein the camera performs the storing, the displaying and the generating.

11. The method of claim 7, wherein the shifted position of the digital image displayed on the monitor is an image of a peripheral boundary of the digital image at said shifted position.

12. A non-transitory computer-readable medium storing instructions which when executed by a processor cause the following:

storing a digital image with corresponding auxiliary data;

displaying a part of the digital image on a monitor, a second digital image, and a positional relationship between the second digital image and the digital image;

generating auxiliary data which includes a displacement vector indicating the positional relationship between the second digital image and the digital image, and which includes a frame number identifying digital image among a plurality of digital images stored in a memory, the displacement vector corresponding to a panning of an image capture device performed by an operator; and

generating a synthesized image using the digital image, the second digital image, and the auxiliary data,

wherein, after the digital image is stored with the auxiliary data, there is a display on the monitor of the displacement vector and of a shifted position of the digital image which is determined by a magnitude and direction of the displacement vector which correspond to the panning.

13. The non-transitory computer-readable medium according to claim 12, which when executed by the processor cause:

storing the digital image in a first frame buffer; and

storing the auxiliary data in a second frame buffer.

14. The non-transitory computer-readable medium according to claim 12, wherein the digital image and the second digital image overlap each other.

15. The non-transitory computer-readable medium according to claim 12, wherein the instructions further cause:

capturing the digital image and the second digital image using a camera.

16. The non-transitory computer-readable medium according to claim 12, wherein the shifted position of the digital image displayed on the monitor is an image of a peripheral boundary of the digital image at said shifted position.