Generating a synthesized image from a plurality of images
First Claim
1. An image capturing apparatus for generating a synthesized image from a first image and a second image obtained by continuous image-capturing, the image capturing apparatus comprising:
- a displacement detection unit configured to detect a positional displacement between the first image and the second image;
an image-capturing mode determination unit configured to determine whether the first image and the second image were captured in a still image mode;
a control unit configured;
to direct the displacement detection unit to detect the positional displacement between the first image and the second image using a first displacement detection method in response to a determination by the image-capturing mode determination unit that the first image and the second image were captured in the still image mode; and
to direct the displacement detection unit to detect the positional displacement between the first image and the second image using a second displacement detection method in response to a determination by the image-capturing mode determination unit that the first image and the second image were not captured in the still image mode,wherein the second displacement detection method is different from the first displacement detection method, the first displacement method includes the use of local motion vectors to detect the positional displacement between the first image and the second image and the second displacement detection method includes the use of a frame motion vector to detect the positional displacement between the first image and the second image; and
a synthesis unit configured to generate the synthesized image by synthesizing the first image and the second image based on the detected positional displacement.
3 Assignments
0 Petitions
Accused Products
Abstract
A plurality of images is captured, and a positional displacement between the images is determined. The images may be captured as still images or as moving images. Moving images may include, for example, images that are captured as part of the recording of a video or as live image data that is played back in real time. Different positional displacement techniques are be used to determine the positional displacement between the images, based on how the images are captured. For example, a first positional displacement technique may be used if the images are still images and a second positional displacement technique if the images are moving images. The images may then be synthesized images based on the determined positional displacement of the images to generate a synthesized image. The images may be synthesized using a weighted synthesis technique, a simple synthesis technique, or other appropriate synthesis technique.
15 Citations
14 Claims
-
1. An image capturing apparatus for generating a synthesized image from a first image and a second image obtained by continuous image-capturing, the image capturing apparatus comprising:
-
a displacement detection unit configured to detect a positional displacement between the first image and the second image; an image-capturing mode determination unit configured to determine whether the first image and the second image were captured in a still image mode; a control unit configured; to direct the displacement detection unit to detect the positional displacement between the first image and the second image using a first displacement detection method in response to a determination by the image-capturing mode determination unit that the first image and the second image were captured in the still image mode; and to direct the displacement detection unit to detect the positional displacement between the first image and the second image using a second displacement detection method in response to a determination by the image-capturing mode determination unit that the first image and the second image were not captured in the still image mode, wherein the second displacement detection method is different from the first displacement detection method, the first displacement method includes the use of local motion vectors to detect the positional displacement between the first image and the second image and the second displacement detection method includes the use of a frame motion vector to detect the positional displacement between the first image and the second image; and a synthesis unit configured to generate the synthesized image by synthesizing the first image and the second image based on the detected positional displacement. - View Dependent Claims (2, 3, 7, 9, 10, 11, 12)
-
-
4. An image capturing apparatus for generating a synthesized image from a first image and a second image obtained by continuous image-capturing, the image capturing apparatus comprising:
-
a displacement detection unit configured to detect a positional displacement between the first image and the second image; an image-capturing mode determination unit configured to determine whether the first image and the second image were captured in a still image mode; a control unit configured; to direct the displacement detection unit to detect the positional displacement between the first image and the second image using a first displacement detection method in response to a determination by the image-capturing mode determination unit that the first image and the second image were captured in the still image mode; and to direct the displacement detection unit to detect the positional displacement between the first image and the second image using a second displacement detection method in response to a determination by the image-capturing mode determination unit that the first image and the second image were not captured in the still image mode, wherein the second displacement detection method is different from the first displacement detection method; and a synthesis unit configured to generate the synthesized image by synthesizing the first image and the second image based on the detected positional displacement; wherein the synthesis unit is configured to use a first synthesis method for synthesizing the first image and the second image when the first image and the second image were captured in the still image mode, and the synthesis unit is configured to use a second synthesis method for synthesizing the first image and the second image when the first image and the second image were not captured in the still image mode, wherein the second synthesis method and the first synthesis method are different. - View Dependent Claims (5, 6)
-
-
8. An image capturing apparatus for generating a synthesized image from a first image and a second image obtained by continuous image-capturing, the image capturing apparatus comprising:
-
a displacement detection unit configured to detect a positional displacement between the first image and the second image; an image-capturing mode determination unit configured to determine whether the first image and the second image were captured in a still image mode; a control unit configured; to direct the displacement detection unit to detect the positional displacement between the first image and the second image using a first displacement detection method in response to a determination by the image-capturing mode determination unit that the first image and the second image were captured in the still image mode; and to direct the displacement detection unit to detect the positional displacement between the first image and the second image using a second displacement detection method in response to a determination by the image-capturing mode determination unit that the first image and the second image were not captured in the still image mode, wherein the second displacement detection method is different from the first displacement detection method; and a synthesis unit configured to generate the synthesized image by synthesizing the first image and the second image based on the detected positional displacement; wherein the image-capturing mode determination unit is further configured to determine whether the first image and the second image were captured in a movie mode or a live view display mode, and the displacement detection unit is configured; to detect the positional displacement between the first image and the second image using a larger block size when the first image and the second image were captured in the live view display mode, and to detect the positional displacement between the first image and the second image using a smaller block size when the first image and the second image were captured in the movie mode.
-
-
13. A method for generating a synthesized image from a first image and a second image obtained by continuous image-capturing, the method comprising:
-
an image sensor capturing the first image and the second image; determining whether the first image and the second image were captured in a still image mode; detecting a positional displacement between the first image and the second image, wherein the detecting the positional displacement between the first image and the second image is performed using a first displacement detection method when the first image and the second image were captured in the still image mode, and the detecting the positional displacement between the first image and the second image is performed using a second displacement detection method when the first image and the second image were not captured in the still image mode, wherein the second displacement detection method is different from the first displacement detection method, the first displacement method includes the use of local motion vectors to detect the positional displacement between the first image and the second image and the second displacement detection method includes the use of a frame motion vector to detect the positional displacement between the first image and the second image; and generating the synthesized image by synthesizing the first image and the second image based on the detected positional displacement.
-
-
14. A computer-readable medium having processor-executable instructions stored thereon which, when executed by a processor, will cause the processor to perform a method for generating a synthesized image from a first image and a second image obtained by continuous image-capturing, the method comprising:
-
the processor determining whether the first image and the second image were captured in a still image mode; the processor detecting a positional displacement between the first image and the second image, wherein the detecting the positional displacement between the first image and the second image is performed using a first displacement detection method when the first image and the second image were captured in the still image mode, and the detecting the positional displacement between the first image and the second image is performed using a second displacement detection method when the first image and the second image were not captured in the still image mode, wherein the second displacement detection method is different from the first displacement detection method, the first displacement method includes the use of local motion vectors to detect the positional displacement between the first image and the second image and the second displacement detection method includes the use of a frame motion vector to detect the positional displacement between the first image and the second image; and the processor generating the synthesized image by synthesizing the first image and the second image based on the detected positional displacement.
-
Specification