Method and apparatus for capturing a multidimensional array of overlapping images for composite image generation

• US 6,657,667 B1
• Filed: 11/25/1997
• Issued: 12/02/2003
• Est. Priority Date: 11/25/1997
• Status: Expired due to Fees

• Current Assignee: FlashPoint Technology, Inc.
• Original Assignee: FlashPoint Technology, Inc.
• Inventors: Anderson, Eric C.
• Primary Examiner(s): HO, TUAN V
• Application Number:
  US08/978,034
• Time in Patent Office: 2,198 Days
• Field of Search: 348/36, 348/42, 348/47, 348/50, 348/218, 348/333, 348/588, 348/333.01, 348/333.02, 348/333.05, 348/333.11, 348/333.12, 348/39, 348/143, 382/284, 382/294, 396/19-24, 396/296, 396/373, 396/377, 396/378, 396/381
• US Class Current: 348/333.12
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/65 Control of camera operation in relation to power supply
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 5/262 Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects

Abstract

A method and apparatus for capturing a multidimensional array of overlapping images for composite image generation using a camera that includes a viewfinder. This is accomplished by providing a composite image format comprising an N×M array of overlapping images, and allowing the user to sequentially capture the images in the array. When the user attempts to capture one of the images in the array, the overlap ping areas of previously captured images are displayed in the viewfinder to enable the user to align the next image to be captured in the array with the previously captured images.

Claims

1. A method for capturing a multidimensional array of overlapping images for composite image generation using a camera that includes a viewfinder, method comprising the steps of:

a) displaying to a user a plurality of composite image formats comprising N×

M arrays of image panes;

b) allowing the user to select a composite image format from the plurality of composite image formats;

c) allowing the user to sequentially capture the images in the array; and

d) in response to the user capturing one of the images in the array, displaying overlapping areas of previously captured images in the array in the viewfinder to enable the user to align the next image to be captured in the array with the previously captured images.

2. A method as in claim 1 wherein step c) further includes the steps of:

c1) selecting a first image in the N×

M array to capture;

c2) capturing the first image; and

c3) selecting a second image in the N×

M array to capture, wherein the second image overlaps the first image in the N×

M array.

3. A method as in claim 2 wherein the viewfinder is bounded by four edges, step d) further including the steps of:

d1) dividing the viewfinder into a first and a second zone in response to the user capturing the first image, wherein the first zone is adjacent to one of the four edges of the viewfinder;

d2) displaying a portion of the first image that is to overlap with the second image in the first zone; and

d3) displaying a live view of the second image in the second zone to enable the user to align the second image with the first image.

4. A method as in claim 3 further including the step of:

repeating steps c) through d) until all the images in the N×

M array have been captured.

5. A method as in claim 4 further including the steps of:

storing the captured images of the N×

M array in an image file; and

stitching the captured images to generated the composite image.

6. A method for capturing a multidimensional array of overlapping images for composite image generation using a camera, wherein the camera includes a viewfinder that is bounded by four edges, the method comprising the steps of:

a) providing a composite image format comprising an N×

M array of image panes corresponding to a relative position of overlapping images, wherein each image pane overlaps at least two other image panes in the image format, and a current image pane corresponds to a position of an image to be captured;

b) selecting a first image in the N×

M array to capture;

c) capturing the first image;

d) selecting a second image in the N×

M array to capture, wherein the second image overlaps the first image in the N×

M array;

e) determining how many (x) captured images overlap with the current pane and dividing the viewfinder into x zones and a live view zone, wherein each of the x zones is adjacent to one of the four edges of the viewfinder;

f) displaying portions of the overlapping images in their corresponding zones;

g) displaying a live view of the second image in the live view zone to enable the user to align the second image with the first image;

h) capturing the second image;

i) selecting a third image in the N×

M array to capture, wherein the third image overlaps with either the first image or the second image in the N×

M array; and

j) repeating steps c) through i) until all the images in the N×

M array have been captured.

7. A method as in claim 6 wherein step e) further includes the step of:

e1) indicating boundaries between the x zones and the live view zone in the viewfinder using contiguously shaped lines.

8. A method as in claim 7 wherein step a) further includes the step of:

a1) displaying a menu of a plurality of N×

M composite image array formats from which a user may select.

9. A method as in claim 8 wherein step a) further includes the step of:

a2) entering values for N and M in order to select the composite image format.

10. A method as in claim 8 wherein step b) further includes the step of:

b1) setting the first image to capture as a default.

11. A method as in claim 8 wherein step b) further includes the step of:

b1) allowing the user to manually select the first image to capture.

12. A method as in claim 8 wherein step c) further includes the steps of:

c1) associating tags necessary for stitching with each captured image, wherein the tags include any combination of a designation of the composite image format, an identification of which image panes each captured image corresponds to, an order of image capture, a percentage of overlap, and a lens field of view; and

c2) storing each captured image in a first file.

13. A method as in claim 6 wherein step e) further includes the step of:

e1) translucently displaying portions of the overlapping images over the live view image.

14. A digital camera comprising:

an imaging device for capturing image data;

a memory for storing the image data from the imaging device;

a viewfinder bounded by four edges; and

processing means coupled to the imaging device, the memory and to the viewfinder, the processing means including

means for providing a composite image format comprising an N×

M array of image panes corresponding to a relative position of overlapping images, wherein each image pane overlaps at least two other image panes in the image format, and a current image pane corresponds to a position of an image to be captured;

means for selecting a first image in the N×

M array to capture, means for capturing the first image,

means for selecting a second image in the N×

M array to capture, wherein the second image overlaps the first image in the N×

M array,

means for dividing the viewfinder into a first and a second zone in response to the user capturing the first image, wherein the first zone is adjacent to one of the four edges of the viewfinder,

means for displaying a portion of the first image that is to overlap with the second image in the first zone,

means for displaying a live view of the second image in the second zone to enable the user to align the second image with the first image,

means for determining a number (x) of previously captured images that overlap the current pane, and means for dividing the viewfinder into the (x) number of zones and a live view zone, and

means for displaying portions of the overlapping images in their corresponding zones.

15. The invention of claim 14 wherein the processor further includes means for indicating boundaries between the (x) number of zones and the live view zone in the viewfinder using contiguously shaped lines.

16. The invention of claim 15 wherein the processor further includes means for allowing a user to enter values for N and M so that the user can select the composite image format.

17. The invention of claim 14 wherein the processor further includes means for translucently displaying portions of the overlapping images over the live view image.

18. The invention of claim 14 wherein the processor further includes means for displaying a menu of a plurality of N×

M composite image array formats from which a user may select.

19. The invention of claim 18 wherein the processor further includes means for allowing the user to manually select the first image to capture.

20. The invention of claim 18 wherein the processor further includes means for storing tags with each captured image, wherein the tags include a information necessary for stitching, the information including any combination of;

a designation of the composite image format,

an identification of which image pane the captured images correspond to,

an order of image capture,

a percentage of image overlap, and

a lens field of view.

21. The invention of claim 18 wherein the memory includes an input buffer and a frame buffer, and wherein the input buffer stores the image data from imaging device, the processing means functioning to perform color space conversion on the image data to provide processed image data, and to store the processed image data in the frame buffer for output to the viewfinder.

22. The invention of claim 21 wherein the frame buffer is divided into the (x) number of zones and the live view zone corresponding to the zones in the viewfinder, wherein the overlapping areas of previously captured images are transferred from memory to their respective zones in the frame buffer.

23. The invention of claim 22 wherein during a live view mode, the input buffer is divided into the (x) number of zones and the live view zone corresponding to the zones in the viewfinder, and wherein image data from the live view zone in the input buffer is transferred to the live view zone in the frame buffer for display.

24. The invention of claim 23 wherein the processing means comprises a software program.

25. The invention of claim 23 wherein the processing means comprises hardware.

26. The invention of claim 23 wherein the processing means comprises a combination of software and hardware.

27. The invention of claim 23 wherein the input buffer and frame are ping-pong buffers.

28. The invention of claim 18 wherein the processor further includes means for setting the first image to capture as a default.