Method and apparatus for composing a panoramic photograph

• US 20070172151A1
• Filed: 01/24/2006
• Published: 07/26/2007
• Est. Priority Date: 01/24/2006
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Boyd, David, Gennetten, K.
• Granted Patent: US 7,639,897 B2
• Time in Patent Office: Days
• US Class Current: 382/299
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture

Abstract

Methods and apparatus are disclosed for guiding a camera user to take an appropriate set of component photographs to be stitched into a stitched panoramic photograph of a scene. In one example embodiment, the camera constructs and displays a video mosaic while the user sweeps the field of view of the camera over the scene. The camera computes the number and locations of a set of component photographs that will tile the scene, and then guides the user to sweep field of view of the camera over the scene a second time, visiting each component photograph location. A high-resolution component photograph may be taken at each location. Optionally, the camera gathers information from frames used to construct the video mosaic and uses the information to select settings for focus, exposure, or both to be used during the taking of the component photographs.

Claims

1. A method, comprising:

assembling a low-resolution video mosaic of a scene as a field of view of a camera is swept over the scene;

computing the number and locations of a set of high-resolution component photographs that tile the swept scene field of view; and

guiding a user of the camera to sweep the field of view of the camera over the scene a second time so that the location of each of the high-resolution component photographs is visited.

2. The method of claim 1, further comprising taking a high-resolution component photograph at each location.

3. The method of claim 2, wherein each high-resolution component photograph is taken automatically.

4. The method of claim 1, further comprising displaying the low-resolution video mosaic on a display on the camera.

5. The method of claim 4, further comprising dynamically scaling the low-resolution video mosaic to fit the display.

6. The method of claim 1, further comprising stitching the resulting component photographs into a high-resolution stitched panoramic photograph, the stitching performed in the camera.

7. The method of claim 1, further comprising:

gathering information from substantially the entire scene from video frames used in assembling the low-resolution video mosaic;

determining settings for focus, exposure, or both based on the gathered information; and

using the settings in taking the high-resolution component photographs.

8. The method of claim 1, wherein guiding the user further comprises:

indicating on the display the location of each component photograph;

tracking the camera position; and

indicating on the display the current field of view of the camera in relation to the component photograph locations.

9. The method of claim 8, wherein tracking the camera position further comprises analyzing successively captured digital images.

10. The method of claim 1, wherein guiding the user further comprises, for each of the component photographs:

indicating on the display a window at the location of the component photograph to be taken;

displaying in the window the portion of the scene at which the camera is currently aimed.

11. A camera, comprising:

an electronic array light sensor;

a lens that projects an image of a scene onto the electronic array light sensor;

a display; and

logic, the logic configured to

construct a low-resolution video mosaic as the field of view of the camera is swept over the scene;

display the low-resolution video mosaic on the display;

calculate the number and locations of a set of high-resolution component photographs that tile the swept portion of the scene, the high-resolution component photographs to be stitched into a high-resolution panoramic photograph of the scene; and

guide a user of the camera to sweep the field of view of the camera over the scene a second time, visiting the location of each of the component photographs.

12. The camera of claim 11, wherein the logic is further configured to dynamically scale the low-resolution video mosaic on the display.

13. The camera of claim 11, wherein the logic is further configured to take a high- resolution component photograph at each of the locations.

14. The camera of claim 13, wherein the logic is further configured to take a high- resolution component photograph automatically when the camera is aimed substantially at one of the component photograph locations.

15. The camera of claim 11, wherein the logic is further configured to:

track motion of the camera during the second sweep; and

indicate on the display the locations of the component photographs; and

indicate on the display where the camera is aimed in relation to the component photograph locations.

16. The camera of claim 15, wherein the logic is further configured to track camera motion by analysis of successively captured digital images.

17. The camera of claim 11, wherein the logic is further configured to, during the second sweep and for each of the component photographs:

indicate on the display a window at the component photograph location; and

repetitively show in the window the portion of the scene at which the camera is currently aimed.

18. The camera of claim 11, the logic further configured to:

gather information about substantially the entire scene from video frames used to construct the video mosaic;

compute settings for focus, exposure, or both from the gathered information; and

use the settings in taking the component photographs.

19. A method of taking component photographs to be stitched into a panoramic photograph, comprising:

a first phase during which a field of view of a camera is swept over a scene by a user and the camera constructs a low-resolution video mosaic of the swept scene field of view; and

a second phase during which the camera guides the user to sweep the camera field of view over the scene a second time, visiting locations of each of a set of component photographs that cover, with appropriate overlap, the field of view swept in the first phase.

20. The method of claim 19, further comprising:

displaying the low-resolution video mosaic on a display on the camera;

taking repetitive digital photographs after the first phase is complete;

using the repetitive digital photographs and the display to guide the user during the second phase sweep.