PANORAMA IMAGING USING SUPER-RESOLUTION

• US 20110141229A1
• Filed: 12/11/2009
• Published: 06/16/2011
• Est. Priority Date: 12/11/2009
• Status: Abandoned Application

• Current Assignee: DigitalOptics Corporation Europe Limited (Adeia, Inc.)
• Original Assignee: FotoNation Ireland Limited (Adeia, Inc.)
• Inventors: Murray, Larry, Stec, Piotr, Drimbarean, Alexandru, Corcoran, Peter, Barcovschi, Igor
• Application Number:
  US12/636,629
• Publication Number:
  US 20110141229A1
• Time in Patent Office: Days
• US Class Current: 348/37
• CPC Class Codes: H04N 2101/00 Still video cameras
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 23/951 by using two or more images to influence resolution, frame rate or aspect ratio
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation

Abstract

A technique of generating a panoramic image involves acquiring a set of at least two main image frames, as well as corresponding generating and/or acquiring corresponding relatively low-resolution image frames, of overlapping portions of a panoramic scene. A map or other information is stored relating to the generation of a low-res panorama. A main panorama image is formed by joining main image frames based on the map or other information gained in the low-res process.

Claims

1. A method for generating a panorama image using a portable imaging device, said method comprising:

fixing an exposure level for acquiring the panorama image with the portable imaging device;

palming the imaging device across a panoramic scene;

acquiring two or more sets each including at least two image frames of portions of said panoramic scene and processing said set, said acquiring comprising using an optic and imaging sensor of the portable imaging device, said processing including,

sorting and retaining multiple images of the two or more sets;

determining a relative displacement between each pair of neighboring frames within each of said two or more sets of image frames;

registering images within each of said image sets relative to one another;

joining each of said two or more sets to form two or more substantially overlapping panorama images;

combining said two or more substantially overlapping panorama images to form a higher resolution panorama image of substantially the same scene; and

storing, transmitting or displaying said relatively high resolution panorama image.

2. The method of claim 1, wherein said combining of said two or more substantially overlapping panorama images comprises applying a super-resolution technique.

3. The method of claim 2, further comprising cropping the higher resolution panorama image including removing one or more non-overlapping regions from one or more component panorama images.

4. The method of claim 1, further comprising determining a relative displacement between a first or otherwise corresponding acquired frame of each of said two or more sets of image frames.

5. The method of claim 4, further comprising registering a combined panoramic image derived from images of each of said two or more sets.

6. The method of claim 1, wherein the acquiring comprises acquiring a set of at least three low resolution image frames of portions of said scene.

7. The method of claim 1, wherein the acquiring comprises acquiring a set of at least four low resolution image frames of portions of said scene.

8. The method of claim 1, further comprising interleaving joining of pairs of image frames with acquiring or generating, or both, of next image frames.

9. A portable camera-enabled device capable of in-camera generation of a panorama image, comprising:

a lens;

an image sensor;

a processor; and

a processor readable medium having code embedded therein for programming the processor to perform a panorama image generation method that comprises;

fixing an exposure level for acquiring the panorama image with the portable imaging device;

panning the imaging device across a panoramic scene;

acquiring two or more sets each including at least two image frames of portions of said panoramic scene and processing said set, said acquiring comprising using an optic and imaging sensor of the portable imaging device, said processing including,

sorting and retaining multiple images of the two or more sets;

determining a relative displacement between each pair of neighboring frames within each of said two or more sets of image frames;

registering images within each of said image sets relative to one another;

joining each of said two or more sets to form two or more substantially overlapping panorama images;

combining said two or more substantially overlapping panorama images to form a higher resolution panorama image of substantially the same scene; and

storing, transmitting or displaying said relatively high resolution panorama image.

10. The device of claim 9, wherein said combining of said two or more substantially overlapping panorama images comprises applying a super-resolution technique.

11. The device of claim 10, wherein the method further comprises cropping the higher resolution panorama image including removing one or more non-overlapping regions from one or more component panorama images.

12. The device of claim 9, wherein the method further comprises determining a relative displacement between a first or otherwise corresponding acquired frame of each of said two or more sets of image frames.

13. The device of claim 12, wherein the method further comprises registering a combined panoramic image derived from images of each of said two or more sets.

14. The device of claim 9, wherein the acquiring comprises acquiring a set of at least three low resolution image frames of portions of said scene.

15. The device of claim 9, wherein the acquiring comprises acquiring a set of at least four low resolution image frames of portions of said scene.

16. The device of claim 9, wherein the method further comprises interleaving joining of pairs of image frames with acquiring or generating, or both, of next image frames.

17. One or more processor-readable storage media having code embedded therein for programming a processor to perform a method for generating a panorama image using a portable imaging device, said method comprising:

fixing an exposure level for acquiring the panorama image with the portable imaging device;

panning the imaging device across a panoramic scene;

acquiring two or more sets each including at least two image frames of portions of said panoramic scene and processing said set, said acquiring comprising using an optic and imaging sensor of the portable imaging device, said processing including,

sorting and retaining multiple images of the two or more sets;

determining a relative displacement between each pair of neighboring frames within each of said two or more sets of image frames;

registering images within each of said image sets relative to one another;

joining each of said two or more sets to form two or more substantially overlapping panorama images;

combining said two or more substantially overlapping panorama images to form a higher resolution panorama image of substantially the same scene; and

storing, transmitting or displaying said relatively high resolution panorama image.

18. The one or more processor-readable storage media of claim 17, wherein said combining of said two or more substantially overlapping panorama images comprises applying a super-resolution technique.

19. The one or more processor-readable storage media of claim 18, wherein the method further comprises cropping the higher resolution panorama image including removing one or more non-overlapping regions from one or more component panorama images.

20. The one or more processor-readable storage media of claim 17, wherein the method further comprises determining a relative displacement between a first or otherwise corresponding acquired frame of each of said two or more sets of image frames.

21. The one or more processor-readable storage media of claim 20, wherein the method further comprises registering a combined panoramic image derived from images of each of said two or more sets.

22. The one or more processor-readable storage media of claim 17, wherein the acquiring comprises acquiring a set of at least three low resolution image frames of portions of said scene.

23. The one or more processor-readable storage media of claim 17, wherein the acquiring comprises acquiring a set of at least four low resolution image frames of portions of said scene.

24. The one or more processor-readable storage media of claim 17, wherein the method further comprises interleaving joining of pairs of image frames with acquiring or generating, or both, of next image frames.