Annular view for panorama image

• US 9,888,173 B2
• Filed: 12/06/2012
• Issued: 02/06/2018
• Est. Priority Date: 12/06/2012
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Zhang, Lei, Zou, Xuan, Ling, Fan
• Primary Examiner(s): Navas, Jr., Edemio
• Application Number:
  US14/442,837
• Publication Number:
  US 20150296141A1
• Time in Patent Office: 1,888 Days
• Field of Search: None
• CPC Class Codes: G03B 37/02 with scanning movement of lens or cameras
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture

Abstract

A device (300) for displaying panoramic images includes an image sensor (315), a panoramic display module (345) and a display (325). The display (110, 200) displays an annular panorama view (120, 210). The annular view (120, 210) may be an incomplete annulus for illustrating a missing view angle (126) from an incomplete panoramic image. The display (200) further includes a window (220) and a high resolution display portion (240). The window (220) bounds a portion (230) of the annular view (210). The high resolution display portion (240) displays a high resolution image corresponding to the portion (230) of the annular view (210). The window (220) is movable around the annular view (210). A size of the window (220) or the high resolution display portion (240) is adjustable. A method for generating a panoramic image is also provided.

Claims

1. A system for displaying panoramic images comprising:

an image sensor configured to capture a panoramic image of a scene of interest;

a processor configured to;

read the captured panoramic image,

identify a missing portion of the panoramic image,

form an annular configuration of the panoramic image, wherein the annular configuration comprises an incomplete annulus including an arc representing a range of view covered by the panoramic image, the arc including a first arc cutoff edge and a second arc cutoff edge bounding a missing view angle representing the missing portion of the panoramic image,

receive selection by a user of an option to capture additional image data representing the missing portion of the panoramic image,

detect first and second edges of the missing portion of the panoramic view, the first and second edges corresponding to the first arc cutoff edge and the second arc cutoff edge, respectively,

generate a panorama completion user interface using the first edge,

receive the additional image data representing the missing portion of the panoramic image,

stitch the additional image data representing the missing portion into the panoramic image,

update the annular configuration based on the stitching to include a complete annulus of the panoramic image, and

output the complete annulus to a display; and

the display configured to display the annular configuration of the panoramic image.

2. The system of claim 1, wherein the processor is further configured to output to the display:

a window configured to bound a portion of the arc of the annular configuration; and

a high resolution display portion configured to display a rectangular image, wherein the rectangular image corresponds to the portion of the arc of the annular configuration.

3. The system of claim 2, wherein the window is movable around the arc of the annular configuration.

4. The system of claim 2, wherein a size of the window or the high resolution display portion is adjustable.

5. The system of claim 3, wherein the rectangular image is updated to correspond to the portion of the arc of the annular configuration bound by the window.

6. The system of claim 1, wherein the display comprises a touch screen, an LCD screen, or an LED screen.

7. A method for generating a panoramic image of a scene, the method comprising:

receiving image data representing a plurality of images of a scene of interest from an image sensor;

combining the plurality of images into a panoramic view of the scene of interest;

identifying a missing portion of the panoramic view;

generating an annular graphical representation of the panoramic view, wherein the annular graphical representation comprises an incomplete annulus including an arc representing a range of view covered by the panoramic image, the arc including a first arc cutoff edge and a second arc cutoff edge bounding a missing view angle representing the missing portion of the panoramic view;

displaying the annular graphical representation on a display;

receiving selection by a user of an option to capture additional image data representing the missing portion of the panoramic view;

detecting first and second edges of the missing portion of the panoramic view, the first and second edges corresponding to the first arc cutoff edge and the second arc cutoff edge, respectively;

generating a panorama completion user interface using the first edge

receiving the additional image data representing the missing portion of the panoramic view;

combining the additional image data representing the missing portion with the panoramic view;

updating the annular graphical representation based on the combining to include a complete annulus of the panoramic view; and

displaying the complete annulus of the panoramic image.

8. The method of claim 7, wherein displaying the annular graphical representation further comprises:

displaying a window over a portion of the arc of the annular graphical representation; and

displaying a high-resolution rectangular image corresponding to the portion of the arc of the annular graphical representation.

9. The method of claim 8, further comprising updating the high-resolution rectangular image or the window as a user moves the window around the arc of the annular graphical representation.

10. The method of claim 8, further comprising updating the high-resolution rectangular image as a user adjusts a size of the window.

11. A non-transitory computer-readable medium comprising code that, when executed, causes an processor to perform the method of:

receiving image data representing a plurality of images;

combining the plurality of images into a panoramic image;

identifying a missing portion of the panoramic image;

generating an annular graphical representation of the panoramic view, wherein the annular graphical representation comprises an incomplete annulus including an arc representing a range of view covered by the panoramic image, the arc including a first arc cutoff edge and a second arc cutoff edge bounding a missing view angle representing the missing portion of the panoramic image;

displaying the annular graphical representation to a user on a display;

receiving selection by a user of an option to capture additional image data representing the missing portion of the panoramic image;

detecting first and second edges of the missing portion of the panoramic view, the first and second edges corresponding to the first arc cutoff edge and the second arc cutoff edge, respectively;

generating a panorama completion user interface using the first edge;

receiving the additional image data representing the missing portion of the panoramic image;

stitching the additional image data representing the missing portion into the panoramic image;

updating the annular graphical representation based on the stitching to include a complete annulus of the panoramic image; and

displaying the complete annulus of the panoramic image.

12. The non-transitory computer-readable medium of claim 11, wherein displaying the annular graphical representation further comprises:

displaying a window over a portion of the arc of the annular graphical representation; and

displaying a high-resolution rectangular image corresponding to the portion of the arc of the annular graphical representation.

13. The non-transitory computer-readable medium of claim 12, further comprising updating the high-resolution rectangular image as a user moves the window around the arc of the annular graphical representation.

14. The non-transitory computer-readable medium of claim 12, the method further comprising updating the high-resolution rectangular image as a user adjusts a size of the window.

15. An apparatus for generating and displaying panoramic images comprising:

means for capturing a plurality of images;

means for;

combining the plurality of images into a panoramic image,

identifying a missing portion of the panoramic image,

generating an annular graphical representation of the panoramic view, wherein the annular graphical representation comprises an incomplete annulus including an arc representing a range of view covered by the panoramic image, the arc including a first arc cutoff edge and a second arc cutoff edge bounding a missing view angle representing the missing portion of the panoramic image; and

means for displaying the panorama as an annular view,

receiving selection by a user of an option to capture additional image data representing the missing portion of the panoramic image,

detecting first and second edges of the missing portion of the panoramic view, the first and second edges corresponding to the first arc cutoff edge and the second arc cutoff edge, respectively;

generating a panorama completion user interface using the first edge;

receiving the additional image data representing the missing portion of the panoramic image;

stitching the additional image data representing the missing portion into the panoramic image;

updating the annular graphical representation based on the stitching to include a complete annulus of the panoramic image; and

displaying the complete annulus of the panoramic image.

16. The apparatus of claim 15, wherein the means for capturing a plurality of images comprises a digital imaging device.

17. The apparatus of claim 16, wherein the digital imaging device is incorporated into a mobile computing device.

18. The apparatus of claim 15, further comprising means for assisting a user in capturing an image or images to fill in the missing portion of the panoramic image.

19. The apparatus of claim 15, wherein the means for displaying the panorama comprises touch screen technology or a flat panel display.