Method and system for generating images used in extended range panorama composition
First Claim
1. A method of obtaining an extended dynamic range panorama image of a scene from a plurality of limited dynamic range images captured by an image sensor in a digital camera, said method comprising steps of:
- (a) from a first position, capturing a first plurality of digital images comprising image pixels of the scene by exposing the image sensor to light transmitted from the scene as observed from the first position, wherein light transmittance upon the image sensor is adjustable;
(b) evaluating each image after it is captured for an illumination level exceeding the limited dynamic range of the image at either a higher or a lower end of the dynamic range for at least some of the image pixels;
(c) based on the evaluation of each image exceeding the limited dynamic range, adjusting the light transmittance upon the image sensor in order to obtain a subsequent digital image having a different scene brightness range;
(d) storing the first plurality of digital images;
(e) processing the stored digital images to generate a first composite image having an extended dynamic range greater than any of the digital images by themselves;
(f) from a second position, capturing a second plurality of digital images comprising image pixels of the scene by exposing the image sensor to light transmitted from the scene as observed from the second position, and then repeating the steps (b) through (e) for the second plurality of images to generate a second composite image; and
(g) processing the first and second composite images to generate an extended dynamic range panorama image.
1 Assignment
0 Petitions
Accused Products
Abstract
In a method of obtaining an extended dynamic range panorama of a scene from a plurality of limited dynamic range images captured by an image sensor in a digital camera, a plurality of digital images comprising image pixels of the scene are captured from a plurality of positions by exposing the image sensor to light transmitted from the scene, wherein light transmittance upon the image sensor is adjustable. Each image is evaluated after it is captured for an illumination level exceeding the limited dynamic range of the image for at least some of the image pixels. Based on the evaluation of each image exceeding the limited dynamic range, the light transmittance upon the image sensor is adjusted in order to obtain a subsequent digital image having a different scene brightness range. The plurality of digital images are stored, and subsequently the stored digital images are processed to generate a plurality of composite images, each having an extended dynamic range greater than any of the digital images by themselves. The plurality of composite images are used in producing an extended range panorama. In addition, light attenuation data may be stored with the images for subsequent reconstruction of higher bit-depth panorama than the original panorama.
-
Citations
25 Claims
-
1. A method of obtaining an extended dynamic range panorama image of a scene from a plurality of limited dynamic range images captured by an image sensor in a digital camera, said method comprising steps of:
-
(a) from a first position, capturing a first plurality of digital images comprising image pixels of the scene by exposing the image sensor to light transmitted from the scene as observed from the first position, wherein light transmittance upon the image sensor is adjustable;
(b) evaluating each image after it is captured for an illumination level exceeding the limited dynamic range of the image at either a higher or a lower end of the dynamic range for at least some of the image pixels;
(c) based on the evaluation of each image exceeding the limited dynamic range, adjusting the light transmittance upon the image sensor in order to obtain a subsequent digital image having a different scene brightness range;
(d) storing the first plurality of digital images;
(e) processing the stored digital images to generate a first composite image having an extended dynamic range greater than any of the digital images by themselves;
(f) from a second position, capturing a second plurality of digital images comprising image pixels of the scene by exposing the image sensor to light transmitted from the scene as observed from the second position, and then repeating the steps (b) through (e) for the second plurality of images to generate a second composite image; and
(g) processing the first and second composite images to generate an extended dynamic range panorama image. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A system for obtaining an extended dynamic range panorama image of a scene from a plurality of limited dynamic range images of the scene captured by a digital camera, said system comprising:
-
a camera having (a) an image sensor for capturing a plurality of digital images comprising image pixels of the scene by exposing the image sensor to light transmitted from the scene, wherein light transmittance upon the image sensor is adjustable;
(b) means for evaluating each image after it is captured for an illumination level exceeding the limited dynamic range of the image for at least some of the image pixels;
(c) a controller for adjusting the light transmittance upon the image sensor in order to obtain a subsequent digital image having a different scene brightness range, whereby said controller is operative based on the evaluation of each image exceeding the limited dynamic range; and
(d) a storage device for storing the plurality of digital images, whereby the camera is operated in a plurality of positions to capture respective pluralities of digital images comprising image pixels of the scene as observed from the plurality of positions; and
an offline processor for (a) processing the respective pluralities of stored images to generate a plurality of composite images, each having an extended dynamic range greater than any of the digital images by themselves and (b) processing the plurality of composite images to generate an extended dynamic range panorama image. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19, 20, 21)
-
-
22. A method of obtaining a high bit depth panorama image of a scene from images of lower bit depth of the scene captured by an image sensor in a digital camera, said lower bit depth images also comprising lower dynamic range images, said method comprising steps of:
-
(a) from a first position, capturing a first plurality of digital images of lower bit depth comprising image pixels of the scene by exposing the image sensor to light transmitted from the scene as observed from the first position, wherein light transmittance upon the image sensor is variably attenuated for at least one of the images;
(b) evaluating each image after it is captured for an illumination level exceeding the limited dynamic range of the image for at least some of the image pixels;
(c) based on the evaluation of each image exceeding the limited dynamic range, adjusting the light transmittance upon the image sensor in order to obtain a subsequent digital image having a different scene brightness range;
(d) calculating an attenuation coefficient for each of the images corresponding to the degree of attenuation for each image;
(e) storing data for the reconstruction of one or more high bit depth images from the low bit depth images, said data including the first plurality of digital images and the attenuation coefficients;
(f) processing the stored data to generate a first composite image having a higher bit depth than any of the digital images by themselves;
(g) from a second position, capturing a second plurality of digital images of lower bit depth comprising image pixels of the scene by exposing the image sensor to light transmitted from the scene as observed from the second position, and then repeating the steps (b) through (f) on the second plurality of images to generate a second composite image; and
(h) processing the first and second composite images to generate a panorama image having a higher bit depth. - View Dependent Claims (23, 24, 25)
-
Specification