Method and apparatus for determining sensor format factors from image metadata

• US 8,842,190 B2
• Filed: 10/14/2008
• Issued: 09/23/2014
• Est. Priority Date: 08/29/2008
• Status: Active Grant

• Current Assignee: Adobe Inc.
• Original Assignee: Adobe Systems Incorporated (Adobe Inc.)
• Inventors: Chen, Simon, Chien, Jen-Chan, Jin, Hailin
• Primary Examiner(s): KHAN, USMAN A
• Application Number:
  US12/251,267
• Publication Number:
  US 20130121525A1
• Time in Patent Office: 2,170 Days
• Field of Search: 348/345, 348/222.1, 382/100, 382/254
• US Class Current: 348/222.1
• CPC Class Codes: G06T 3/12 Panospheric to cylindrical image transformations
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture

Abstract

Method and apparatus for determining sensor format factors from image metadata in which one of multiple techniques is applied to determine a sensor format factor for a camera from information in the metadata. Information from the metadata may be used to identify which of the multiple techniques to use. For example, the camera make and model may be used to determine a particular technique to use. As another example, the presence or absence of particular attributes or values for particular attributes may be used in determining a particular technique. In one embodiment, a profile database may be searched according to information in the metadata to determine if a sensor format factor for the camera is in the database. If the sensor format factor for the camera is not in the database, other information in the metadata may be examined to determine a particular technique from among the plurality of techniques.

Claims

1. A computer-implemented method, comprising:

examining, by a computing device, metadata corresponding to an input image to determine a particular one of a plurality of techniques for determining a sensor format factor for a camera used to capture the input image from information in the metadata, the plurality of techniques comprising at least a first technique configured to determine the sensor format factor from a ratio of a diagonal of 35 mm film and a diagonal of a sensor region used to capture the input image, the diagonal of the sensor region determined based on an image width, an image height, a focal plane X resolution, and a focal plane Y resolution of the input image that are obtained from the metadata; and

applying the particular technique to information obtained from the metadata corresponding to the input image to determine the sensor format factor for the camera used to capture the input image.

2. The computer-implemented method as recited in claim 1, wherein said examining metadata further comprises:

searching a profile database according to camera make and camera model information in the metadata to determine if the sensor format factor for the camera is stored in the profile database;

if the sensor format factor for the camera is not stored in the profile database, examining other information in the metadata to determine the particular technique for determining the sensor format factor for the camera from the information in the metadata.

3. The computer-implemented method as recited in claim 1, wherein the plurality of techniques further comprises at least one of:

a second technique configured to determine the sensor format factor from a focal length of the lens used to capture the input image and focal length in 35 mm film of a lens used to capture the input image;

or

a third technique configured to assign a default value to the sensor format factor based on a camera make as determined from the metadata.

4. The computer-implemented method as recited in claim 1, wherein performing the first technique comprises:

obtaining values for the image width, the image length, the focal plane X resolution, and the focal plane Y resolution from the metadata;

calculating a focal plane image width from the image width and the focal plane X resolution;

calculating a focal plane image height from the image height and the focal plane Y resolution;

dividing the sum of the squares of 35 mm film width and 35 mm film height by the sum of the squares of the focal plane image width and the focal plane image height; and

taking the square root of the results of said dividing to generate the sensor format factor.

5. The computer-implemented method as recited in claim 3, wherein performing the second technique comprises:

obtaining values for the focal length of the lens and the focal length in 35 mm film from the metadata; and

dividing the focal length in 35 mm film by the focal length of the lens to generate an estimated sensor format factor; and

clipping the estimated sensor format factor to generate the sensor format factor.

6. The computer-implemented method as recited in claim 5, wherein said clipping the estimated sensor format factor to generate the sensor format factor comprises:

if the absolute value of the estimated sensor format factor −

1.0 is less than or equal to 0.25 or if the absolute value of the estimated sensor format factor −

1.5 is less than or equal to 0.25, and if the absolute value of the estimated sensor format factor −

1.0 is less than the absolute value of the estimated sensor format factor −

1.5, setting the sensor format factor to 1.0;

if the absolute value of the estimated sensor format factor −

1.0 is less than or equal to 0.25 or if the absolute value of the estimated sensor format factor −

1.5 is less than or equal to 0.25, and if the absolute value of the estimated sensor format factor −

1.0 is greater than or equal to the absolute value of the estimated sensor format factor −

1.5, setting the sensor format factor to 1.5.

7. The computer-implemented method as recited in claim 3, wherein said examining metadata corresponding to an input image to determine a particular one of a plurality of techniques for calculating a sensor format factor for a camera from information in the metadata comprises:

examining the metadata to determine if the first technique is applicable;

if the first technique is applicable, applying the first technique to determine the sensor format factor;

if the first technique is not applicable, examining the metadata to determine if the second technique is applicable;

if the second technique is applicable, applying the second technique to determine the sensor format factor;

if the second technique is not applicable, defaulting to the third technique to determine the sensor format factor.

8. The computer-implemented method as recited in claim 3, wherein the plurality of techniques further includes a fourth technique comprising searching a profile database according to the metadata to determine if a sensor format factor for the camera is stored in the profile database.

9. The computer-implemented method as recited in claim 8, wherein said searching a profile database according to the metadata to determine if a sensor format factor for the camera is stored in the profile database comprises:

determining a camera make and a camera model of the camera from the metadata;

attempting to match the camera make and the camera model from the metadata to information stored in a profile in the profile database; and

if a match is found and if the profile includes a sensor format factor for the camera make and the camera model, assigning the sensor format factor from the matched profile to the sensor format factor for the particular camera used to capture the input image.

10. The computer-implemented method as recited in claim 8, wherein said examining metadata corresponding to an input image to determine a particular one of a plurality of techniques for calculating a sensor format factor for a camera from information in the metadata comprises:

examining the metadata to determine if the fourth technique is applicable;

if the fourth technique is applicable, applying the fourth technique to determine the sensor format factor;

if the fourth technique is not applicable, examining the metadata to determine if the first technique is applicable;

if the first technique is applicable, applying the first technique to determine the sensor format factor;

if the first technique is not applicable, examining the metadata to determine if the second technique is applicable;

if the second technique is applicable, applying the second technique to determine the sensor format factor;

if the second technique is not applicable, defaulting to the third technique to determine the sensor format factor.

11. The computer-implemented method as recited in claim 1, further comprising:

locating, in a profile database, a particular profile that matches the metadata corresponding to the input image;

retrieving, from the particular profile, data specific to a particular camera and lens combination indicated by the particular profile; and

adjusting the data according to the determined sensor format factor.

12. A system, comprising:

at least one processor; and

a memory comprising program instructions stored thereon, the program instructions executable by the at least one processor to;

examine metadata corresponding to an input image to determine a particular one of a plurality of techniques for determining a sensor format factor for a camera used to capture the input image from information in the metadata, the plurality of techniques comprising at least a second technique configured to determine the sensor format factor from a focal length of a lens used to capture the input image and focal length in 35 mm film of the lens used to capture the input image, wherein the second technique further comprises dividing the focal length in 35 mm film by the focal length of the lens to generate an estimated sensor format factor, and clipping the estimated sensor format factor to generate the sensor format factor; and

apply the particular technique to information obtained from the metadata corresponding to the input image to determine the sensor format factor for the camera used to capture the input image.

13. The system as recited in claim 12, wherein, to examine metadata, the program instructions are executable by the at least one processor to:

search a profile database according to camera make and camera model information in the metadata to determine if the sensor format factor for the camera is stored in the profile database;

if the sensor format factor for the camera is not stored in the profile database, examine other information in the metadata to determine the particular technique for determining the sensor format factor for the camera from the information in the metadata.

14. The system as recited in claim 12, wherein the plurality of techniques further comprises at least one of:

a first technique configured to determine the sensor format factor from dimensions of 35 mm film and dimensions of a sensor region used to capture the input image;

or

a third technique configured to assign a default value to the sensor format factor based on a camera make as determined from the metadata.

15. The system as recited in claim 14, wherein, to perform the first technique the program instructions are executable by the at least one processor to:

obtain values for an image width, an image length, a focal plane X resolution, and a focal plane Y resolution from the metadata;

calculate a focal plane image width from the image width and the focal plane X resolution;

calculate a focal plane image height from the image height and the focal plane Y resolution;

divide the sum of the squares of 35 mm film width and 35 mm film height by the sum of the squares of the focal plane image width and the focal plane image height; and

take the square root of the results of said dividing to generate the sensor format factor.

16. The system as recited in claim 14, wherein, to examine metadata corresponding to an input image to determine a particular one of a plurality of techniques for calculating a sensor format factor for a camera from information in the metadata, the program instructions are executable by the at least one processor to:

examine the metadata to determine if the first technique is applicable;

if the first technique is applicable, apply the first technique to determine the sensor format factor;

if the first technique is not applicable, examine the metadata to determine if the second technique is applicable;

if the second technique is applicable, apply the second technique to determine the sensor format factor;

if the second technique is not applicable, default to the third technique to determine the sensor format factor.

17. The system as recited in claim 14, wherein the plurality of techniques further includes a fourth technique configured to search a profile database according to the metadata to determine if a sensor format factor for the camera is stored in the profile database.

18. The system as recited in claim 17, wherein to perform the fourth technique, the program instructions are executable by the at least one processor to:

determine a camera make and a camera model of the camera from the metadata;

attempt to match the camera make and the camera model from the metadata to information stored in a profile in the profile database; and

if a match is found and if the profile includes a sensor format factor for the camera make and the camera model, assign the sensor format factor from the matched profile to the sensor format factor for the particular camera used to capture the input image.

19. The system as recited in claim 17, wherein, to examine metadata corresponding to an input image to determine a particular one of a plurality of techniques for calculating a sensor format factor for a camera from information in the metadata, the program instructions are executable by the at least one processor to:

examine the metadata to determine if the fourth technique is applicable;

if the fourth technique is applicable, apply the fourth technique to determine the sensor format factor;

if the fourth technique is not applicable, examine the metadata to determine if the first technique is applicable;

if the first technique is applicable, apply the first technique to determine the sensor format factor;

if the first technique is not applicable, examine the metadata to determine if the second technique is applicable;

if the second technique is applicable, apply the second technique to determine the sensor format factor;

if the second technique is not applicable, default to the third technique to determine the sensor format factor.

20. The system as recited in claim 12, wherein the program instructions are executable by the at least one processor to:

locate, in a profile database, a particular profile that best matches the metadata corresponding to the input image;

retrieve, from the particular profile, data specific to a particular camera and lens combination indicated by the particular profile; and

adjust the data according to the determined sensor format factor.

21. A non-transitory computer-readable medium comprising program instructions stored thereon that, responsive to execution by a computer, perform operations comprising:

examining metadata corresponding to an input image to determine a particular one of a plurality of techniques for determining a sensor format factor for a camera used to capture the input image from information in the metadata, the plurality of techniques comprising at least a first technique configured to determine the sensor format factor from a ratio of a diagonal of 35 mm film and a diagonal of a sensor region used to capture the input image, the diagonal of the sensor region determined based on an image width, an image height, a focal plane X resolution, and a focal plane Y resolution of the input image that are obtained from the metadata; and

applying the particular technique to information obtained from the metadata corresponding to the input image to determine the sensor format factor for the camera used to capture the input image.

22. The non-transitory computer-readable medium as recited in claim 21, wherein the program instructions, responsive to execution by the computer, perform the examining metadata by:

searching a profile database according to camera make and camera model information in the metadata to determine if the sensor format factor for the camera is stored in the profile database;

if the sensor format factor for the camera is not stored in the profile database, examining other information in the metadata to determine the particular technique for determining the sensor format factor for the camera from the information in the metadata.

23. The non-transitory computer-readable medium as recited in claim 21, wherein the plurality of techniques further comprises at least one of:

a second technique configured to determine the sensor format factor from a focal length of the lens used to capture the input image and focal length in 35 mm film of a lens used to capture the input image;

or

a third technique configured to assign a default value to the sensor format factor based on a camera make as determined from the metadata.

24. The non-transitory computer-readable medium as recited in claim 21, wherein the program instructions, responsive to execution by the computer, perform the first technique by:

obtaining values for the image width, the image length, the focal plane X resolution, and the focal plane Y resolution from the metadata;

calculating a focal plane image width from the image width and the focal plane X resolution;

calculating a focal plane image height from the image height and the focal plane Y resolution;

dividing the sum of the squares of 35 mm film width and 35 mm film height by the sum of the squares of the focal plane image width and the focal plane image height; and

taking the square root of the results of said dividing to generate the sensor format factor.

25. The non-transitory computer-readable medium as recited in claim 23, wherein the program instructions, responsive to execution by the computer, perform the second technique by:

obtaining values for the focal length of the lens and the focal length in 35 mm film from the metadata; and

dividing the focal length in 35 mm film by the focal length of the lens to generate an estimated sensor format factor; and

clipping the estimated sensor format factor to generate the sensor format factor.

26. The non-transitory computer-readable medium as recited in claim 23, wherein the program instructions, responsive to execution by the computer, perform the examining by:

examining the metadata to determine if the first technique is applicable;

if the first technique is applicable, applying the first technique to determine the sensor format factor;

if the first technique is not applicable, examining the metadata to determine if the second technique is applicable;

if the second technique is applicable, applying the second technique to determine the sensor format factor;

if the second technique is not applicable, defaulting to the third technique to determine the sensor format factor.

27. The non-transitory computer-readable medium as recited in claim 23, wherein the plurality of techniques further includes a fourth technique configured to search a profile database according to the metadata to determine if a sensor format factor for the camera is stored in the profile database.

28. The non-transitory computer-readable medium as recited in claim 27, wherein the program instructions, responsive to execution by the computer, perform the fourth technique by:

determining a camera make and a camera model of the camera from the metadata;

attempting to match the camera make and the camera model from the metadata to information stored in a profile in the profile database; and

if a match is found and if the profile includes a sensor format factor for the camera make and the camera model, assigning the sensor format factor from the matched profile to the sensor format factor for the particular camera used to capture the input image.

29. The non-transitory computer-readable medium as recited in claim 27, wherein the program instructions, responsive to execution by the computer, perform the examining by:

examining the metadata to determine if the fourth technique is applicable;

if the fourth technique is applicable, applying the fourth technique to determine the sensor format factor;

if the fourth technique is not applicable, examining the metadata to determine if the first technique is applicable;

if the first technique is applicable, applying the first technique to determine the sensor format factor;

if the first technique is not applicable, examining the metadata to determine if the second technique is applicable;

if the second technique is applicable, applying the second technique to determine the sensor format factor;

if the second technique is not applicable, defaulting to the third technique to determine the sensor format factor.

30. The non-transitory computer-readable medium as recited in claim 21, wherein the program instructions, responsive to execution by the computer, perform operations further comprising:

locating, in a profile database, a particular profile that matches the metadata corresponding to the input image;

retrieving, from the particular profile, data specific to a particular camera and lens combination indicated by the particular profile; and

adjusting the data according to the determined sensor format factor.