Method of controlling an action, such as a sharpness modification, using a colour digital image

• US 7,920,172 B2
• Filed: 03/06/2006
• Issued: 04/05/2011
• Est. Priority Date: 03/07/2005
• Status: Expired due to Fees

• Current Assignee: Lens Correction Technologies Corporation
• Original Assignee: DXO Labs
• Inventors: Tarchouna, Imene, Meniere, Jerome, Chanas, Laurent, Guichard, Frederic, Liege, Bruno
• Primary Examiner(s): Tran; Sinh
• Assistant Examiner(s): Pasiewicz; Daniel M
• Application Number:
  US11/817,977
• Publication Number:
  US 20080158377A1
• Time in Patent Office: 1,856 Days
• Field of Search: 348/222.1, 348/223.1, 348/224.1, 382/106, 382/153, 382/165, 382/255, 382272-275
• US Class Current: 348/222.1
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/959 by adjusting depth of field during image capture, e.g. maximising or setting range based on scene characteristics
• CPC Class Codes: H04N 25/134 based on three different wavelength filter elements
• CPC Class Codes: H04N 25/615 involving a transfer function modelling the optical system, e.g. optical transfer function [OTF], phase transfer function [PhTF] or modulation transfer function [MTF]
• CPC Class Codes: H04N 25/6153 for colour signals

Abstract

A method for activating a function by using a measurement taken from at least one digital image having at least two colors and originating from an image-capturing apparatus, wherein a relative sharpness is measured between at least two colors on at least one region of the digital image, and at least one function is activated depending on the measured relative sharpness.

Claims

1. A method for activating at least one function by using a measurement taken from at least one digital image having at least two colours and originating from an image-capturing apparatus, wherein:

a relative sharpness is measured between at least two colours on at least one region of the digital image, and

at least one function, from a plurality of functions, is activated depending on the measured relative sharpness, the plurality of functions including a function to determine a distance between the capturing apparatus and at least one object in the digital image based on the relative sharpness.

2. A method according to claim 1 wherein the at least one function activated is included in a group comprising:

a determination of a relative distance between two imaged objects,

an action depending on the said distance and/or the said relative distance,

a process on at least one zone Z′

of the digital image and/or of another digital image,

a servo-control of the capturing apparatus and/or a servo-control of another apparatus,

a provision of an indication and/or alarm and/or alert signal to a user,

a detection of a part of the image, an alteration of a colour sharpness,

a determination of a position and/or of the movement of the capturing apparatus,

a determination of a subject'"'"'s position within the image, an alteration of at least one image specification,

an alteration of all or part of the image,

a determination of a zone of interest inside the image, notably in order to provide a servo-control signal,

an alteration of a resolution for all or part of the image,

a provision of data relating to the image,

a provision of data to a sound-capturing device,

a parametering of a compression,

at least one adjustment for the capturing apparatus.

3. The method according to claim 1 or 2, wherein

the function activated includes a process on at least one zone Z′

of the digital image and/or of another digital image, and

the zone Z′

is included in all or part of the digital image region, and/or the whole digital image, and/or a separate zone from the digital image region, and/or another digital image, and/or another whole digital image.

4. The method according to claim 3 wherein the zone Z′

, for which a process is activated, comprises at least one pixel of an image and wherein a region R comprises a pre-determined vicinity of the corresponding pixel in the digital image.

5. The method according to claim 4, wherein the process is applied to all the pixels of an image.

6. The method according to claim 3, wherein the process on at least the zone Z′

includes alteration of at least one specification contained in the group comprising;

sharpness, contrast, luminosity, detail, colour, the type of compression, the rate of compression, the image contents, the resolution.

7. The method according to claim 3, wherein the process includes an alteration of the sharpness of each pixel in the zone Z′

by way of a filter mixing the values attached to the pixel or pixels within a pre-determined vicinity for each pixel, the parameters of the filter depending upon the measured relative sharpness.

8. The method according to claim 3, wherein the zone Z′

is determined by using the measured relative sharpness.

9. The method according to claim 3, wherein the zone Z′

is included in a background for an image, notably destined for remote transmission, through a system of visio or video-conferencing.

10. The method according to claim 3, wherein

the process includes the provision of data depending on the distance between the imaged object and the capturing apparatus for all or part of the pixels of the zone Z′

, and

the storage and/or the transmission and/or the use of such data is activated depending on the distance, the stored data notably being saved in a data-processing file, in an image file.

11. The method according to claim 1, wherein the function activated includes a servo-control of the capturing apparatus, such as a servo-control for focussing and/or of exposure, and/or of flash, and/or for image-framing, and/or for white-balancing, and/or for image-stabilising, and/or a servo-control of another apparatus or device linked to the capturing apparatus, including guiding of a robot.

12. The method according to claim 1, wherein the function activated includes a provision of a signal, including an indication signal of the main focal point of the digital image and/or of a focussing zone and/or of the distance of at least one part of the imaged scene, to the capturing apparatus.

13. The method according to claim 1, wherein the function activated depends upon at least one specification of the capturing apparatus during picture-taking including the focal length, the aperture, the distance for focussing, the exposure parameters, the white-balance parameters, the resolution, the compression, or an adjustment made by the user.

14. The method according to claim 1, wherein the digital image is included in a raw image stemming from the sensor of the capturing apparatus.

15. The method according to claim 1, wherein the measurement is made inside the capturing apparatus and/or the function activated is made inside the capturing apparatus.

16. The method according to claim 1, wherein the measurement is taken beyond the capturing apparatus, including on a computer after transfer of the image, and/or wherein a function is activated beyond the capturing apparatus.

17. The method according to claim 1, wherein the function activated comprises a detection and/or recognition activation of a part of the image, including detection and/or recognition of the face.

18. The method according to claim 1, wherein the measurement comprises a measurement of relative sharpness between a first colour and at least a second colour, referred to as the other colour, and wherein the activation comprises alteration of the sharpness of the other colour depending on the sharpness of the first colour.

19. The method according to claim 18 wherein the sharpness alteration of the other colour is embodied using a calculation of the type CA=CN+F(CO−

CN), where CA represents the other improved colour, CO represents the other colour prior to processing, CN represents the first colour and F represents a filter.

20. The method according to claim 18, wherein alteration of the sharpness of the other colour is an improvement of the sharpness, the first colour being referred to as the “

sharp colour”

.

21. The method according to claim 20 further comprising:

decomposing the digital image into regions, the sharp colour being selected one for each region.

22. The method according to claim 20, the said capturing apparatus comprising a macro mode, a method wherein the sharp colour is selected depending on activation of the macro mode.

23. The method according to claim 18, wherein the sharpness of at least one colour within at least one image zone is reduced.

24. The method according to claim 1, for which the said digital image stems from a capturing apparatus comprising a lens, the said method further including the step to select a lens from among a series of pre-determined lenses, the said lens representing specifications such that the images of an object with at least two distinct pre-determined distances represent distinct colours of sharpness, thus improving the depth of field and reducing the cost of the lens.

25. The method according to claim 1, wherein the function activated comprises a measurement of the position and/or movement of the capturing apparatus.

26. The method according to claim 1, wherein the function activated involves determination of the position of the main subject or subjects in the image.

27. The method according to claim 26 wherein the function activated further involves the automatic framing, including the centering, zooming or reframing of the digital image, and/or of another image, in relation to the main subject of the digital image.

28. The method according to claim 1, wherein the function activated comprises the application of a process depending on the relative sharpness and on the user'"'"'s choice.

29. The method according to claim 1, wherein the function activated comprises alteration of the contrast and/or of the brightness and/or of the colour and/or of the sharpness of an image, depending on the variation of the relative sharpness within the image.

30. The method according to claim 1, wherein the function activated comprises provision of the position of at least one zone of interest for consideration to a servo-control of exposure and/or of white balance and/or of focussing, such zone of interest being determined by comparing at least two relative sharpness measurements.

31. The method according to claim 1, wherein the function activated comprises provision of a signal to the user, indicating that the image is taken too close-up to be sharp.

32. The method according to claim 1, wherein the function activated comprises alteration of an image resolution depending on the relative sharpness.

33. The method according to claim 1, wherein the function activated comprises the provision of a signal used for an automatic indexing of the digital image.

34. The method according to claim 1, wherein the function activated comprises provision of remote or directional data, in relation to the capturing apparatus, of a subject or an object of the digital image, to a sound-capturing device.

35. The method according to claim 1, wherein the function activated includes the parametering of increased compression for the background, and of reduced compression for the main subject or subjects, such main subject or subjects being determined as an image zone complying with the criteria based upon the measured relative sharpness.

36. The method according to claim 1, wherein the apparatus comprises a sensor having pixels equipped with coloured filters of at least two types, the said filters being selected so that their spectral responses entail little overlapping.

37. The method according to claim 1, wherein the apparatus comprises a sensor having pixels mainly serving to generate the image, and other pixels mainly serving to measure the relative sharpness.

38. The method according to claim 37, wherein the pixels of the sensor, mainly serving to measure the relative sharpness, have a spectral response within a spectral band which entails little overlapping with the spectral band of the sensor'"'"'s pixels, mainly serving to generate the image.

39. The method according to claim 37 wherein the pixels of the sensor, mainly serving to generate an image, have a spectral response that is mainly within the field visible to the human eye, and wherein the other pixels have a spectral response, mainly beyond the field visible to the human eye.

40. The method according to claim 1, in which the capturing apparatus includes a sensor comprising spectral-response pixels, mainly within the field visible to the human eye, and additional pixels having a spectral response, mainly beyond the spectre visible to the human eye, and where the sharpness of the part of the image stemming from these additional pixels exceeds, within at least one range of distances between the capturing apparatus and the imaged scene, the sharpness of the part of the image supplied by the response pixels, mainly within the field visible to the human eye.

41. The method according to claim 1, wherein the apparatus is equipped with a lens lacking a mobile or flexible element for focussing.

42. The method according to claim 1, wherein the apparatus is equipped with a lens having a variable focal length with no mobile or flexible element for focussing.

43. The method according to claim 1, wherein the apparatus is equipped with a lens having a variable focal length with a single mobile or flexible optics group.

44. The method according to claim 1, wherein the digital image stems from at least two sensors.

45. The method according to claim 1, wherein the function activated comprises the addition of an object inside an image and/or the replacement of a part of an image depending on the measured relative sharpness on the digital image.

46. The method according to claim 1, wherein the capturing apparatus capturing a sequence of images, the digital image being a part of the sequence, the action is performed on at least one other image of the sequence.

47. The method according to claim 1, wherein the function activated alters at least one adjustment of the capturing apparatus, including the focal length, the aperture, or the distance for focussing.

48. The method according to claim 1, wherein the function activated comprises the production of an altered raw image.

49. The method according to claim 1, wherein the apparatus comprising a lens having longitudinal chromatic aberrations, including for a given focus, aperture and focal distance, there exists at least one colour for which the distance involving the best sharpness is lower than

50. The method according to claim 1, wherein the measurement of relative sharpness between two colours is made by comparing the results of a first measurement applied to the first colour and the results of a second measurement applied to a second colour, each measurement being such that it depends upon, on the one hand, the colour, and upon the contents of the digital image on the other, the comparison being such that it is removed from the digital image contents.

51. The method according to claim 1, the said digital image stemming from a capturing apparatus comprising a lens, the said method further comprising the step to design a lens representing specifications such that the images of an object with at least two pre-determined distances represent distinct sharpness colours:

in order that the depth of field and/or the aperture and/or every other optical specification is improved, and/or that the cost of the optics is reduced.

52. An image-capturing and/or reproducing apparatus comprising an optical system for capturing and/or reproducing images, an image sensor and/or generator and/or a servo-control system, the image being processed, in view of its improvement, by digital image-processing means,

the method being such that the user determines or selects the optical system and/or the sensor and/or the image generator and/or the servo-control system parameters, using the capacity to process images via digital means, and further determines or selects improvement of a colour sharpness depending on another colour in accordance with a method according to claim 1,

in order to minimise the embodiment costs and/or to optimise the performances of the image-capturing and/or reproducing apparatus.

53. An image-capturing apparatus using the method according to claim 1.

54. A digital image-processing device using the method according to claim 1.

55. A method according to claim 1 enabling to improve sharpness of at least one colour of a digital image, notably stemming from an image-capturing device, comprising:

selecting from among a plurality of colours at least one colour referred to as “

sharp colour;

” and

reflecting the sharpness of the sharp colour onto at least one other improved colour, so that the improved colour represents increased sharpness.

56. The method according to claim 55 further comprising:

decomposing the digital image into regions, the said sharp colour being selected for each region.

57. The method according to claim 56, the said digital image stemming from a capturing apparatus, the said method further comprising:

determining the distance between the capturing apparatus and at least one object of the captured scene by using the sharpness of at least two colours in an image region of the said object.

58. The method according to claim 57 further comprising:

reducing the sharpness of at least one colour within at least one image region.

59. The method according to claim 57 further comprising:

determining a servo-control instruction for the said capturing apparatus by using the sharpness of at least two colours in order that focussing is achieved in fewer steps and is accelerated.

60. The method according to claim 55, the said sharp colour selection being that of choosing the sharpest colour according to a pre-determined rule.

61. The method according to claim 55, the said “

sharp colour”

selection being pre-determined.

62. The method according to claim 55, the said digital image stemming from a capturing apparatus, the said sharp colour selection depending on the distance between the capturing apparatus and at least one object of the captured scene in order to obtain the said digital image.

63. The method according to claim 55, the said image apparatus comprising a macro mode, the said sharp colour selection depending upon activation of the macro mode.

64. The method according to claim 55, the said digital image stemming from a capturing apparatus comprising a lens, the said method further comprising:

selecting a lens from among a series of pre-determined lenses, the said lens representing specifications such that the images of an object having at least two pre-determined distances represent distinct sharp colours, thus improving the depth of field and/or reducing the cost of the lens.

65. The method according to claim 55, wherein repercussion of the sharpness of the sharp colour on at least one other improved colour is embodied by using a calculation of the type CA=CN+F(CO−

CN), where CA represents the improved colour, CO represents the improved colour prior to processing, CN represents the sharp colour and F represents a filter.

66. The method according to claim 55, the said digital image stemming from a capturing apparatus comprising a lens, the said method further comprising:

designing a lens by taking account of the method according to the invention, the said lens representing specifications such that the images of an object with at least two pre-determined distances represent distinct sharp colours;

in order that the depth of field and/or the aperture and/or every other optical specification is improved and/or the cost of the optics is reduced, and

in order that the mechanical focussing can be achieved by using fewer positions.

67. An image-capturing and/or reproducing apparatus comprising an optical system for capturing and/or reproducing images, an image sensor and/or generator and/or a servo-control system, the image being processed, in view of its improvement, by digital image-processing means,

the method being such that the user determines or selects the optical system and/or the sensor and/or the image generator and/or the servo-control system parameters, using the capacity to process images via digital means, and especially for improving the sharpness of a colour depending on the sharpness of another colour in accordance with a method according to claim 55,

in order to minimise the embodiment costs and/or to optimise the performances of the image-capturing and/or reproducing apparatus.

68. The image-capturing and/or reproducing apparatus using the colour-improvement method according to claim 55.

69. A digital image-processing device implementing the method according to claim 55.

70. A digital image obtained using the image-capturing and/or the reproducing apparatus according to claim 68.