Method and apparatus for resolution improvement in digital capturing

• US 8,126,284 B2
• Filed: 12/03/2007
• Issued: 02/28/2012
• Est. Priority Date: 12/01/2006
• Status: Expired due to Fees

• Current Assignee: Avago Technologies International Sales Pte Limited (Broadcom, Inc.)
• Original Assignee: Broadcom Corporation (Broadcom, Inc.)
• Inventors: Vitsnudel, Ilia, Potikha, Elizaveta, Sorek, Noam
• Primary Examiner(s): Allison, Andrae S
• Application Number:
  US11/949,212
• Publication Number:
  US 20080131022A1
• Time in Patent Office: 1,548 Days
• Field of Search: 382/162, 382/167, 382/199, 382/254, 382/266, 348/234, 348/222.1, 348/223.1, 348/235, 348/252, 348/266, 348/289, 348/625, 348/627, 348/631, 348/663, 348/712, 348/612, 348/675, 348/703, 348/224.1
• US Class Current: 382/254
• CPC Class Codes: G06T 2207/20012 Locally adaptive
• CPC Class Codes: G06T 2207/20192 Edge enhancement; Edge preservation
• CPC Class Codes: G06T 3/4015 Image demosaicing, e.g. colour filter arrays [CFA] or Bayer patterns
• CPC Class Codes: G06T 3/403 Edge-driven scaling; Edge-based scaling
• CPC Class Codes: G06T 5/20 using local operators
• CPC Class Codes: G06T 5/73 Deblurring; Sharpening
• CPC Class Codes: H04N 1/4092 Edge or detail enhancement
• CPC Class Codes: H04N 9/646 for image enhancement, e.g. vertical detail restoration, cross-colour elimination, contour correction, chrominance trapping filters

Abstract

A method and apparatus for enhancing the resolution of digital images. For each image a white balanced image is generated, which takes into account the differences in the colors of the sensor cell upon which the values are generated. Edge detection filters are then activated on the white balanced image and a weight is determined, indicating the probability that a feature which was detected as an edge is indeed an edge. At the last step, each detected edge is multiplied by the probability and is added to the luminance component, thus enhancing the edges. Preferred embodiments of the white balance image generation. Generating the white balanced image, detecting the edges and determining the weights are disclosed for sensors operating in Line Addition On mode and for sensors operating in Line Addition Off mode.

Claims

1. A method for enhancing the resolution of a digital image captured by a capturing device, wherein the capturing device includes a sensor, the method comprising:

receiving the digital image from the sensor;

generating a white balanced image from the digital image;

detecting an at least one edge on the white balanced image; and

determining a weight for each of the at least one edge, wherein the sensor operates in Line Addition Off mode, wherein substantially all pixels in the white balanced image are generated by performing mathematical operations, wherein each operation is performed on cells belonging to a single row of the digital image, and wherein the value of green cells is multiplied by a predetermined factor, and the value of each cell is incremented by the average value of its horizontal neighboring cells.

2. The method of claim 1 wherein the at least one edge is a horizontal edge.

3. The method of claim 1 wherein the weight is used for eliminating false edges.

4. The method of claim 1 wherein the weight is determined by analyzing vertical and horizontal edges strength on a luminance component of the digital image.

5. The method of claim 1 wherein the sensor is a CCD sensor or a CMOS sensor.

6. The method of claim 1 wherein the white balanced image is generated by multiplying all sensor values of a predetermine color in a constant number so as to obtain uniform values for mosaic cells of different types in areas capturing a uniform color.

7. A method for enhancing the resolution of a digital image captured by a capturing device, wherein the capturing device includes a sensor, the method comprising:

receiving the digital image from the sensor;

generating a white balanced image from the digital image;

detecting an at least one edge on the white balanced image; and

determining a weight for each of the at least one edge, wherein the sensor operates in Line Addition Off mode, wherein substantially all pixels in the white balanced image are generated by performing mathematical operations, wherein each operation is performed on pixels belonging to a single column of the digital image, and wherein the value of green cells is multiplied by a predetermined factor, and wherein the value of each cell is either incremented by the average value of its vertical non-immediate neighboring cells or is assigned the average value of its two vertical immediate neighboring cells.

8. The method of claim 7 wherein the at least one edge is a vertical edge.

9. The method of claim 7 wherein the sensor is a CCD sensor or a CMOS sensor.

10. The method of claim 7 wherein the weight is used for eliminating false edges.

11. The method of claim 7 wherein the weight is determined by analyzing vertical and horizontal edges strength on a luminance component of the digital image.

12. The method of claim 7 wherein the white balanced image is generated by multiplying all sensor values of a predetermine color in a constant number so as to obtain uniform values for mosaic cells of different types in areas capturing a uniform color.

13. A method for enhancing the resolution of a digital image captured by a digital camera that includes a sensor, the method comprising:

receiving the digital image from the sensor that includes a CCD sensor or a CMOS sensor;

generating a white balanced image from the digital image;

detecting an at least one edge on the white balanced image; and

determining a weight for each of the at least one edge, wherein the sensor operates in Line Addition Off mode or Line Addition On mode, wherein substantially all pixels in the white balanced image are generated by performing mathematical operations, wherein each operation is performed on pixels belonging to a single column or a single row of the digital image, and wherein the value of green cells is multiplied by a predetermined factor, and wherein the value of each cell is incremented by the average value of its horizontal neighboring cells or its vertical neighboring cells.

14. The method of claim 13 comprising:

adding to a luminance component generated from the digital image a sum of products, wherein each product is a multiplication of the at least one edge and the weight.

15. The method of claim 13 wherein the sensor operates in Line Addition On mode.

16. The method of claim 15 wherein the white balanced image is generated by multiplying all sensor values of a predetermined color in a constant number so as to obtain uniform values for mosaic cells of different types in areas capturing a grayscale image.

17. The method of claim 15 wherein the weight for each of the at least one edge is determined based on at least one parameter based on one or more of the following:

a weight indicating if a significant color pattern is present;

the presence of additional edges in the vicinity of the at least one edge;

the difference between vertical neighboring cells in the white balanced image;

the absence or presence of horizontal edges; and

local illumination range intensity.

18. The method of claim 17 wherein the weight for each of the at least one edge is determined as the minimum of the at least one parameter.

19. The method of claim 13 wherein the at least one edge comprises a horizontal edge or a vertical edge.

20. The method of claim 13 wherein the weight is used for eliminating false edges.