Methods of processing mosaicked images

• US 9,280,803 B2
• Filed: 04/25/2013
• Issued: 03/08/2016
• Est. Priority Date: 04/25/2013
• Status: Active Grant

• Current Assignee: Xueshan Technologies Inc. (Wi-LAN Inc.)
• Original Assignee: MediaTek, Inc.
• Inventors: Wei, Ming-Chi
• Primary Examiner(s): Wu, Jingge
• Application Number:
  US13/870,970
• Publication Number:
  US 20140321741A1
• Time in Patent Office: 1,048 Days
• US Class Current: 1/1
• CPC Class Codes: G06T 3/4015 Image demosaicing, e.g. colour filter arrays [CFA] or Bayer patterns

Abstract

An embodiment of the invention provides a method of processing a mosaicked image. First, the mosaicked image is up-sampled along a first direction to generate a first intermediate image. Then, the first intermediate image is resized along the first direction to generate a second intermediate image. Next, the second intermediate image is up-sampled along a second direction to generate a third intermediate image. Afterward, the third intermediate image is resized along the second direction to generate a resized and partly demosaicked image.

Claims

1. A method of processing a mosaicked image, comprising:

up-sampling the mosaicked image along a first direction to generate a first intermediate image;

resizing the first intermediate image along the first direction to generate a second intermediate image comprising at least one full-sampled color plane and at least one sub-sampled color plane;

up-sampling the second intermediate image along a second direction to generate a third intermediate image; and

resizing the third intermediate image along the second direction to generate a resized and partly demosaicked image.

2. The method of claim 1, wherein the step of up-sampling the mosaicked image along the first direction to generate the first intermediate image comprises:

in each color plane of the mosaicked image, up-sampling each sub-sampled line along the first direction through interpolation along the first direction.

3. The method of claim 1, wherein the step of up-sampling the second intermediate image along the second direction to generate the third intermediate image comprises:

in each color plane of the second intermediate image, up-sampling each sub-sampled line along the second direction through interpolation along the second direction.

4. The method of claim 1, wherein odd lines along the first direction in a first color plane of the mosaicked image are sub-sampled, even lines along the first direction in a second color plane of the mosaicked image are sub-sampled, and all lines along the first direction in a third color plane of the mosaicked image are sub-sampled, and the step of up-sampling the mosaicked image along the first direction to generate the first intermediate image comprises:

converting the odd lines along the first direction in the first color plane into full-sampled lines;

converting the even lines along the first direction in the second color plane into full-sampled lines; and

converting all the lines along the first direction in the third color plane into full-sampled lines.

5. The method of claim 1, wherein odd lines along the second direction in a first color plane of the second intermediate image are sub-sampled, even lines along the second direction in a second color plane of the second intermediate image are sub-sampled, and all lines along the second direction in a third color plane of the second intermediate image are full-sampled, and the step of up-sampling the second intermediate image along the second direction to generate the third intermediate image comprises:

converting the odd lines along the second direction in the first color plane into full-sampled lines; and

converting the even lines along the second direction in the second color plane into full-sampled lines.

6. The method of claim 1, wherein a resolution of the mosaicked image is the same as a resolution of the first intermediate image.

7. The method of claim 1, wherein a resolution of the second intermediate image is the same as a resolution of the third intermediate image.

8. The method of claim 1, wherein a resolution of the resized and partly demosaicked image is smaller than a resolution of the mosaicked image.

9. A method of processing a mosaicked image, comprising:

up-sampling the mosaicked image along a first direction to generate a first intermediate image;

resizing the first intermediate image along the first direction to generate a second intermediate image comprising at least one full-sampled color plane and at least one sub-sampled color plane;

up-sampling the second intermediate image along a second direction to generate a third intermediate image;

resizing the third intermediate image along the second direction to generate a resized and partly demosaicked image; and

processing the resized and partly demosaicked image to generate a demosaicked and processed image.

10. The method of claim 9, wherein the step of up-sampling the mosaicked image along the first direction to generate the first intermediate image comprises:

in each color plane of the mosaicked image, up-sampling each sub-sampled line along the first direction through interpolation along the first direction.

11. The method of claim 9, wherein the step of up-sampling the second intermediate image along the second direction to generate the third intermediate image comprises:

in each color plane of the second intermediate image, up-sampling each sub-sampled line along the second direction through interpolation along the second direction.

12. The method of claim 9, wherein odd lines along the first direction in a first color plane of the mosaicked image are sub-sampled, even lines along the first direction in a second color plane of the mosaicked image are sub-sampled, and all lines along the first direction in a third color plane of the mosaicked image are sub-sampled, and the step of up-sampling the mosaicked image along the first direction to generate the first intermediate image comprises:

converting the odd lines along the first direction in the first color plane into full-sampled lines;

converting the even lines along the first direction in the second color plane into full-sampled lines; and

converting all the lines along the first direction in the third color plane into full-sampled lines.

13. The method of claim 9, wherein odd lines along the second direction in a first color plane of the second intermediate image are sub-sampled, even lines along the second direction in a second color plane of the second intermediate image are sub-sampled, and all lines along the second direction in a third color plane of the second intermediate image are full-sampled, and the step of up-sampling the second intermediate image along the second direction to generate the third intermediate image comprises:

converting the odd lines along the second direction in the first color plane into full-sampled lines; and

converting the even lines along the second direction in the second color plane into full-sampled lines.

14. The method of claim 9, wherein a resolution of the mosaicked image is the same as a resolution of the first intermediate image.

15. The method of claim 9, wherein a resolution of the second intermediate image is the same as a resolution of the third intermediate image.

16. The method of claim 9, wherein a resolution of the resized and partly demosaicked image is smaller than a resolution of the mosaicked image.

17. The method of claim 9, wherein the step of processing the resized and partly demosaicked image to generate the demosaicked and processed image comprises:

performing demosaicking, gamma correction, color correction, noise reduction, and edge enhancement.