Image processing method and apparatus

• US 10,560,644 B2
• Filed: 09/16/2014
• Issued: 02/11/2020
• Est. Priority Date: 09/16/2014
• Status: Active Grant

• Current Assignee: Honor Device Company Limited
• Original Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Inventors: Ge, Fangyong, Wang, Yali
• Primary Examiner(s): Rahaman, Mohammed S
• Assistant Examiner(s): Lee, Jimmy S
• Application Number:
  US15/511,583
• Publication Number:
  US 20170289466A1
• Time in Patent Office: 1,974 Days
• Field of Search: 348 33
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: H04N 17/002 for television cameras
• CPC Class Codes: H04N 23/11 for generating image signals from visible and infrared light wavelengths
• CPC Class Codes: H04N 23/20 for generating image signals from infrared radiation only
• CPC Class Codes: H04N 23/70 Circuitry for compensating brightness variation in the scene
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 23/88 for colour balance, e.g. white-balance circuits or colour temperature control
• CPC Class Codes: H04N 23/95 Computational photography systems, e.g. light-field imaging systems
• CPC Class Codes: H04N 9/73 Colour balance circuits, e.g. white balance circuits or colour temperature control camera processing pipelines for colour balance H04N23/88

Abstract

An image processing method, including: obtaining image data of a photographed original image, and obtaining ambient infrared intensity I that is used when the original image is photographed; obtaining infrared image data corresponding to I according to a preset correspondence between tested infrared intensity and infrared image data; obtaining corrected image data according to the image data of the original image and the infrared image data corresponding to I; and obtaining a corresponding corrected image according to the corrected image data, and outputting the corrected image.

Claims

1. An image processing method, comprising:

photographing, by a terminal, an original image;

obtaining, by the terminal, image data of the original image and a measured ambient infrared intensity I corresponding to the original image;

removing, by the terminal, effects of ambient infrared light on the original image, wherein removing the effects of ambient infrared light on the original image comprises;

obtaining infrared image data which corresponds to the measured ambient infrared intensity I according to a pre-tested correspondence between tested infrared intensities and respective infrared image data;

obtaining corrected image data according to the image data of the original image and the infrared image data corresponding to the measured ambient infrared intensity I; and

obtaining a corrected image according to the corrected image data; and

outputting, by the terminal, the corrected image;

wherein the pre-tested correspondence is a relationship set comprising n groups of tested infrared intensities I_x, and infrared image data M_x, wherein n is a positive integer greater than 1;

wherein the infrared image data M_x is infrared image data obtained corresponding to the tested infrared intensities I_x for integer values of x from 1 to n;

wherein obtaining the infrared image data which corresponds to the measured ambient infrared intensity I according to the pre-tested correspondence comprises;

determining, from the pre-tested correspondence, that the measured ambient infrared intensity I is between a tested infrared intensity I_m and a tested infrared intensity I_m+1, wherein m is a positive integer less than n; and

determining, according to a preset selection policy, infrared image data M_m corresponding to the tested infrared intensity I_m or infrared image data M_m+1 corresponding to the tested infrared intensity I_m+1 as the infrared image data corresponding to the measured ambient infrared intensity I.

2. The method according to claim 1, wherein determining, according to the preset selection policy, the infrared image data M_m corresponding to the tested infrared intensity I_m or the infrared image data M_m+1 corresponding to the tested infrared intensity I_m+1 as the infrared image data corresponding to the measured ambient infrared intensity I comprises:

determining, according to a preset policy of selecting a lower limit, the infrared image data M_m corresponding to the tested infrared intensity I_m as the infrared image data corresponding to the measured ambient infrared intensity I.

3. The method according to claim 1, wherein determining, according to the preset selection policy, the infrared image data M_m corresponding to the tested infrared intensity I_m or the infrared image data M_m+1 corresponding to the tested infrared intensity I_m+1 as the infrared image data corresponding to the measured ambient infrared intensity I comprises:

according to a proximity selection policy;

determining the infrared image data M_m corresponding to the tested infrared intensity I_m as the infrared image data corresponding to the measured ambient infrared intensity I if a difference between the measured ambient infrared intensity I and the tested infrared intensity I_m is less than or equal to a difference between the tested infrared intensity I_m+1 and the measured ambient infrared intensity I;

or

determining the infrared image data M_m+1 corresponding to the tested infrared intensity I_m+1 as the infrared image data corresponding to the measured ambient infrared intensity I if a difference between the measured ambient infrared intensity I and the tested infrared intensity I_m is greater than a difference between the tested infrared intensity I_m+1 and the measured ambient infrared intensity I.

4. The method according to claim 1, wherein obtaining the corrected image data according to the image data of the original image and the infrared image data corresponding to the measured ambient infrared intensity I comprises:

obtaining the corrected image data by subtracting the infrared image data corresponding to the measured ambient infrared intensity I from the image data of the original image.

5. The method according to claim 1, wherein after obtaining the corrected image according to the corrected image data, the method further comprises:

performing, by the terminal, white balance processing on the corrected image, wherein the white balance processing corresponds to proportions of three primary colors being adjusted in different color temperature environments to achieve color balance.

11. The method according to claim 2, wherein after obtaining the corrected image according to the corrected image data, the method further comprises:

performing, by the terminal, white balance processing on the corrected image, wherein the white balance processing corresponds to proportions of three primary colors being adjusted in different color temperature environments to achieve color balance.

12. The method according to claim 3, wherein after obtaining the corrected image according to the corrected image data, the method further comprises:

performing, by the terminal, white balance processing on the corrected image, wherein the white balance processing corresponds to proportions of three primary colors being adjusted in different color temperature environments to achieve color balance.

6. A terminal, comprising:

a camera;

an infrared sensor;

a processor;

a memory; and

a display apparatus;

wherein the camera is configured to photograph an original image;

wherein the infrared sensor is configured to obtain a measured ambient infrared intensity I corresponding to the original image;

wherein the memory is configured to store a pre-tested correspondence between tested infrared intensities and respective infrared image data;

wherein the processor is configured to;

obtain image data of the photographed original image, and obtain the measured ambient infrared intensity I;

remove effects of ambient infrared light on the original image, wherein removing the effects of ambient infrared light on the original image comprises;

obtaining infrared image data corresponding to the measured ambient infrared intensity I according to the pre-tested correspondence;

obtaining corrected image data according to the image data of the original image and the infrared image data corresponding to the measured ambient infrared intensity I; and

obtaining a corrected image according to the corrected image data; and

output the corrected image to the display apparatus;

wherein the display apparatus is configured to display the corrected image;

wherein the pre-tested correspondence is a relationship set comprising n groups of tested infrared intensities I_x and infrared image data M_x, wherein n is a positive integer greater than 1;

wherein the infrared image data M_x is infrared image data obtained corresponding to the tested infrared intensities I_x for integer values of x from 1 to n;

wherein obtaining the infrared image data corresponding to the measured ambient infrared intensity I according to the pre-tested correspondence comprises;

determining, from the pre-tested correspondence, that the measured ambient infrared intensity I is between a tested infrared intensity I_m and a tested infrared intensity I_m+1, wherein m is a positive integer less than n; and

determining, according to a preset selection policy, infrared image data M_m corresponding to the tested infrared intensity I_m or infrared image data M_m+1 corresponding to the tested infrared intensity I_m+1 as the infrared image data corresponding to the measured ambient infrared intensity I.

7. The terminal according to claim 6, wherein determining, according to the preset selection policy, the infrared image data M_m corresponding to the tested infrared intensity I_m or the infrared image data M_m+1 corresponding to the tested infrared intensity I_m+1 as the infrared image data corresponding to the measured ambient infrared intensity I comprises:

determining, according to a preset policy of selecting a lower limit, the infrared image data M_m corresponding to the tested infrared intensity I_m as the infrared image data corresponding to the measured ambient infrared intensity I.

8. The terminal according to claim 6, wherein determining, according to the preset selection policy, the infrared image data M_m corresponding to the tested infrared intensity I_m or the infrared image data M_m+1 corresponding to the tested infrared intensity I_m+1 as the infrared image data corresponding to the measured ambient infrared intensity I comprises:

according to a proximity selection policy;

determining the infrared image data M_m corresponding to the tested infrared intensity I_m as the infrared image data corresponding to the measured ambient infrared intensity I if a difference between the measured ambient infrared intensity I and the tested infrared intensity I_m is less than or equal to a difference between the tested infrared intensity I_m+1 and the measured ambient infrared intensity I;

or

determining the infrared image data M_m+1 corresponding to the tested infrared intensity I_m+1 as the infrared image data corresponding to the measured ambient infrared intensity I if a difference between the measured ambient infrared intensity I and the tested infrared intensity I_m is greater than a difference between the tested infrared intensity I_m+1 and the measured ambient infrared intensity I.

9. The terminal according to claim 6, wherein obtaining the corrected image data according to the image data of the original image and the infrared image data corresponding to the measured ambient infrared intensity I comprises:

obtaining the corrected image data by subtracting the infrared image data corresponding to the measured ambient infrared intensity I from the image data of the original image.

10. The terminal according to claim 6, wherein the processor is further configured to:

after the corrected image is obtained according to the corrected image data, perform white balance processing on the corrected image, wherein the white balance processing corresponds to proportions of three primary colors being adjusted in different color temperature environments to achieve color balance.

13. The terminal according to claim 7, wherein the processor is further configured to:

after the corrected image is obtained according to the corrected image data, perform white balance processing on the corrected image, wherein the white balance processing corresponds to proportions of three primary colors being adjusted in different color temperature environments to achieve color balance.

14. The terminal according to claim 8, wherein the processor is further configured to:

after the corrected image is obtained according to the corrected image data, perform white balance processing on the corrected image, wherein the white balance processing corresponds to proportions of three primary colors being adjusted in different color temperature environments to achieve color balance.