Method of processing image of electronic device and electronic device thereof

• US 10,182,196 B2
• Filed: 09/29/2016
• Issued: 01/15/2019
• Est. Priority Date: 10/06/2015
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Park, Byeong-Chan
• Primary Examiner(s): Prabhakher, Pritham D
• Application Number:
  US15/279,804
• Publication Number:
  US 20170099444A1
• Time in Patent Office: 838 Days
• Field of Search: 348364
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/675 comprising setting of focusing regions
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 25/44 by partially reading an SSIS array
• CPC Class Codes: H04N 25/46 by combining or binning pixels

Abstract

According to various embodiments of the present disclosure, an electronic device includes: a camera module that obtains an image; and a processor which implements the method, including setting a quadrangular area in the obtained image including a reference pixel and a corresponding pixel disposed respectively at corners of the quadrangular area, calculating an accumulated-pixel value for each pixel of the obtained image corresponding to the quadrangular area, such that a particular pixel value for a particular pixel is a sum of the pixel values beginning from the reference pixel, continuing though an arrangement of pixels in the quadrangular area and terminating at the particular pixel, and generating an image quality processing-dedicated frame of accumulated-pixel values based on calculated accumulated-pixel values of each pixel of the frame.

Claims

1. An electronic device, comprising:

a camera that obtains an image;

at least one processor; and

memory storing programming instructions executable by the at least one processor to cause the electronic device to;

set a quadrangular area in the obtained image including a reference pixel and a corresponding pixel disposed respectively at corners of the quadrangular area,

calculate an accumulated-pixel value for each pixel of the obtained image corresponding to the quadrangular area including a lower-right corner pixel, an upper-left corner pixel, an upper-right corner pixel, and a lower-left corner pixel, such that a particular pixel value for a particular pixel is a sum of the pixel values beginning from the reference pixel, continuing through an arrangement of pixels in the quadrangular area and terminating at the particular pixel; and

generate an image quality processing-dedicated frame of accumulated-pixel values based on calculated accumulated-pixel values of each pixel of the frame,

wherein calculating the accumulated-pixel value includes adding pixel values of the lower-right corner pixel to the upper-left corner pixel and subtracting pixel values of the upper-right corner pixel and lower-left corner pixel.

2. The electronic device of claim 1, wherein the programming instructions are further executable by the at least one processor to reduce a size of the generated image quality processing-dedicated frame using at least one of sub-sampling and binning.

3. The electronic device of claim 1, wherein the programming instructions are further executable by the at least one processor to reduce a size of the frame using at least one of sub-sampling and binning.

4. The electronic device of claim 1, wherein the programming instructions are further executable by the at least one processor to perform data processing on the frame to generate image quality data associated with the frame.

5. The electronic device of claim 4, wherein the image quality data includes at least one of auto focus (AF) data, auto white balance (AWB) data, and auto exposure (AE) data.

6. An image processing method for an electronic device, comprising:

obtaining an image through a camera of the electronic device;

setting a quadrangular area in the obtained image including a reference pixel and a corresponding pixel disposed respectively at corners of the quadrangular area;

calculating an accumulated-pixel value for each pixel of the obtained image corresponding to the quadrangular area including a lower-right corner pixel, an upper-left corner pixel, an upper-right corner pixel, and a lower-left corner pixel, such that a particular pixel value for a particular pixel is a sum of the pixel values beginning from the reference pixel, continuing through an arrangement of pixels in the quadrangular area and terminating at the particular pixel; and

generating an image quality processing-dedicated frame of accumulated-pixel values based on calculated accumulated-pixel values of each pixel of the frame,

wherein calculating the accumulated-pixel value includes adding pixel values of the lower-right corner pixel to the upper-left corner pixel and subtracting pixel values of the upper-right corner pixel and lower-left corner pixel.

7. The method of claim 6, further comprising:

reducing a size of the generated image quality processing-dedicated frame using at least one of sub-sampling and binning.

8. The method of claim 6, wherein the calculating of the accumulated-pixel value comprises:

reducing a size of the frame using at least one of sub-sampling and binning.

9. The method of claim 6, wherein the calculating of the accumulated-pixel value comprises:

performing data processing on the frame to generate image quality data associated with the frame.

10. The method of claim 9, wherein the image quality data includes at least one of auto focus (AF) data, auto white balance (AWB) data, and auto exposure (AE) data.

11. An electronic device, comprising:

a camera that obtains an image;

at least one processor; and

memory storing programming instructions executable by the at least one processor to cause the electronic device to;

generate an image quality processing-dedicated frame with respect to the obtained image based on the obtained image, and

set at least one of;

a first region of interest disposed within the obtained image using the generated image quality processing-dedicated frame, and

a second region of interest having a size or disposed at a location differing from at least one of a size and location of the first region of interest, respectively, and

set a quadrangular area in the obtained image including a reference pixel and a corresponding pixel disposed respectively at corners of the quadrangular area,

wherein the first region of interest includes the quadrangular area, and the programming instructions are further executable by the at least one processor to obtain data of the first region of interest from the generated image quality processing-dedicated frame by;

adding a first pixel value of a first pixel disposed at a first corner of the quadrangular area to a second pixel value of a second pixel disposed at a second corner of the quadrangular area, the first corner diagonally opposite the second corner, and the first pixel disposed farther from the reference pixel among all pixels in the first region of interest, and

subtracting, from the sum of the first pixel value and the second pixel value, both a third pixel value of a third pixel disposed at a third corner of the quadrangular area and a fourth pixel value of a fourth pixel disposed at a fourth corner of the quadrangular area.

12. The electronic device of claim 11, wherein the programming instructions are further executable by the at least one processor to perform:

calculating, for each pixel of the frame, an accumulated-pixel value such that a particular pixel value for a particular pixel is a sum of the pixel values beginning from the reference pixel, continuing through an arrangement of pixels in the quadrangular area and terminating at the particular pixel; and

generating the image quality processing-dedicated frame including accumulated-pixel values based on calculated accumulated-pixel values for each pixel of the obtained image.

13. The electronic device of claim 12, wherein the programming instructions are further executable by the at least one processor to reduce a size of the generated image quality processing-dedicated frame using at least one of sub-sampling and binning.

14. The electronic device of claim 12, wherein second region of interest includes the quadrangular area, and the processor is configured to obtain data of the second region of interest from the generated image quality processing-dedicated frame by:

adding a first pixel value of a first pixel disposed at a first corner of the quadrangular area to a second pixel value of a second pixel disposed at a second corner of the quadrangular area, the first corner diagonally opposite the second corner, and the first pixel disposed farther from the reference pixel among all pixels in the first region of interest, and

subtracting, from the sum of the first pixel value and the second pixel value, both a third pixel value of a third pixel disposed at a third corner of the quadrangular area and a fourth pixel value of a fourth pixel disposed at a fourth corner of the quadrangular area.

15. An image processing method of an electronic device, comprising:

obtaining an image through a camera of the electronic device;

generating an image quality processing-dedicated frame with respect to the obtained image based on the obtained image; and

setting at least one of;

a first region of interest disposed within the obtained image using the generated image quality processing-dedicated frame, and

a second region of interest having a size or disposed at a location differing from at least one of a size and location of the first region of interest, respectively,

setting a quadrangular area in the obtained image including a reference pixel and a corresponding pixel disposed respectively at corners of the quadrangular area,

wherein the first region of interest includes the quadrangular area, and data of the first region of interest is obtained from the generated image quality processing-dedicated frame by;

adding a first pixel value of a first pixel disposed at a first corner of the quadrangular area to a second pixel value of a second pixel disposed at a second corner of the quadrangular area, the first corner diagonally opposite the second corner, and the first pixel disposed farther from the reference pixel among all pixels in the first region of interest, and

subtracting, from the sum of the first pixel value and the second pixel value, both a third pixel value of a third pixel disposed at a third corner of the quadrangular area and a fourth pixel value of a fourth pixel disposed at a fourth corner of the quadrangular area.

16. The method of claim 15, wherein the generating of the image quality processing-dedicated frame comprises:

calculating, for each pixel of the frame, an accumulated-pixel value such that a particular pixel value for a particular pixel is a sum of the pixel values beginning from the reference pixel, continuing through an arrangement of pixels in the quadrangular area and terminating at the particular pixel; and

generating the image quality processing-dedicated frame including accumulated-pixel values based on calculated accumulated-pixel values for each pixel of the frame.

17. The method of claim 16, further comprising:

reducing the size of the generated image quality processing-dedicated frame using at least one of sub-sampling and binning.

18. The method of claim 16, wherein second region of interest includes the quadrangular area, and the data of the second region of interest is obtained from the generated image quality processing-dedicated frame by:

adding a first pixel value of a first pixel disposed at a first corner of the quadrangular area to a second pixel value of a second pixel disposed at a second corner of the quadrangular area, the first corner diagonally opposite the second corner, and the first pixel disposed farther from the reference pixel among all pixels in the first region of interest, and

subtracting, from the sum of the first pixel value and the second pixel value, both a third pixel value of a third pixel disposed at a third corner of the quadrangular area and a fourth pixel value of a fourth pixel disposed at a fourth corner of the quadrangular area.