IMAGE SIGNAL PROCESSOR LINE BUFFER CONFIGURATION FOR PROCESSING RAW IMAGE DATA
First Claim
1. A method for processing image data using an image signal processing system comprising:
- using a digital image sensor to acquire raw image data comprising a plurality of raw pixels representative of an image scene;
providing the raw pixels to a raw image processing pipeline comprising a set of line buffers;
processing the raw pixels using the raw image processing pipeline, wherein processing the raw pixels using the raw image processing pipeline comprises;
applying a first set of gain, offset, and clamping parameters to the raw pixels using gain, offset, and clamping logic implemented in a first line of logic;
using defective pixel correction logic implemented using a first line of logic and a first subset of the set of line buffers to apply a defective pixel correction operation to the raw pixels;
using noise reduction logic implemented using the set of line buffers to apply noise reduction to the raw pixels;
using lens shading correction logic implemented using a second subset of the set of line buffers to apply lens shading correction to the raw pixels;
applying a second of gain, offset, and clamping parameters to the raw pixels using the second subset of line buffers; and
using demosaicing logic implemented using the second subset of line buffers to demosaic the raw pixels into corresponding color RGB pixels.
1 Assignment
0 Petitions
Accused Products
Abstract
The present disclosure provides techniques relates to the implementation of a raw pixel processing unit using a set of line buffers. In one embodiment, the set of line buffers may include a first subset and second subset. Various logical units of the raw pixel processing unit may be implemented using the first and second subsets of line buffers in a shared manner. For instance, in one embodiment, defective pixel correction and detection logic may be implemented using the first subset of line buffers. The second subset of line buffers may be used to implement lens shading correction logic, gain, offset, and clamping logic, and demosaicing logic. Further, noise reduction may also be implemented using at least a portion of each of the first and second subsets of line buffers.
-
Citations
29 Claims
-
1. A method for processing image data using an image signal processing system comprising:
-
using a digital image sensor to acquire raw image data comprising a plurality of raw pixels representative of an image scene; providing the raw pixels to a raw image processing pipeline comprising a set of line buffers; processing the raw pixels using the raw image processing pipeline, wherein processing the raw pixels using the raw image processing pipeline comprises; applying a first set of gain, offset, and clamping parameters to the raw pixels using gain, offset, and clamping logic implemented in a first line of logic; using defective pixel correction logic implemented using a first line of logic and a first subset of the set of line buffers to apply a defective pixel correction operation to the raw pixels; using noise reduction logic implemented using the set of line buffers to apply noise reduction to the raw pixels; using lens shading correction logic implemented using a second subset of the set of line buffers to apply lens shading correction to the raw pixels; applying a second of gain, offset, and clamping parameters to the raw pixels using the second subset of line buffers; and using demosaicing logic implemented using the second subset of line buffers to demosaic the raw pixels into corresponding color RGB pixels. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. An image signal processing system comprising:
-
an image processing pipeline comprising a raw pixel processing unit, wherein the raw pixel processing unit is configured to process and convert raw pixels acquired using a digital image sensor into corresponding color RGB pixels and comprises a first row of logic and a plurality of line buffers comprising a first subset of line buffers and a second subset of line buffers; wherein the first subset of line buffers comprises a first line buffer configured to receive a first output from the first row of logic, a second line buffer configured to receive a second output from the first line buffer, a third line buffer configured to receive a third output from the second line buffer, a fourth line buffer configured to receive a fourth output from the third line buffer, and a fifth line buffer configured to receive a fifth output from the fourth line buffer; wherein the second subset of line buffers comprises a sixth line buffer configured to receive a sixth output from the fifth line buffer, a seventh line buffer configured to receive a seventh output from the sixth line buffer, an eighth line buffer configured to receive an eighth output from the seventh line buffer, a ninth line buffer configured to receive a ninth output from the eighth line buffer, and a tenth line buffer configured to receive a tenth output from the ninth line buffer. - View Dependent Claims (10, 11, 12, 13, 14, 15)
-
-
16. A method for implementing a raw processing pipeline of an image signal processing system comprising:
-
providing a first line of logic configured to receive raw image pixels acquire using an image sensor; providing an arrangement of line buffers comprising a first subset of line buffers and a second subset of line buffers, wherein the first subset of line buffers comprises a first line buffer, a second line buffer, a third line buffer, a fourth line buffer, and a fifth line buffer, and wherein the second subset of logic comprises a sixth line buffer, a seventh line buffer, an eighth line buffer, a ninth line buffer, and a tenth line buffer; and communicatively coupling an output of the first line of logic to an input of the first line buffer, an output of the first line buffer to an input of the second line buffer, an output of the second line buffer to an input of the third line buffer, an output of the third line buffer to an input of the fourth line buffer, an output of the fourth line buffer to an input of the fifth line buffer, an output of the fifth line buffer to an input of the sixth line buffer, an output of the sixth line buffer to an input of the seventh line buffer, an output of the seventh line buffer to an input of the eighth line buffer, an output of the eighth line buffer to an input of the ninth line buffer, and an output of the ninth line buffer to an input of the tenth line buffer; wherein the raw pixel processing pipeline is configured to process the raw image pixels to produce corresponding RGB image pixels. - View Dependent Claims (17, 18, 19, 20)
-
-
21. An electronic device comprising:
-
an image sensor configured to acquire raw image data comprising a plurality of raw pixels representative of an image scene; an image signal processing sub-system; and a sensor interface configured to provide the raw pixels from the image sensor to the image signal processing sub-system, wherein the image signal processing sub-system comprises an image pixel processing pipeline having a raw pixel processing unit comprising; a first gain, offset, and clamping logic implemented using a first row of logic; a first subset of line buffers comprising a first line buffer, a second line buffer, a third line buffer, a fourth line buffer, and a fifth line buffer; a second subset of line buffers comprising a sixth line buffer, a seventh line buffer, an eighth line buffer, a ninth line buffer, and a tenth line buffer; defective pixel correction and detection unit implemented using the first row of logic and at least a portion of the first subset of line buffers; noise reduction logic implemented using the first row of logic, the first subset of line buffers, and the second subset of line buffers; lens shading correction logic implemented using the second subset of line buffers; a second gain, offset, and clamping logic implemented using the second subset of line buffers; and demosaicing logic implemented using the second subset of line buffers, wherein the demosaicing logic is configured to convert the raw pixels into RGB pixels. - View Dependent Claims (22, 23, 24, 25, 26, 27, 28, 29)
-
Specification