Single Image Sensor for Capturing Mixed Structured-light Images and Regular Images
First Claim
1. An integrated image sensor, comprising:
- a pixel array being responsive to light energy received by the pixel array to produce pixel signals having a voltage level depending on the light energy received by the pixel array;
one or more output circuits coupled to the pixel array to access the pixel signals produced by the pixel array;
one or more analog-to-digital converters having a first dynamic range and a second dynamic range;
one or more timing and control circuits coupled to the pixel array, said one or more output circuits, said one or more analog-to-digital converters or a combination thereof, wherein said one or more timing and control circuits are arranged to;
capture, by the pixel array, a structured-light image formed on a common image plane during a first frame period by applying first reset signals to the pixel array to reset rows of pixels of the pixel array, exposing the rows of pixels of the pixel array to structured light to cause first analog signals from the rows of pixels, and converting the first analog signals from the rows of pixels of the pixel array into first digital outputs for the structured-light image using one or more analog-to-digital converters; and
capture, by the pixel array, a regular image formed on the common image plane during a second frame period longer than the first frame period by applying second reset signals to the pixel array to reset the rows of pixels of the pixel array, exposing the rows of pixels to non-structured light to cause second analog signals from the rows of pixels, and converting the second analog signals from the rows of pixels into second digital outputs for the regular image using said one or more analog-to-digital converters; and
wherein the structured-light image is captured before or after the regular image to derive depth or shape information for the regular image.
0 Assignments
0 Petitions
Accused Products
Abstract
An integrated image sensor for capturing a mixed structured-light image and regular image using an integrated image sensor are disclosed. The integrated image sensor comprises a pixel array, one or more output circuits, one or more analog-to-digital converters, and one or more timing and control circuits. The timing and control circuits are arranged to perform a set of actions including capturing a regular image and a structured-light image. According to the present invention, the structured-light image captured before or after the regular image is used to derive depth or shape information for the regular image. An endoscope based on the above integrated image sensor is also disclosed. The endoscope may comprises a capsule housing adapted to be swallowed, where the components of integrated image sensor, a structured light source and a non-structured light source are enclosed and sealed in the capsule housing.
-
Citations
18 Claims
-
1. An integrated image sensor, comprising:
-
a pixel array being responsive to light energy received by the pixel array to produce pixel signals having a voltage level depending on the light energy received by the pixel array; one or more output circuits coupled to the pixel array to access the pixel signals produced by the pixel array; one or more analog-to-digital converters having a first dynamic range and a second dynamic range; one or more timing and control circuits coupled to the pixel array, said one or more output circuits, said one or more analog-to-digital converters or a combination thereof, wherein said one or more timing and control circuits are arranged to; capture, by the pixel array, a structured-light image formed on a common image plane during a first frame period by applying first reset signals to the pixel array to reset rows of pixels of the pixel array, exposing the rows of pixels of the pixel array to structured light to cause first analog signals from the rows of pixels, and converting the first analog signals from the rows of pixels of the pixel array into first digital outputs for the structured-light image using one or more analog-to-digital converters; and capture, by the pixel array, a regular image formed on the common image plane during a second frame period longer than the first frame period by applying second reset signals to the pixel array to reset the rows of pixels of the pixel array, exposing the rows of pixels to non-structured light to cause second analog signals from the rows of pixels, and converting the second analog signals from the rows of pixels into second digital outputs for the regular image using said one or more analog-to-digital converters; and wherein the structured-light image is captured before or after the regular image to derive depth or shape information for the regular image. - View Dependent Claims (2, 3, 4)
-
-
5. An endoscope, comprising:
-
a pixel array being responsive to light energy received by the pixel array to produce pixel signals having a voltage level depending on the light energy received by the pixel array; a structured light source; a non-structured light source; one or more output circuits coupled to the pixel array to access the pixel signals produced by the pixel array; one or more analog-to-digital converters having a first dynamic range and a second dynamic range; one or more timing and control circuits, wherein said one or more timing and control circuits are coupled to the pixel array, said one or more output circuits, said one or more analog-to-digital converters, or a combination thereof, wherein said one or more timing and control circuits are arranged to; capture, by the pixel array, a structured-light image formed on a common image plane during a first frame period by applying first reset signals to the pixel array to reset rows of pixels of the pixel array, exposing the rows of pixels of the pixel array to first illumination from the structured light source to cause first analog signals from the rows of pixels and converting the first analog signals from the rows of pixels of the pixel array into first digital outputs for the structured-light image using one or more analog-to-digital converters; and capture, by the pixel array, a regular image formed on the common image plane during a second frame period longer than the first frame period by applying second reset signals to the pixel array to reset the rows of pixels of the pixel array, exposing the rows of pixels to second illumination from the non-structured light source to cause second analog signals from the rows of pixels, and converting the second analog signals from the rows of pixels into second digital outputs for the regular image using said one or more analog-to-digital converters; and wherein the structured-light image is captured before or after the regular image to derive depth or shape information for the regular image. - View Dependent Claims (6, 7, 8, 9)
-
-
10. A camera system, comprising:
-
a pixel array being responsive to light energy received by the pixel array to produce pixel signals data having a voltage level depending on the light energy received by the pixel array; a structured light source; a non-structured light source; one or more output circuits coupled to the pixel array to access pixel signals produced by the pixel array; one or more analog-to-digital converters having a first dynamic range and a second dynamic range; one or more timing and control circuits coupled to the pixel array, said one or more output circuits, said one or more analog-to-digital converters, the structured light source, the non-structured light source, or a combination thereof, wherein said one or more timing and control circuits are configured to; capture, by the pixel array, a structured-light image formed on a common image plane during a first frame period by applying first reset signals to the pixel array to reset rows of pixels of the pixel array, exposing the rows of pixels of the pixel array to first illumination from the structured light source to cause first analog signals from the rows of pixels and converting the first analog signals from the rows of pixels of the pixel array into first digital outputs for the structured-light image using one or more analog-to-digital converters; and capture, by the pixel array, a first regular image formed on the common image plane during a second frame period by applying second reset signals to the pixel array to reset the rows of pixels of the pixel array, exposing the rows of pixels to second illumination from the non-structured light source to cause second analog signals from the rows of pixels, and converting the second analog signals from the rows of pixels into second digital outputs for the first regular image using said one or more analog-to-digital converters; and capture, by the pixel array, a second regular image formed on the common image plane during a third frame period by applying third reset signals to the pixel array to reset the rows of pixels of the pixel array, exposing the rows of pixels to the second illumination from the non-structured light source to cause third analog signals from the rows of pixels, and converting the third analog signals from the rows of pixels into third digital outputs for the second regular image using said one or more analog-to-digital converters; combine the second digital outputs and the third digital outputs to form a combined regular image; and wherein the structured-light image is captured between the first regular image and the second regular image to derive depth or shape information for the combined regular image, and the first frame period is shorter than a sum of the second frame period and the third frame period. - View Dependent Claims (11, 12, 13)
-
-
14. An endoscope for in vivo viewing, comprising:
-
a pixel array being responsive to light energy received by the pixel array to produce pixel signals having a voltage level depending on the light energy received by the pixel array; a structured light source; a non-structured light source; one or more output circuits coupled to the pixel array to access the pixel signals produced by the pixel array; one or more analog-to-digital converters having a first dynamic range and a second dynamic range; one or more timing and control circuits coupled to the pixel array, said one or more output circuits, said one or more analog-to-digital converters, the structured light source, the non-structured light source, or a combination thereof, wherein said one or more timing and control circuits are configured to; capture, by the pixel array, a structured-light image formed on a common image plane during a first frame period by applying first reset signals to the pixel array to reset rows of pixels of the pixel array, exposing the rows of pixels of the pixel array to first illumination from the structured light source to cause first analog signals from the rows of pixels and converting the first analog signals from the rows of pixels of the pixel array into first digital outputs for the structured-light image using one or more analog-to-digital converters; and capture, by the pixel array, a first regular image formed on the common image plane during a second frame period by applying second reset signals to the pixel array to reset the rows of pixels of the pixel array, exposing the rows of pixels to an ambient light or second illumination from the non-structured light source to cause second analog signals from the rows of pixels, and converting the second analog signals from the rows of pixels into second digital outputs for the first regular image using said one or more analog-to-digital converters; and capture, by the pixel array, a second regular image formed on the common image plane during a third frame period by applying third reset signals to the pixel array to reset the rows of pixels of the pixel array, exposing the rows of pixels to the ambient light or the second illumination from the non-structured light source to cause third analog signals from the rows of pixels, and converting the third analog signals from the rows of pixels into third digital outputs for the second regular image using said one or more analog-to-digital converters; combine the second digital outputs and the third digital outputs to form a combined regular image; and wherein the structured-light image is captured between the first regular image and the second regular image, and the first frame period is shorter than a sum of the second frame period and the third frame period. - View Dependent Claims (15, 16, 17, 18)
-
Specification