Method and system for automatic gain control of sensors in time-of-flight systems
First Claim
1. For use with a time-of-flight (TOF) system that illuminates a target, a distance z from said TOF system, with optical energy having a modulated periodic waveform that includes a high frequency component, and that detects a fraction of said illumination with an array of pixel photodetectors operable in at least two phases to determine data proportional to said distance z, a method to automatically control detection gain of said pixel photodetectors, the method comprising the following steps:
- (a) identifying which of said pixel photodetectors are receiving excessive levels of optical energy to output reliable detection data, which of said pixel photodetectors are receiving insufficient levels of optical energy to output reliable detection data, and which of said pixel photodetectors are receiving adequate levels of optical energy to output reliable detection data;
(b) designating one of at least three groups into which pixel photodetectors identified in step (a) are placed, comprising (i) said pixel photodetectors receiving excessive levels of optical energy, (ii) said pixel photodetectors receiving insufficient levels of optical energy, and (iii) said pixel photodetectors receiving adequate levels of optical energy; and
(c) if a highest number of said pixel photodetectors are members of a group comprising (i) said pixel photodetectors receiving excessive levels of optical energy, varying at least one system parameter associated with said TOF system to reduce levels of optical energy presented to said pixel photodetectors; and
if a highest number of said pixel photodetectors are members of a group comprising (ii) said pixel photodetectors receiving insufficient levels of optical energy, varying at least one system parameter associated with said TOF system to increase levels of optical energy presented to said pixel photodetectors.
3 Assignments
0 Petitions
Accused Products
Abstract
Performance of pixel detectors in a TOF imaging system is dynamically adjusted to improve dynamic range to maximize the number of pixel detectors that output valid data. The invention traverses the system-acquired z depth, the brightness, and the active brightness images, and assigns each pixel a quantized value. Quantization values encompass pixels receiving too little light, normal light, to too much light. Pixels are grouped into quantized category groups, whose populations are represented by a histogram. If the number of pixels in the normal category exceeds a threshold, no immediate corrective action is taken. If the number of pixel receiving too little (or too much) light exceeds those receiving too much (or too little) light, the invention commands at least one system parameter change to increase (or decrease) light reaching the pixels. Controllable TOF system parameters can include exposure time, common mode resets, video gain, among others.
39 Citations
20 Claims
-
1. For use with a time-of-flight (TOF) system that illuminates a target, a distance z from said TOF system, with optical energy having a modulated periodic waveform that includes a high frequency component, and that detects a fraction of said illumination with an array of pixel photodetectors operable in at least two phases to determine data proportional to said distance z, a method to automatically control detection gain of said pixel photodetectors, the method comprising the following steps:
-
(a) identifying which of said pixel photodetectors are receiving excessive levels of optical energy to output reliable detection data, which of said pixel photodetectors are receiving insufficient levels of optical energy to output reliable detection data, and which of said pixel photodetectors are receiving adequate levels of optical energy to output reliable detection data;
(b) designating one of at least three groups into which pixel photodetectors identified in step (a) are placed, comprising (i) said pixel photodetectors receiving excessive levels of optical energy, (ii) said pixel photodetectors receiving insufficient levels of optical energy, and (iii) said pixel photodetectors receiving adequate levels of optical energy; and
(c) if a highest number of said pixel photodetectors are members of a group comprising (i) said pixel photodetectors receiving excessive levels of optical energy, varying at least one system parameter associated with said TOF system to reduce levels of optical energy presented to said pixel photodetectors; and
if a highest number of said pixel photodetectors are members of a group comprising (ii) said pixel photodetectors receiving insufficient levels of optical energy, varying at least one system parameter associated with said TOF system to increase levels of optical energy presented to said pixel photodetectors. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. For use with a time-of-flight (TOF) system that illuminates a target, a distance z from said TOF system, with optical energy having a modulated periodic waveform that includes a high frequency component, and that detects a fraction of said illumination with an array of pixel photodetectors operable in at least two phases to determine data proportional to said distance z, a control system to automatically control detection gain of said pixel photodetectors, the control system comprising:
-
means for identifying which of said pixel photodetectors are receiving excessive levels of optical energy to output reliable detection data, which of said pixel photodetectors are receiving insufficient levels of optical energy to output reliable detection data, and which of said pixel photodetectors are receiving adequate levels of optical energy to output reliable detection data;
means for designating one of at least three groups into which pixel photodetectors identified by said means for identifying are placed, designation choices comprising (i) said pixel photodetectors receiving excessive levels of optical energy, (ii) said pixel photodetectors receiving insufficient levels of optical energy, and (iii) said pixel photodetectors receiving adequate levels of optical energy; and
means for varying at least one system parameter associated with said TOF system;
wherein said means for varying varies at least one system parameter associated with said TOF system to reduce levels of optical energy presented to said pixel photodetectors if said means for designating determines that a highest number of said pixel photodetectors are members of a group comprising said pixel photodetectors receiving excessive levels of optical energy; and
wherein said means for varying varies at least one system parameter associated with said TOF system to increase levels of optical energy presented to said pixel photodetectors if a highest number of said pixel photodetectors are members of a group comprising said pixel photodetectors receiving insufficient levels of optical energy. - View Dependent Claims (8, 9, 10, 11)
-
-
12. For use with a time-of-flight (TOF) system that illuminates a target, a distance z from said TOF system, with optical energy having a modulated periodic waveform that includes a high frequency component, and that detects a fraction of said illumination with an array of pixel photodetectors operable in at least two phases to determine data proportional to said distance z, a method to automatically control detection gain of said pixel photodetectors, the method comprising the following steps:
-
(a) identifying from a passive brightness image acquired by said TOF system which of said pixel photodetectors are receiving excessive levels of optical energy to output reliable detection data, and identifying from an active brightness image which of said pixel photodetectors are receiving insufficient levels of optical energy to output reliable detection data and forming a histogram of such identification;
(b) using identification information from step (a) to form a histogram representing number of said pixel photodetectors receiving excessive levels of optical energy, number of said pixel photodetectors receiving insufficient levels of optical energy, and number of said pixel photodetectors receiving neither excessive nor insufficient levels of optical energy;
(c) estimating variation in at least one system parameter of said TOF system to produce a change in light Δ
L that increases said number of said pixel photodetectors receiving neither excessive nor insufficient levels of optical energy;
(d) varying at least one system parameter of said TOF system to increase said number of said pixel photodetectors receiving neither excessive nor insufficient levels of optical energy. - View Dependent Claims (13, 14)
-
-
15. For use with a time-of-flight (TOF) system that illuminates a target, a distance z from said TOF system, with optical energy having a modulated periodic waveform that includes a high frequency component, and that detects a fraction of said illumination with an array of pixel photodetectors operable in at least two phases to determine data proportional to said distance z, a control system to automatically control detection gain of said pixel photodetectors, said control system comprising:
-
means for identifying from a passive brightness image acquired by said TOF system which of said pixel photodetectors are receiving excessive levels of optical energy to output reliable detection data, and for identifying from an active brightness image which of said pixel photodetectors are receiving insufficient levels of optical energy to output reliable detection data and forming a histogram of such identification;
means for forming a histogram, using identification information from said means for identifying, representing number of said pixel photodetectors receiving excessive levels of optical energy, number of said pixel photodetectors receiving insufficient levels of optical energy, and number of said pixel photodetectors receiving neither excessive nor insufficient levels of optical energy;
means for estimating variation in at least one system parameter of said TOF system to produce a change in light Δ
L that increases said number of said pixel photodetectors receiving neither excessive nor insufficient levels of optical energy; and
means for varying at least one system parameter of said TOF system to increase said number of said pixel photodetectors receiving neither excessive nor insufficient levels of optical energy. - View Dependent Claims (16, 17)
-
-
18. For use with a time-of-flight (TOF) system that illuminates a target, a distance z from said TOF system, with optical energy having a modulated periodic waveform that includes a high frequency component, and that detects a fraction of said illumination with an array of pixel photodetectors operable in at least two phases to determine data proportional to said distance z, a method to automatically control detection gain of said pixel photodetectors, the method comprising the following steps:
-
(a) identifying from a passive brightness image acquired by said TOF system which of said pixel photodetectors are receiving excessive levels of optical energy to output reliable detection data, and identifying from an active brightness image which of said pixel photodetectors are receiving insufficient levels of optical energy to output reliable detection data and forming a histogram of such identification;
(b) using identification information from step (a) to traverse said active brightness image and said passive brightness image to determine therefrom number of said pixel photodetectors receiving insufficient levels of optical energy, and number of said pixel photodetectors receiving neither excessive nor insufficient levels of optical energy;
(c) estimating variation in at least one system parameter of said TOF system to produce a change in light Δ
L that increases said number of said pixel photodetectors receiving neither excessive nor insufficient levels of optical energy; and
(d) varying at least one system parameter of said TOF system to increase said number of said pixel photodetectors receiving neither excessive nor insufficient levels of optical energy. - View Dependent Claims (19)
-
-
20. For use with a time-of-flight (TOF) system that illuminates a target, a distance z from said TOF system, with optical energy having a modulated periodic waveform that includes a high frequency component, and that detects a fraction of said illumination with an array of pixel photodetectors operable in at least two phases to determine data proportional to said distance z, a control system to automatically control detection gain of said pixel photodetectors, the control system comprising:
-
means for identifying from a passive brightness image acquired by said TOF system which of said pixel photodetectors are receiving excessive levels of optical energy to output reliable detection data, and identifying from an active brightness image which of said pixel photodetectors are receiving insufficient levels of optical energy to output reliable detection data and forming a histogram of such identification;
means for traversing said active brightness image and said passive brightness image and for determining therefrom number of said pixel photodetectors receiving insufficient levels of optical energy, and number of said pixel photodetectors receiving neither excessive nor insufficient levels of optical energy;
means for estimating variation in at least one system parameter of said TOF system to produce a change in light Δ
L that increases said number of said pixel photodetectors receiving neither excessive nor insufficient levels of optical energy; and
means for varying at least one system parameter of said TOF system to increase said number of said pixel photodetectors receiving neither excessive nor insufficient levels of optical energy.
-
Specification