Method and system for automatic gain control of sensors in time-of-flight systems
First Claim
1. For use with a time-of-flight (TOF) system that illuminates a target, a distance z from said TOF system, with emitted optical energy having a modulated periodic waveform that includes a high frequency component, and that detects a fraction of said emitted optical energy with an array of pixel photodetectors operable in at least two phases to determine data proportional to said distance z, said TOF system operable to determine distance z independently of reflectivity of said target, a method to automatically control detection gain of said pixel photodetectors, the method comprising the following steps:
- (a) identifying which of said pixel photodetectors are receiving excessive levels of emitted optical energy to output reliable detection data, which of said pixel photodetectors are receiving insufficient levels of emitted optical energy to output reliable detection data, and which of said pixel photodetectors are receiving adequate levels of emitted optical energy to output reliable detection data;
(b) designating one of at least three groups into which pixel photodetectors identified in step (a) are placed, comprising (i) said pixel photodetectors receiving excessive levels of emitted optical energy, (ii) said pixel photodetectors receiving insufficient levels of emitted optical energy, and (iii) said pixel photodetectors receiving adequate levels of emitted optical energy; and
(c) if a highest number of said pixel photodetectors are members of a group comprising (i) said pixel photodetectors receiving excessive levels of emitted optical energy, varying at least one system parameter associated with said TOF system to reduce levels of emitted optical energy presented to said pixel photodetectors; and
if a highest number of said pixel photodetectors are members of a group comprising (ii) said pixel photodetectors receiving insufficient levels of emitted optical energy, varying at least one system parameter associated with said TOF system to increase levels of emitted optical energy presented to said pixel photodetectors.
3 Assignments
0 Petitions
Accused Products
Abstract
Performance of pixel detectors in a TOF imaging system is dynamically adjusted to improve dynamic range to maximize the number of pixel detectors that output valid data. The invention traverses the system-acquired z depth, the brightness, and the active brightness images, and assigns each pixel a quantized value. Quantization values encompass pixels receiving too little light, normal light, to too much light. Pixels are grouped into quantized category groups, whose populations are represented by a histogram. If the number of pixels in the normal category exceeds a threshold, no immediate corrective action is taken. If the number of pixel receiving too little (or too much) light exceeds those receiving too much (or too little) light, the invention commands at least one system parameter change to increase (or decrease) light reaching the pixels. Controllable TOF system parameters can include exposure time, common mode resets, video gain, among others.
112 Citations
20 Claims
-
1. For use with a time-of-flight (TOF) system that illuminates a target, a distance z from said TOF system, with emitted optical energy having a modulated periodic waveform that includes a high frequency component, and that detects a fraction of said emitted optical energy with an array of pixel photodetectors operable in at least two phases to determine data proportional to said distance z, said TOF system operable to determine distance z independently of reflectivity of said target, a method to automatically control detection gain of said pixel photodetectors, the method comprising the following steps:
-
(a) identifying which of said pixel photodetectors are receiving excessive levels of emitted optical energy to output reliable detection data, which of said pixel photodetectors are receiving insufficient levels of emitted optical energy to output reliable detection data, and which of said pixel photodetectors are receiving adequate levels of emitted optical energy to output reliable detection data; (b) designating one of at least three groups into which pixel photodetectors identified in step (a) are placed, comprising (i) said pixel photodetectors receiving excessive levels of emitted optical energy, (ii) said pixel photodetectors receiving insufficient levels of emitted optical energy, and (iii) said pixel photodetectors receiving adequate levels of emitted optical energy; and (c) if a highest number of said pixel photodetectors are members of a group comprising (i) said pixel photodetectors receiving excessive levels of emitted optical energy, varying at least one system parameter associated with said TOF system to reduce levels of emitted optical energy presented to said pixel photodetectors; and
if a highest number of said pixel photodetectors are members of a group comprising (ii) said pixel photodetectors receiving insufficient levels of emitted optical energy, varying at least one system parameter associated with said TOF system to increase levels of emitted optical energy presented to said pixel photodetectors. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. For use with a time-of-flight (TOF) system that illuminates a target, a distance z from said TOF system, with emitted optical energy having a modulated periodic waveform that includes a high frequency component, and that detects a fraction of said emitted optical energy with an array of pixel photodetectors operable in at least two phases to determine data proportional to said distance z, said TOF system operable to determine distance z independently of reflectivity of said target, a control system to automatically control detection gain of said pixel photodetectors, the control system comprising:
-
means for identifying which of said pixel photodetectors are receiving excessive levels of emitted optical energy to output reliable detection data, which of said pixel photodetectors are receiving insufficient levels of emitted optical energy to output reliable detection data, and which of said pixel photodetectors are receiving adequate levels of emitted optical energy to output reliable detection data; means for designating one of at least three groups into which pixel photodetectors identified by said means for identifying are placed, designation choices comprising (i) said pixel photodetectors receiving excessive levels of emitted optical energy, (ii) said pixel photodetectors receiving insufficient levels of emitted optical energy, and (iii) said pixel photodetectors receiving adequate levels of emitted optical energy; and means for varying at least one system parameter associated with said TOF system; wherein said means for varying varies at least one system parameter associated with said TOF system to reduce levels of emitted optical energy presented to said pixel photodetectors if said means for designating determines that a highest number of said pixel photodetectors are members of a group comprising said pixel photodetectors receiving excessive levels of emitted optical energy; and wherein said means for varying varies at least one system parameter associated with said TOF system to increase levels of emitted optical energy presented to said pixel photodetectors if a highest number of said pixel photodetectors are members of a group comprising said pixel photodetectors receiving insufficient levels of emitted optical energy. - View Dependent Claims (8, 9, 10, 11)
-
-
12. For use with a time-of-flight (TOF) system that illuminates a target, a distance z from said TOF system, with optical energy having a modulated periodic waveform that includes a high frequency component, and that detects a fraction of said illumination with an array of pixel photodetectors operable in at least two phases to determine data proportional to said distance z, said TOF system operable to determine distance z independently of ambient light, a method to automatically control detection gain of said pixel photodetectors, the method comprising the following steps:
-
(a) identifying from a passive brightness image acquired by said TOF system which of said pixel photodetectors are receiving excessive levels of emitted optical energy to output reliable detection data, and identifying from an active brightness image which of said pixel photodetectors are receiving insufficient levels of emitted optical energy to output reliable detection data and forming a histogram of such identification; (b) using identification information from step (a) to form a histogram representing number of said pixel photodetectors receiving excessive levels of emitted optical energy, number of said pixel photodetectors receiving insufficient levels of emitted optical energy, and number of said pixel photodetectors receiving neither excessive nor insufficient levels of emitted optical energy; (c) estimating variation in at least one system parameter of said TOF system to produce a change in light Δ
L that increases said number of said pixel photodetectors receiving neither excessive nor insufficient levels of emitted optical energy;(d) varying at least one system parameter of said TOF system to increase said number of said pixel photodetectors receiving neither excessive nor insufficient levels of emitted optical energy. - View Dependent Claims (13, 14)
-
-
15. For use with a time-of-flight (TOF) system that illuminates a target, a distance z from said TOF system, with emitted optical energy having a modulated periodic waveform that includes a high frequency component, and that detects a fraction of said emitted optical energy with an array of pixel photodetectors operable in at least two phases to determine data proportional to said distance z, said TOF system operable to determine distance z independently of ambient light, a control system to automatically control detection gain of said pixel photodetectors, said control system comprising:
-
means for identifying from a passive brightness image acquired by said TOF system which of said pixel photodetectors are receiving excessive levels of emitted optical energy to output reliable detection data, and for identifying from an active brightness image which of said pixel photodetectors are receiving insufficient levels of emitted optical energy to output reliable detection data and forming a histogram of such identification; means for forming a histogram, using identification information from said means for identifying, representing number of said pixel photodetectors receiving excessive levels of emitted optical energy, number of said pixel photodetectors receiving insufficient levels of optical energy, and number of said pixel photodetectors receiving neither excessive nor insufficient levels of emitted optical energy; means for estimating variation in at least one system parameter of said TOF system to produce a change in light Δ
L that increases said number of said pixel photodetectors receiving neither excessive nor insufficient levels of emitted optical energy; andmeans for varying at least one system parameter of said TOF system to increase said number of said pixel photodetectors receiving neither excessive nor insufficient levels of emitted optical energy. - View Dependent Claims (16, 17)
-
-
18. For use with a time-of-flight (TOF) system that illuminates a target, a distance z from said TOF system, with emitted optical energy having a modulated periodic waveform that includes a high frequency component, and that detects a fraction of said emitted optical energy with an array of pixel photodetectors operable in at least two phases to determine data proportional to said distance z, said TOF system operable independently of ambient light, a method to automatically control detection gain of said pixel photodetectors, the method comprising the following steps:
-
(a) identifying from a passive brightness image acquired by said TOF system which of said pixel photodetectors are receiving excessive levels of emitted optical energy to output reliable detection data, and identifying from an active brightness image which of said pixel photodetectors are receiving insufficient levels of emitted optical energy to output reliable detection data and forming a histogram of such identification; (b) using identification information from step (a) to traverse said active brightness image and said passive brightness image to determine therefrom number of said pixel photodetectors receiving insufficient levels of emitted optical energy, and number of said pixel photodetectors receiving neither excessive nor insufficient levels of emitted optical energy; (c) estimating variation in at least one system parameter of said TOF system to produce a change in light Δ
L that increases said number of said pixel photodetectors receiving neither excessive nor insufficient levels of emitted optical energy; and(d) varying at least one system parameter of said TOF system to increase said number of said pixel photodetectors receiving neither excessive nor insufficient levels of emitted optical energy. - View Dependent Claims (19)
-
-
20. For use with a time-of-flight (TOF) system that illuminates a target, a distance z from said TOF system, with optical energy having a modulated periodic waveform that includes a high frequency component, and that detects a fraction of said illumination with an array of pixel photodetectors operable in at least two phases to determine data proportional to said distance z, said TOF system operable independently of reflectivity of said target, a control system to automatically control detection gain of said pixel photodetectors, the control system comprising:
-
means for identifying from a passive brightness image acquired by said TOF system which of said pixel photodetectors are receiving excessive levels of emitted optical energy to output reliable detection data, and identifying from an active brightness image which of said pixel photodetectors are receiving insufficient levels of emitted optical energy to output reliable detection data and forming a histogram of such identification; means for traversing said active brightness image and said passive brightness image and for determining therefrom number of said pixel photodetectors receiving insufficient levels of emitted optical energy, and number of said pixel photodetectors receiving neither excessive nor insufficient levels of emitted optical energy; means for estimating variation in at least one system parameter of said TOF system to produce a change in light Δ
L that increases said number of said pixel photodetectors receiving neither excessive nor insufficient levels of emitted optical energy; andmeans for varying at least one system parameter of said TOF system to increase said number of said pixel photodetectors receiving neither excessive nor insufficient levels of emitted optical energy.
-
Specification