Distance measurement system and solid-state imaging sensor used therefor

• US 10,151,835 B2
• Filed: 02/17/2016
• Issued: 12/11/2018
• Est. Priority Date: 08/23/2013
• Status: Active Grant

• Current Assignee: Nuvoton Technology Corporation Japan (Winbond Electronics Corporation)
• Original Assignee: Panasonic Intellectual Property Management Co., Ltd. (Panasonic Holdings Corporation)
• Inventors: Ito, Junji, Yamada, Tohru, Fujii, Toshiya
• Primary Examiner(s): Abraham, Samantha K
• Application Number:
  US15/045,851
• Publication Number:
  US 20160161611A1
• Time in Patent Office: 1,028 Days
• CPC Class Codes: G01S 17/003 Bistatic lidar systems; Multistatic lidar systems
• CPC Class Codes: G01S 17/10 using transmission of interrupted, pulse-modulated waves determination of distance by phase measurements G01S17/32
• CPC Class Codes: G01S 17/86 Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
• CPC Class Codes: G01S 17/87 Combinations of systems using electromagnetic waves other than radio waves
• CPC Class Codes: G01S 17/894 3D imaging with simultaneous measurement of time-of-flight at a 2D array of receiver pixels, e.g. time-of-flight cameras or flash lidar
• CPC Class Codes: G01S 7/4814 of transmitters alone

Abstract

A distance measurement system includes: a signal generator which generates a light emission signal that instructs light emission and an exposure signal that instructs exposure of reflected light; a first illumination and distance measurement light source which receives the light emission signal and, according to the signal received, performs the light emission for illumination without a purpose of distance measurement and the light emission with the purpose of distance measurement using the reflected light; an imaging device which receives the exposure signal, performs the exposure according to the signal received, and obtains an amount of light exposure of the reflected light; and a calculator which calculates distance information using the amount of light exposure and outputs the distance information, wherein the distance measurement system has operation modes including an illumination mode and a first distance measurement mode.

Claims

1. A distance measurement system to be used in transport equipment, the distance measurement system comprising:

a signal generator that generates light emission pulse signals, of a plurality of types, that instruct light emission and an exposure signal that instructs exposure of reflected light;

a headlight assembly that receives the light emission pulse signals and, according to the light emission pulse signals received, emit pulsed light for illumination without a purpose of distance measurement and emit pulsed light with the purpose of distance measurement using the reflected light;

an imaging device that includes a solid-state imaging sensor which receives the exposure signal, performs the exposure according to the exposure signal received, and obtains an amount of light exposure of the reflected light to perform the distance measurement; and

a calculator that calculates distance information using the amount of light exposure and output the distance information,

wherein the headlight assembly includes a first light source and a second light source, and

the signal generator generates, as the light emission pulse signals of the plurality of types, (i) a first light-emission pulse signal that instructs light emission for performing a distance measurement mode in which distance measurement is performed using the first light source, and (ii) a second light-emission pulse signal for performing an illumination mode in which illumination without the purpose of the distance measurement is performed using the second light source.

2. The distance measurement system according to claim 1,

wherein the illumination in the illumination mode and the distance measurement in the distance measurement mode are performed by synchronizing turning ON of the first light-emission pulse signal and turning OFF of the second light-emission pulse signal or by synchronizing turning OFF of the first light-emission pulse signal and turning ON of the second light-emission pulse signal.

3. The distance measurement system according to claim 1,

wherein a time duration in which the first light-emission pulse signal is ON is shorter than a time duration in which the second light-emission pulse signal is ON.

4. The distance measurement system according to claim 1,

wherein the second light-emission pulse signal is turned ON after the time duration in which the first light-emission pulse signal is ON is repeated a plurality of times.

5. The distance measurement system according to claim 1,

wherein a sum of the number of times the first light-emission pulse signal is ON and the number of times the second light-emission pulse signal is ON is at least 120 times per second.

6. The distance measurement system according to claim 1,

wherein the first light-emission pulse signal has an amplitude larger than an amplitude of the second light-emission pulse signal.

7. The distance measurement system according to claim 1,

wherein a time duration in which the light emitted by the headlight assembly in the distance measurement mode is ON is shorter than a time duration in which the light emitted by the headlight assembly in the illumination mode is ON.

8. The distance measurement system according to claim 1,

wherein the light emitted by the headlight assembly in the distance measurement mode has an amplitude larger than an amplitude of the light emitted by the headlight assembly in the illumination mode.

9. The distance measurement system according to claim 1,

wherein the distance measurement mode and the illumination mode are switched at least 120 times per second.

10. The distance measurement system according to claim 1,

wherein the first light source is a high beam light source that emits infrared light, and

the second light source is a low beam light source.

11. The distance measurement system according to claim 1,

wherein the distance measurement mode is a time of flight (TOF) mode.

12. The distance measurement system according to claim 1,

wherein the headlight assembly and the imaging device are mounted at a certain distance from each other.

13. The distance measurement system according to claim 1,

wherein the distance measurement system has a mode in which the imaging device operates and the calculator measures an amount of background light with the headlight assembly turned off, and

the calculator performs correction by subtracting the amount of background light from the amount of light exposure in the distance measurement mode.

14. The distance measurement system according to claim 1,

wherein the headlight assembly includes a light-emitting diode (LED) or a laser diode.

15. The distance measurement system according to claim 1,

wherein the solid-state imaging sensor is a charge-coupled device (CCD) solid-state imaging sensor.

16. The distance measurement system according to claim 1,

wherein the solid-state imaging sensor includes

a plurality of pixels each including:

a light receiver that performs photoelectric conversion; and

an accumulator that accumulates signal charge read from the light receiver, and

the solid-state imaging sensor is a metal-oxide-semiconductor (MOS) solid-state imaging sensor that collectively reads the signal charge of the light receivers into the accumulators in the plurality of pixels.

17. The distance measurement system according to claim 1,

wherein the solid-state imaging sensor includes a plurality of pixels, and

each of the plurality of pixels includes any one of an infrared transmission filter, a first filter that transmits red light and infrared light, a second filter that transmits green light and infrared light, and a third filter that transmits blue light and infrared light.

18. A solid-state imaging sensor for use in a distance measurement system which is to be used in transport equipment, the distance measurement system including:

a signal generator that generates light emission pulse signals, of a plurality of types, that instruct light emission and an exposure signal that instructs exposure of reflected light;

a headlight assembly that receives the light emission pulse signals, and, according to the light emission pulse signals received, emits pulsed light for illumination without a purpose of distance measurement and emits pulsed light with the purpose of distance measurement using the reflected light;

an imaging device that includes the solid-state imaging sensor which receives the exposure signal, performs the exposure according to the exposure signal received, and obtains an amount of light exposure of the reflected light to perform the distance measurement; and

a calculator that calculates distance information using the amount of light exposure and outputs the distance information,

wherein the headlight assembly includes a first light source and a second light source,

the signal generator generates, as the light emission pulse signals of the plurality of types, (i) a first light-emission pulse signal that instructs light emission for performing a distance measurement mode in which distance measurement is performed using the first light source, and (ii) a second light-emission pulse signal for performing an illumination mode in which illumination without the purpose of the distance measurement is performed using the second light source, and

in the distance measurement mode, the solid-state imaging sensor captures an image using the reflected light that is infrared light emitted by the first light source and reflected by a subject.