Optical Occupant Sensing Techniques

• US 20090066065A1
• Filed: 02/21/2008
• Published: 03/12/2009
• Est. Priority Date: 06/07/1995
• Status: Active Grant

• Current Assignee: American Vehicular Sciences LLC (Acacia Research Corporation)
• Original Assignee: Automotive Technologies International Incorporated
• Inventors: Breed, David S., Johnson, Wendell C., DuVall, Wilbur E.
• Granted Patent: US 7,734,061 B2
• Time in Patent Office: Days
• US Class Current: 280/735
• CPC Class Codes: B60J 10/00 Sealing arrangements
• CPC Class Codes: B60N 2/002 Seats provided with an occupancy detection means mounted therein or thereon detection means responsive to presence or absence of children B60N2/266
• CPC Class Codes: B60N 2/0268 using sensors or detectors for adapting the seat or seat part, e.g. to the position of an occupant
• CPC Class Codes: B60N 2/0272 using sensors or detectors for detecting the position of seat parts
• CPC Class Codes: B60Q 1/143 combined with another condition, e.g. using vehicle recognition from camera images or activation of wipers
• CPC Class Codes: B60Q 2300/3321 Detection of streetlights
• CPC Class Codes: B60Q 2300/41 preceding vehicle
• CPC Class Codes: B60Q 2300/42 oncoming vehicle
• CPC Class Codes: B60R 16/037 for occupant comfort , e.g. for automatic adjustment of appliances according to personal settings, e.g. seats, mirrors, steering wheel
• CPC Class Codes: B60R 2001/1223 with sensors or transducers
• CPC Class Codes: B60R 2001/1253 with cameras, video cameras or video screens
• CPC Class Codes: B60R 2021/0027 Post collision measures, e.g. notifying emergency services
• CPC Class Codes: B60R 2021/01315 monitoring occupant displacement
• CPC Class Codes: B60R 21/0134 responsive to imminent contact with an obstacle , e.g. using radar systems
• CPC Class Codes: B60R 21/01516 using force or pressure sensing means
• CPC Class Codes: B60R 21/0152 using strain gauges
• CPC Class Codes: B60R 21/0153 using field detection presence sensors
• CPC Class Codes: B60R 21/01534 using electromagneticwaves, e.g. infrared
• CPC Class Codes: B60R 21/01536 using ultrasonic waves
• CPC Class Codes: B60R 21/01538 for image processing, e.g. cameras or sensor arrays
• CPC Class Codes: B60R 21/0154 : in combination with seat heating
• CPC Class Codes: B60R 21/01542 : detecting passenger motion
• CPC Class Codes: B60R 21/01544 : detecting seat belt parameters, e.g. length, tension or height-adjustment
• CPC Class Codes: B60R 21/01548 : sensing the amount of belt winded on retractor
• CPC Class Codes: B60R 21/01552 : detecting position of specific human body parts, e.g. face, eyes or hands
• CPC Class Codes: B60R 21/01554 : Seat position sensors
• CPC Class Codes: B60R 25/25 : using biometry
• CPC Class Codes: B60R 25/252 : Fingerprint recognition
• CPC Class Codes: B60R 25/255 : Eye recognition
• CPC Class Codes: B60R 25/257 : Voice recognition
• CPC Class Codes: E05F 15/43 : responsive to disruption of energy beams, e.g. light or sound
• CPC Class Codes: E05F 15/431 : specially adapted for vehicle windows or roofs
• CPC Class Codes: E05F 2015/433 : using reflection from the obstruction
• CPC Class Codes: E05Y 2900/55 : Windows
• CPC Class Codes: G01S 13/04 : Systems determining presence of a target based on relative movement of target G01S13/56
• CPC Class Codes: G01S 15/04 : Systems determining presence of a target
• CPC Class Codes: G01S 15/06 : Systems determining the position data of a target
• CPC Class Codes: G01S 15/87 : Combinations of sonar systems
• CPC Class Codes: G01S 15/88 : Sonar systems specially adapted for specific applications seismic or acoustic prospecting or detecting G01V1/00
• CPC Class Codes: G01S 17/04 : Systems determining the presence of a target
• CPC Class Codes: G01S 17/88 : Lidar systems specially adapted for specific applications
• CPC Class Codes: G01S 17/89 : for mapping or imaging
• CPC Class Codes: G01S 7/4802 : using analysis of echo signal for target characterisation; Target signature; Target cross-section
• CPC Class Codes: G01S 7/539 : using analysis of echo signal for target characterisation; Target signature; Target cross-section
• CPC Class Codes: G06V 20/59 : inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
• CPC Class Codes: G06V 40/10 : Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: G10K 2210/1282 : Automobiles
• CPC Class Codes: G10K 2210/3219 : Geometry of the configuration

Abstract

Vehicular system for determining the presence of an object in a passenger compartment of the vehicle includes a first image receiver arranged at a first location for obtaining a first two-dimensional view of a portion of the compartment, and a second image receiver arranged at a second location for obtaining a second two-dimensional view of the same portion of the compartment, the second image receiver being arranged relative to the first image receiver such that three dimensions of the portion of the compartment are encompassed by the first and second views. A processor receives images from the first and second image receivers and determines whether an object is present in the compartment based on the images. A reactive system, such as an airbag assembly, may be coupled to the processor and controlled thereby based on the determination of whether an object is present in the imaged portion of the compartment.

Claims

1. A vehicle including a system for determining the presence of an object in a passenger compartment of the vehicle, the system comprising

a first image receiver arranged at a first location in the vehicle for obtaining a first two-dimensional view of a portion of the passenger compartment;

a second image receiver arranged at a second location in the vehicle for obtaining a second two-dimensional view of the same portion of the passenger compartment, said second image receiver being arranged relative to said first image receiver such that three dimensions of the portion of the passenger compartment are encompassed by said first and second views, and

a processor for receiving images from said first and second image receivers and determining whether an object is present in the passenger compartment based on the images.

2. The vehicle of claim 1, wherein said first receiver is arranged on an A-pillar of the vehicle and thereby provides vertical and transverse information about the portion of the passenger compartment.

3. The vehicle of claim 1, wherein said first receiver is arranged on a roof of the vehicle above a seat of the vehicle or on a headliner of the vehicle directly above the portion of the passenger compartment.

4. The vehicle of claim 1, wherein said second receiver is arranged on a headliner of the vehicle at or proximate a center of a headliner of the vehicle.

5. The vehicle of claim 1, wherein said second receiver is arranged on a headliner of the vehicle relative to the portion of the passenger compartment.

6. The vehicle of claim 1, further comprising a reactive component, system or subsystem coupled to said processor, said processor being arranged to control said reactive component, system or subsystem based on the determination of whether an object is present in the portion of the passenger compartment.

7. The vehicle of claim 6, wherein said reactive component, system or subsystem is an airbag assembly including at least one airbag, said processor being arranged to control at least one deployment parameter of said at least one airbag.

8. The vehicle of claim 1, wherein at least one of said first and second receivers is a CMOS dynamic pixel camera, an active pixel camera or an HDRC camera operative using a logarithm of incident light.

9. The vehicle of claim 1, wherein one of said first and second receivers is arranged in a dashboard or instrument panel of the vehicle to receive an image reflected by a windshield of the vehicle.

10. The vehicle of claim 1, wherein said processor is arranged to process the images received from said first and second image receivers to subtract images obtained in the presence of artificial illumination from images obtained in the absence of artificial illumination.

11. The vehicle of claim 1, wherein said processor is arranged to process the images received from said first and second image receivers to form a three-dimensional image of a seat in the portion of the passenger compartment without an occupant present, process the images received from said first and second image receivers to form a three-dimensional image of the portion of the passenger compartment when an occupant present and subtract the formed three-dimensional image of the seat from the formed three-dimensional image of the portion of the passenger compartment and then determine whether an object is present based on the resultant image.

12. The vehicle of claim 1, wherein said processor is arranged to analyze the images from said first and second image receivers over time by comparing the images received from each of said first and second receivers at different time and analyzing differences between the images.

13. A vehicle including a system for ascertaining the identity of an object in a passenger compartment of the vehicle, the system comprising

a first image receiver arranged at a first location in the vehicle for obtaining a first two-dimensional view of a portion of the passenger compartment;

a second image receiver arranged at a second location in the vehicle for obtaining a second two-dimensional view of the same portion of the passenger compartment, said second image receiver being arranged relative to said first image receiver such that three dimensions of the portion of the passenger compartment are encompassed by said first and second images; and

a processor for receiving images from said first and second image receivers and ascertaining the identity of the object based on the images.

14. The vehicle of claim 13, further comprising a reactive component, system or subsystem coupled to said processor, said processor being arranged to control said reactive component, system or subsystem based on the identity of the object.

15. The vehicle of claim 13, wherein said processor is arranged to process the images received from said first and second image receivers to subtract images obtained in the presence of artificial illumination from images obtained in the absence of artificial illumination.

16. The vehicle of claim 13, wherein said processor is arranged to process the images received from said first and second image receivers to form a three-dimensional image of a seat in the portion of the passenger compartment without an occupant present, process the images received from said first and second image receivers to form a three-dimensional image of the portion of the passenger compartment when an occupant present and subtract the formed three-dimensional image of the seat from the formed three-dimensional image of the portion of the passenger compartment and then ascertain the identity of the object based on the resultant image.

17. The vehicle of claim 13, wherein said processor is arranged to analyze the images from said first and second image receivers over time by comparing the images received from each of said first and second receivers at different time and analyzing differences between the images.

18. A method for determining the presence of an object in a passenger compartment of a vehicle, comprising:

obtaining a first image of a portion of the passenger compartment covering first and second dimensions of the passenger compartment,

obtaining a second image of the same portion of the passenger compartment covering the first dimension and a third dimension such that three dimensions of the portion of the passenger compartment are encompassed by the first and second images, and

determining whether an object is present in the passenger compartment based on the first and second images.

19. The method of claim 18, wherein the first image is obtained by a first receiver and the second image is obtained by a second receiver, further comprising:

arranging the first receiver to provide two-dimensional views of the portion of the passenger compartment; and

arranging the second receiver to provide a different two-dimensional view of the portion of the passenger compartment.

20. The method of claim 18, further comprising:

controlling a reactive component, system or subsystem based on the determination of whether an object is present in the portion of the passenger compartment.

21. A method for ascertaining the identity of an object in a passenger compartment of a vehicle, comprising:

obtaining a first image of a portion of the passenger compartment covering first and second dimensions of the passenger compartment;

obtaining a second image of the same portion of the passenger compartment covering the first dimension and a third dimension such that all three dimensions of the portion of the passenger compartment are encompassed by the first and second images; and

ascertaining the identity of the object in the passenger compartment based on the first and second images.

22. The method of claim 21, wherein the first image is obtained by a first receiver and the second image is obtained by a second receiver, further comprising:

arranging the first receiver to provide two-dimensional views of the portion of the passenger compartment; and

arranging the second receiver to provide a different two-dimensional view of the portion of the passenger compartment.

23. The method of claim 21, further comprising:

controlling a reactive component, system or subsystem based on the identity of the object.