Optical occupant sensing techniques

• US 7,734,061 B2
• Filed: 02/21/2008
• Issued: 06/08/2010
• Est. Priority Date: 06/07/1995
• Status: Expired due to Fees

• Current Assignee: American Vehicular Sciences LLC (Acacia Research Corporation)
• Original Assignee: Automotive Technologies International Incorporated
• Inventors: Breed, David S., Johnson, Wendell C., DuVall, Wilbur E.
• Primary Examiner(s): COUSO, YON JUNG
• Application Number:
  US12/035,180
• Publication Number:
  US 20090066065A1
• Time in Patent Office: 838 Days
• Field of Search: 382/100, 382/104, 382/106, 382/115, 382/154, 382/156, 382/282, 382/312, 348/42, 348/46, 348/47, 701/44, 701/45, 701/49, 701/59, 702/155, 702/156, 702/166, 706/15, 706/20, 340/573.1, 280/735
• US Class Current: 382/100
• CPC Class Codes: B60J 10/00 Sealing arrangements
• CPC Class Codes: B60N 2/002 Seats provided with an occupancy detection means mounted therein or thereon detection means responsive to presence or absence of children B60N2/266
• CPC Class Codes: B60N 2/0268 using sensors or detectors for adapting the seat or seat part, e.g. to the position of an occupant
• CPC Class Codes: B60N 2/0272 using sensors or detectors for detecting the position of seat parts
• CPC Class Codes: B60Q 1/143 combined with another condition, e.g. using vehicle recognition from camera images or activation of wipers
• CPC Class Codes: B60Q 2300/3321 Detection of streetlights
• CPC Class Codes: B60Q 2300/41 preceding vehicle
• CPC Class Codes: B60Q 2300/42 oncoming vehicle
• CPC Class Codes: B60R 16/037 for occupant comfort , e.g. for automatic adjustment of appliances according to personal settings, e.g. seats, mirrors, steering wheel
• CPC Class Codes: B60R 2001/1223 with sensors or transducers
• CPC Class Codes: B60R 2001/1253 with cameras, video cameras or video screens
• CPC Class Codes: B60R 2021/0027 Post collision measures, e.g. notifying emergency services
• CPC Class Codes: B60R 2021/01315 monitoring occupant displacement
• CPC Class Codes: B60R 21/0134 responsive to imminent contact with an obstacle , e.g. using radar systems
• CPC Class Codes: B60R 21/01516 using force or pressure sensing means
• CPC Class Codes: B60R 21/0152 using strain gauges
• CPC Class Codes: B60R 21/0153 using field detection presence sensors
• CPC Class Codes: B60R 21/01534 using electromagneticwaves, e.g. infrared
• CPC Class Codes: B60R 21/01536 using ultrasonic waves
• CPC Class Codes: B60R 21/01538 for image processing, e.g. cameras or sensor arrays
• CPC Class Codes: B60R 21/0154 : in combination with seat heating
• CPC Class Codes: B60R 21/01542 : detecting passenger motion
• CPC Class Codes: B60R 21/01544 : detecting seat belt parameters, e.g. length, tension or height-adjustment
• CPC Class Codes: B60R 21/01548 : sensing the amount of belt winded on retractor
• CPC Class Codes: B60R 21/01552 : detecting position of specific human body parts, e.g. face, eyes or hands
• CPC Class Codes: B60R 21/01554 : Seat position sensors
• CPC Class Codes: B60R 25/25 : using biometry
• CPC Class Codes: B60R 25/252 : Fingerprint recognition
• CPC Class Codes: B60R 25/255 : Eye recognition
• CPC Class Codes: B60R 25/257 : Voice recognition
• CPC Class Codes: E05F 15/43 : responsive to disruption of energy beams, e.g. light or sound
• CPC Class Codes: E05F 15/431 : specially adapted for vehicle windows or roofs
• CPC Class Codes: E05F 2015/433 : using reflection from the obstruction
• CPC Class Codes: E05Y 2900/55 : Windows
• CPC Class Codes: G01S 13/04 : Systems determining presence of a target based on relative movement of target G01S13/56
• CPC Class Codes: G01S 15/04 : Systems determining presence of a target
• CPC Class Codes: G01S 15/06 : Systems determining the position data of a target
• CPC Class Codes: G01S 15/87 : Combinations of sonar systems
• CPC Class Codes: G01S 15/88 : Sonar systems specially adapted for specific applications seismic or acoustic prospecting or detecting G01V1/00
• CPC Class Codes: G01S 17/04 : Systems determining the presence of a target
• CPC Class Codes: G01S 17/88 : Lidar systems specially adapted for specific applications
• CPC Class Codes: G01S 17/89 : for mapping or imaging
• CPC Class Codes: G01S 7/4802 : using analysis of echo signal for target characterisation; Target signature; Target cross-section
• CPC Class Codes: G01S 7/539 : using analysis of echo signal for target characterisation; Target signature; Target cross-section
• CPC Class Codes: G06V 20/59 : inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
• CPC Class Codes: G06V 40/10 : Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: G10K 2210/1282 : Automobiles
• CPC Class Codes: G10K 2210/3219 : Geometry of the configuration

Abstract

Vehicular system for determining the presence of an object in a passenger compartment of the vehicle includes a first image receiver arranged at a first location for obtaining a first two-dimensional view of a portion of the compartment, and a second image receiver arranged at a second location for obtaining a second two-dimensional view of the same portion of the compartment, the second image receiver being arranged relative to the first image receiver such that three dimensions of the portion of the compartment are encompassed by the first and second views. A processor receives images from the first and second image receivers and determines whether an object is present in the compartment based on the images. A reactive system, such as an airbag assembly, may be coupled to the processor and controlled thereby based on the determination of whether an object is present in the imaged portion of the compartment.

Claims

1. A vehicle including a system for determining the presence of an object in a passenger compartment of the vehicle, the system comprising

a first image receiver arranged at a first location in the vehicle for obtaining a first two-dimensional view of a portion of the passenger compartment including the object;

a second image receiver arranged at a second location in the vehicle for obtaining a second two-dimensional view of the same portion of the passenger compartment, said second image receiver being arranged relative to said first image receiver such that three dimensions of the portion of the passenger compartment are encompassed by said first and second views, and

a processor coupled to said first and second image receivers and that receives images from said first and second image receivers and determines whether an object is present in the portion of the passenger compartment based on the images obtained from both said first image receiver and said second image receiver.

2. The vehicle of claim 1, wherein said first receiver is arranged on an A-pillar of the vehicle and thereby provides vertical and transverse information about the portion of the passenger compartment.

3. The vehicle of claim 1, wherein said first receiver is arranged on a roof of the vehicle above a seat of the vehicle or on a headliner of the vehicle directly above the portion of the passenger compartment.

4. The vehicle of claim 1, wherein said second receiver is arranged on a headliner of the vehicle at or proximate a center of a headliner of the vehicle.

5. The vehicle of claim 1, wherein said second receiver is arranged on a headliner of the vehicle relative to the portion of the passenger compartment.

6. The vehicle of claim 1, further comprising a reactive component, system or subsystem coupled to said processor, said processor being arranged to control said reactive component, system or subsystem based on the determination of whether an object is present in the portion of the passenger compartment.

7. The vehicle of claim 6, wherein said reactive component, system or subsystem is an airbag assembly including at least one airbag, said processor being arranged to control at least one deployment parameter of said at least one airbag.

8. The vehicle of claim 1, wherein at least one of said first and second receivers is a CMOS dynamic pixel camera, an active pixel camera or an HDRC camera operative using a logarithm of incident light.

9. The vehicle of claim 1, wherein one of said first and second receivers is arranged in a dashboard or instrument panel of the vehicle to receive an image reflected by a windshield of the vehicle.

10. The vehicle of claim 1, wherein said processor is arranged to analyze the images from said first and second image receivers over time by comparing the images received from each of said first and second receivers at different time and analyzing differences between the images.

20. The vehicle of claim 1, further comprising:

an airbag assembly including at least one deployable airbag that deploys in an accident involving the vehicle to protect an occupant of the invention; and

a crash sensor system arranged to sense an accident involving the vehicle,

said processor being coupled to aid airbag assembly and said crash sensor system and being arranged to control at least one deployment parameter of said at least one airbag based on sensing of an accident by said crash sensor system and the determination of whether an object is present in the portion of the passenger compartment.

21. The vehicle of claim 1, wherein said processor includes a trained pattern recognition algorithm that is trained to determine whether an object is present in the portion of the passenger compartment based on the images obtained from both said first image receiver and said second image receiver.

11. A vehicle including a system for ascertaining the identity of an object in a passenger compartment of the vehicle, the system comprising

a first image receiver arranged at a first location in the vehicle for obtaining a first two-dimensional view of a portion of the passenger compartment including the object;

a second image receiver arranged at a second location in the vehicle for obtaining a second two-dimensional view of the same portion of the passenger compartment, said second image receiver being arranged relative to said first image receiver such that three dimensions of the portion of the passenger compartment are encompassed by said first and second images; and

a processor coupled to said first and second image receivers and that receives images from said first and second image receivers and ascertains the identity of the object based on the images obtained from both said first image receiver and said second image receiver.

12. The vehicle of claim 11, further comprising a reactive component, system or subsystem coupled to said processor, said processor being arranged to control said reactive component, system or subsystem based on the identity of the object.

13. The vehicle of claim 11, wherein said processor is arranged to analyze the images from said first and second image receivers over time by comparing the images received from each of said first and second receivers at different time and analyzing differences between the images.

22. The vehicle of claim 11, further comprising:

an airbag assembly including at least one deployable airbag that deploys in an accident involving the vehicle to protect an occupant of the invention; and

a crash sensor system arranged to sense an accident involving the vehicle,

said processor being coupled to aid airbag assembly and said crash sensor system and being arranged to control at least one deployment parameter of said at least one airbag based on sensing of an accident by said crash sensor system and the identity of object in the portion of the passenger compartment.

23. The vehicle of claim 11, wherein said processor includes a trained pattern recognition algorithm that is trained to ascertain the identity of the object based on the images obtained from both said first image receiver and said second image receiver.

14. A method for determining the presence of an object in a passenger compartment of a vehicle, comprising:

obtaining using a first imaging system, a first image of a portion of the passenger compartment covering first and second dimensions of the passenger compartment,

obtaining using a second imaging system, a second image of the same portion of the passenger compartment covering the first dimension and a third dimension of the passenger compartment such that three dimensions of the portion of the passenger compartment are encompassed by the first and second images obtained by the first and second imaging systems, and

determining using a processor, whether an object is present in the passenger compartment based on the first and second images obtained by the first and second imaging systems.

15. The method of claim 14, wherein the first imaging system comprises a first receiver and the second imaging system comprises a second receiver, further comprising:

arranging the first receiver to provide two-dimensional views of the portion of the passenger compartment; and

arranging the second receiver to provide a different two-dimensional view of the portion of the passenger compartment.

16. The method of claim 14, further comprising:

controlling using a control system, a reactive component, system or subsystem based on the determination by the processor of whether an object is present in the portion of the passenger compartment.

17. A method for ascertaining the identity of an object in a passenger compartment of a vehicle, comprising:

obtaining using a first imaging system, a first image of a portion of the passenger compartment covering first and second dimensions of the passenger compartment;

obtaining using a first imaging system, a second image of the same portion of the passenger compartment covering the first dimension and a third dimension of the passenger compartment such that all three dimensions of the portion of the passenger compartment are encompassed by the first and second images obtained by the first and second imaging systems; and

ascertaining using a processor, the identity of the object in the passenger compartment based on the first and second images obtained by the first and second imaging systems.

18. The method of claim 17, wherein the first imaging system comprises a first receiver and the second imaging system comprises a second receiver, further comprising:

arranging the first receiver to provide two-dimensional views of the portion of the passenger compartment; and

arranging the second receiver to provide a different two-dimensional view of the portion of the passenger compartment.

19. The method of claim 17, further comprising:

controlling using a control system, a reactive component, system or subsystem based on the identity of the object ascertained by the processor.