VEHICULAR RESTRAINT SYSTEM CONTROL SYSTEM AND METHOD USING MULTIPLE OPTICAL IMAGERS

• US 20060208169A1
• Filed: 08/31/2004
• Published: 09/21/2006
• Est. Priority Date: 05/05/1992
• Status: Active Grant

• Current Assignee: American Vehicular Sciences LLC (Acacia Research Corporation)
• Original Assignee: Automotive Technologies International Incorporated
• Inventors: Breed, David S., Johnson, Wendell C., DuVall, Wilbur E.
• Granted Patent: US 7,164,117 B2
• Time in Patent Office: Days
• US Class Current: 250/221
• CPC Class Codes: B60N 2/002 Seats provided with an occupancy detection means mounted therein or thereon detection means responsive to presence or absence of children B60N2/266
• CPC Class Codes: B60N 2/0022 for sensing anthropometric parameters, e.g. heart rate or body temperature
• CPC Class Codes: B60N 2/0023 for detection of driver fatigue
• CPC Class Codes: B60N 2/0024 for identifying, categorising or investigation of the occupant or object on the seat
• CPC Class Codes: B60N 2/0025 by using weight measurement
• CPC Class Codes: B60N 2/0026 for distinguishing between humans, animals or objects
• CPC Class Codes: B60N 2/0028 of a body part, e.g. of an arm or a leg
• CPC Class Codes: B60N 2/0029 for detecting the motion of the occupant
• CPC Class Codes: B60N 2/0031 mounted on the frame
• CPC Class Codes: B60N 2/0032 mounted on springs
• CPC Class Codes: B60N 2/0033 mounted on or in the foam cushion
• CPC Class Codes: B60N 2/0035 characterised by the sensor data transmission, e.g. wired connections or wireless transmitters therefor; characterised by the sensor data processing, e.g. seat sensor signal amplification or electric circuits for providing seat sensor information
• CPC Class Codes: B60N 2/267 alerting means responsive to presence or absence of children
• CPC Class Codes: B60N 2/268 detecting or alerting means responsive to the installation of the child seats in the vehicle
• CPC Class Codes: B60N 2210/12 Capacitive; Electric field
• CPC Class Codes: B60N 2210/18 Infrared
• CPC Class Codes: B60N 2210/20 Radar
• CPC Class Codes: B60N 2210/24 Cameras
• CPC Class Codes: B60N 2210/26 Ultrasonic, e.g. sonar
• CPC Class Codes: B60N 2210/42 Strain gauges
• CPC Class Codes: B60N 2210/46 : Electric switches
• CPC Class Codes: B60N 2210/48 : Piezoelectric
• CPC Class Codes: B60N 2210/50 : Inertial sensors
• CPC Class Codes: B60N 2220/10 : using a database
• CPC Class Codes: B60N 2220/20 : using a deterministic algorithm
• CPC Class Codes: B60N 2220/30 : using a neural network
• CPC Class Codes: B60N 2230/20 : Wireless data transmission
• CPC Class Codes: B60N 2230/30 : Signal processing of sensor data
• CPC Class Codes: B60R 21/01516 : using force or pressure sensing means
• CPC Class Codes: B60R 21/0152 : using strain gauges
• CPC Class Codes: B60R 21/0153 : using field detection presence sensors
• CPC Class Codes: B60R 21/01534 : using electromagneticwaves, e.g. infrared
• CPC Class Codes: B60R 21/01536 : using ultrasonic waves
• CPC Class Codes: B60R 21/01542 : detecting passenger motion
• CPC Class Codes: G01S 13/04 : Systems determining presence of a target based on relative movement of target G01S13/56
• CPC Class Codes: G01S 15/04 : Systems determining presence of a target
• CPC Class Codes: G01S 15/06 : Systems determining the position data of a target
• CPC Class Codes: G01S 15/87 : Combinations of sonar systems
• CPC Class Codes: G01S 15/88 : Sonar systems specially adapted for specific applications seismic or acoustic prospecting or detecting G01V1/00
• CPC Class Codes: G01S 17/88 : Lidar systems specially adapted for specific applications
• CPC Class Codes: G01S 17/89 : for mapping or imaging
• CPC Class Codes: G01S 7/417 : involving the use of neural networks
• CPC Class Codes: G01S 7/4802 : using analysis of echo signal for target characterisation; Target signature; Target cross-section
• CPC Class Codes: G01S 7/539 : using analysis of echo signal for target characterisation; Target signature; Target cross-section
• CPC Class Codes: G06V 20/00 : Scenes; Scene-specific elements control of digital cameras H04N23/60
• CPC Class Codes: G06V 20/59 : inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions

Abstract

System and method for obtaining information about occupancy of a compartment in a movable object in which at least first and second optical imagers obtain images of a common area of the compartment and spaced apart from one another. Processing circuitry derives information from the images obtained by the imagers. A light source may illuminate the common area of the compartment and be interposed between the imagers. The processing circuitry can include a microprocessor with at least one pattern recognition algorithm and be arranged to determine the distance between the imagers and an object in the common area by locating a specific feature in the common area by first locating the feature in only the image obtained by one imager, then determining the location of the same feature in the image obtained by another imager, and determining the distance of the feature from the imagers by triangulation.

Claims

1. A vehicle comprising:

a compartment;

a crash sensor system arranged to detect a crash involving the vehicle;

a restraint system having a variable actuation in the event of a crash involving the vehicle;

an occupant monitoring system for obtaining information about occupancy of said compartment and controlling said restraint system based on the obtained information, said occupant monitoring system comprising;

at least first and second optical imagers for obtaining images of a common area of said compartment, said first and second imagers being spaced apart from one another; and

processing circuitry coupled to said crash sensor system, said restraint system and said first and second imagers and arranged to derive information from images obtained by said first and second imagers and control the actuation of said restraint system based on the derived information and on detection of a crash by said crash sensor system,

said processing circuitry being arranged to identify the occupant such that the presence of different types of occupants is determinable and said restraint system is controllable to provide different actuations depending on the type of the occupant.

2. The vehicle of claim 1, wherein said occupant monitoring system further comprises a light source for illuminating the common area of the compartment.

3. The vehicle of claim 2, wherein said light source is interposed between said first and second imagers.

4. The vehicle of claim 2, wherein said light source is arranged to project structured light into the common area.

5. The vehicle of claim 4, wherein said light source is approximately midway between said first and second imagers.

6. The vehicle of claim 1, wherein said processing circuitry comprises a microprocessor with at least one pattern recognition algorithm.

7. The vehicle of claim 1, wherein said processing circuitry is arranged to determine the distance between said first and second imagers and an object in the common area by locating a specific feature in the common area by first locating the feature in only the image obtained by said first imager, then determining the location of the same feature in the image obtained by said second imager, and determining the distance of the feature from said first and second imagers by triangulation.

21. The vehicle of claim 1, further comprising an instrument panel, said first and second imagers being arranged above said instrument panel.

22. The vehicle of claim 1, wherein said first and second imagers are vertically spaced apart from one another.

23. The vehicle of claim 1, further comprising a driver'"'"'s seat and at least one additional seat, said first and second imagers being arranged such that the common area is defined above said at least one additional seat.

24. The vehicle of claim 6, wherein said at least one pattern recognition algorithm comprises a trained pattern recognition algorithm trained in a training stage to identify different occupants by obtaining images from said first and second imagers when each of a plurality of different occupants is present in the common area of said compartment and associating a derivation of the images with an identification of the occupant.

8. (canceled)

9. A vehicle comprising:

a compartment;

a crash sensor system arranged to detect a crash involving the vehicle;

a restraint system having a variable actuation in the event of a crash involving the vehicle;

an arrangement for adjusting or controlling said restraint system based on information about occupancy of said compartment, said arrangement comprising;

at least first and second optical imagers for obtaining images of a common area of said compartment, said first and second imagers being spaced apart from one another;

processing circuitry coupled to said crash sensor system and said first and second imagers and arranged to derive information from images obtained by said first and second images and determine the manner in which said restraint system is to be actuated based on the derived information and on detection of a crash by said crash sensor system; and

an adjustment or control system coupled to said processing circuitry for adjusting or controlling said restraint system to provide for the determined manner of actuation of said restraint system as determined by said processing circuitry,

said processing circuitry deriving a model of an occupying item in said compartment based on at least one initial set of images from said first and second imagers and subsequently deriving information about movement of the occupying item based on variations between the model and subsequently obtained images from said first and second imagers.

11. The vehicle of claim 9, wherein said arrangement further comprises a light source for illuminating the common area of said compartment.

12. The vehicle of claim 11, wherein said light source is interposed between said first and second imagers.

13. The vehicle of claim 11, wherein said light source is arranged to project structured light into the common area.

14. The vehicle of claim 13, wherein said light source is approximately midway between said first and second imagers.

15. The vehicle of claim 9, wherein said processing circuitry comprises a microprocessor with at least one pattern recognition algorithm.

16. The vehicle of claim 9, wherein said processing circuitry is arranged to determine the distance between said first and second imagers and an object in the common area by locating a specific feature in the common area by first locating the feature in only the image obtained by said first imager, then determining the location of the same feature in the image obtained by said second imager, and determining the distance of the feature from said first and second imagers by triangulation.

10. (canceled)

17. (canceled)

18. A method for controlling actuation of a restraint system in a vehicle based on occupancy of a compartment in the vehicle, comprising:

arranging a crash sensor system on the vehicle to detect a crash involving the vehicle;

arranging a restraint system on the vehicle which has a variable actuation in the event of a crash involving the vehicle;

arranging at least first and second optical imagers on or in connection with a wall defining the compartment, the first and second imagers being spaced apart from one another;

obtaining images of a common area of the compartment via the first and second imagers;

deriving information from the images obtained by the first and second imagers, said step of deriving information comprising identifying an occupant in the compartment such that the presence of different types of occupants is determinable; and

controlling actuation of the restraint system based on the derived information and on detection of a crash by the crash sensor system, the restraint system being controlled to provide different actuations depending on the type of the identified occupant.

19. The method of claim 18, further comprising illuminating the common area of the compartment via a light source interposed between the first and second imagers.

20. The method of claim 19, wherein the light source is arranged to project structured light into the common area and is approximately midway between the first and second imagers.

25. (canceled)

26. A method for controlling actuation of a restraint system in a vehicle based on occupancy of a compartment in the vehicle, comprising:

arranging a crash sensor system on the vehicle to detect a crash involving the vehicle;

arranging a restraint system on the vehicle which has a variable actuation in the event of a crash involving the vehicle;

arranging at least first and second optical imagers on or in connection with a wall defining the compartment, the first and second imagers being spaced apart from one another;

adjusting or controlling the restraint system based on information about occupancy of the compartment, said adjusting or controlling step comprising

arranging at least first and second optical imagers spaced apart from one another on the vehicle;

obtaining images of a common area of the compartment via the first and second imagers;

deriving information from images obtained by the first and second imagers;

determining the manner in which the restraint system is to be actuated based on the derived information and on detection of a crash by the crash sensor system, the restraint system being adjusted or controlled to provide for the determined manner of actuation of the restraint system;

deriving a model of an occupying item in the compartment based on at least one initial set of images from the first and second imagers; and

subsequently deriving information about movement of the occupying item based on variations between the model and subsequently obtained images from the first and second imagers.

27. A vehicle comprising:

a compartment;

a crash sensor system arranged to detect a crash involving the vehicle;

a restraint system having a variable actuation in the event of a crash involving the vehicle;

an occupant monitoring system for obtaining information about occupancy of said compartment and controlling said restraint system based on the obtained information, said occupant monitoring system comprising;

at least first and second optical imagers for obtaining images of a common area of the said compartment, said first and second imagers being spaced apart from one another; and

processing circuitry coupled to said crash sensor system, said restraint system and said first and second imagers and arranged to derive information from images obtained by said first and second imagers and control the actuation of said restraint system based on the derived information and on detection of a crash by said crash sensor system,

said processing circuitry comprising a microprocessor with at least one pattern recognition algorithm, said at least one pattern recognition algorithm comprising a trained pattern recognition algorithm trained in a training stage to identify different occupants by obtaining images from said first and second imagers when each of a plurality of different occupants is present in the common area of said compartment and associating a derivation of the images with an identification of the occupant.