Occupant sensing system and method via imaging

• US 6,810,133 B2
• Filed: 06/01/2001
• Issued: 10/26/2004
• Est. Priority Date: 06/01/2001
• Status: Expired due to Fees

• Current Assignee: TRW Limited (Zeppelin - Stiftung der Stadt Friedrichshafen)
• Original Assignee: TRW Limited (Zeppelin - Stiftung der Stadt Friedrichshafen)
• Inventors: Foo, Chek-Peng, Wallace, Jon K., Cooper, Stephen R. W., Khairallah, Farid, Zayan, Nicholas M.
• Primary Examiner(s): Mehta, Bhavesh M.
• Assistant Examiner(s): Tabatabai, Abolfazl
• Application Number:
  US09/872,527
• Publication Number:
  US 20020181743A1
• Time in Patent Office: 1,243 Days
• Field of Search: 382/104, 382/115, 348/143, 348/148, 348/152, 340/425.5, 340/426.1, 340/429, 340/507, 701/45, 701/49, 701/207, 280/735
• US Class Current: 382/104
• CPC Class Codes: B60R 21/01538 for image processing, e.g. cameras or sensor arrays
• CPC Class Codes: G06T 7/254 involving subtraction of images

Abstract

An occupant sensing system (12) and an associated method provide for the sensing of an occupant (14). An illuminating element (46) of the system (12)selectively illuminates the interior of a vehicle (8). An image sensor (50) acquires a first image of the interior of the vehicle (8) when the interior of the vehicle is illuminated by ambient sources only and acquires a second image of the interior of the vehicle when the interior of the vehicle is illuminated by ambient sources and the illuminating element (46). A controller (34) removes the effect of ambient sources by comparing the first and second images to produce a third image of the interior of the vehicle (8) as illuminated by the illuminating element (46) only. The controller (34) determines the presence of an occupant (14) by comparing the third image to a produced map of the interior of the vehicle (8).

Claims

1. An occupant sensing system comprising:

an illuminating element for selectively illuminating the interior of a vehicle;

an image sensor for acquiring a first image of the interior of the vehicle when the interior of the vehicle is illuminated by ambient sources only and for acquiring a second image of the interior of the vehicle when the interior of the vehicle is illuminated by ambient sources and said illuminating element; and

a controller for removing the effect of ambient sources by comparing said first and second images thereby producing a third image of the interior of the vehicle as illuminated by the illuminating element only, said controller determining the presence of an occupant by comparing said third image to a produced map of the interior of the vehicle.

2. The system of claim 1 wherein no occupant is present within the interior of the vehicle in said map.

3. The system of claim 1 wherein, to produce said map, said image sensor acquires a first map of the interior of the vehicle when the interior of the vehicle is illuminated by ambient sources only and acquires a second map of the interior of the vehicle when the interior of the vehicle is illuminated by ambient sources and said illuminating element;

and

wherein said controller removes the effect of ambient sources from said map by comparing said first and second maps thereby producing said map of the interior of the vehicle as illuminated by the illuminating element only.

4. The system of claim 1 wherein said controller updates said map of the interior of the vehicle by comparing a plurality of maps produced over time.

5. The system of claim 1 wherein, when an occupant is present within the interior of the vehicle, an outline of the occupant is developed when said third image is compared to said produced map.

6. The system of claim 1 wherein an aspect of the interior of the vehicle constitutes a background within said third image and said map, said controller determining the presence of an occupant by determining whether a portion of said background visible in said map is not visible in said third image.

7. The system of claim 6 wherein said controller determines whether a portion of said background visible in said map is not visible in said third image by differencing said third image and said map.

8. The system of claim 6 wherein said controller utilizes background location data corresponding to the location of said background within said map to determine the position of an occupant.

9. The system of claim 6 wherein the aspect that constitutes said backgrounds is moveable within the interior of the vehicle, said system further including:

a plurality of produced maps corresponding to a plurality of positions of the moveable aspect;

background location data for said third image corresponding to the location of said moveable background within said third image; and

background location data for each of said plurality of maps corresponding to the location of said moveable background within each of said plurality of maps, said controller comparing said background location data for said third image to said background location data for each of said plurality of maps to determine which map to compare said third image to.

10. The system of claim 9 wherein said controller utilizes occupant classification data to classify the occupant.

11. A method for sensing an occupant comprising the steps of:

acquiring a first image of the interior of the vehicle when the interior of the vehicle is illuminated by ambient sources only;

acquiring a second image of the interior of the vehicle when ambient sources and an illuminating element illuminate the interior of the vehicle;

removing the effect of ambient sources by comparing the first and second images thereby producing a third image of the interior of the vehicle as illuminated by the illuminating element only; and

determining the presence of an occupant by comparing the third image to a produced map of the interior of the vehicle.

12. The method of claim 11 further comprising the steps of:

acquiring a first map of the interior of the vehicle when the interior of the vehicle is illuminated by ambient sources only;

acquiring a second map of the interior of the vehicle when the interior of the vehicle is illuminated by ambient sources and the illuminating element; and

removing the effect of ambient sources from the map by comparing the first and second maps thereby producing the map of the interior of the vehicle as illuminated by the illuminating element only.

13. The method of claim 11 further comprising the step of updating the map of the interior of the vehicle by comparing a plurality of maps produced over time.

14. The method of claim 11 further comprising the step of developing an outline of the occupant when the third image is compared to the produced map.

15. The method of claim 11 further comprising the step of determining the presence of an occupant by determining whether a portion of a background visible in the map is not visible in the third image.

16. The method of claim 15 further comprising the step of differencing the third image and the map to determine whether a portion of the background visible in the map is not visible in the third image.

17. The method of claim 15 further comprising the step of utilizing background location data corresponding to the location of the background within the map to determine the position of an occupant.

18. The method of claim 15 further comprising the steps of:

comparing background location data corresponding to the location of a moveable background within the third image to background location data corresponding to the location of the moveable background within each of a plurality of maps to determine which map to compare the third image to.

19. The method of claim 18 further comprising the step of utilizing occupant classification data to classify the occupant.