Motion based segmentor for occupant tracking using a hausdorf distance heuristic

• US 20030133595A1
• Filed: 10/11/2002
• Published: 07/17/2003
• Est. Priority Date: 05/30/2001
• Status: Abandoned Application

• Current Assignee: Eaton Corp. (Wisconsin) (Eaton Corporation PLC.)
• Original Assignee: Eaton Corp. (Wisconsin) (Eaton Corporation PLC.)
• Inventors: Farmer, Michael, Wen, Li, Chen, Xunchang, Zhou, Chuan
• Application Number:
  US10/269,357
• Publication Number:
  US 20030133595A1
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: B60R 2021/0044 Chest
• CPC Class Codes: B60R 2021/01315 monitoring occupant displacement
• CPC Class Codes: B60R 21/01538 for image processing, e.g. cameras or sensor arrays
• CPC Class Codes: B60R 21/0154 in combination with seat heating
• CPC Class Codes: B60R 21/01542 detecting passenger motion
• CPC Class Codes: B60R 21/01552 detecting position of specific human body parts, e.g. face, eyes or hands
• CPC Class Codes: B60R 21/01556 Child-seat detection systems
• CPC Class Codes: B60R 21/01558 monitoring crash strength
• CPC Class Codes: G06F 18/24765 Rule-based classification
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/10048 Infrared image
• CPC Class Codes: G06T 2207/30268 Vehicle interior
• CPC Class Codes: G06T 7/12 Edge-based segmentation
• CPC Class Codes: G06T 7/174 involving the use of two or more images
• CPC Class Codes: G06T 7/215 Motion-based segmentation
• CPC Class Codes: G06T 7/254 involving subtraction of images
• CPC Class Codes: G06T 7/277 involving stochastic approaches, e.g. using Kalman filters
• CPC Class Codes: G06T 7/74 involving reference images or patches
• CPC Class Codes: G06V 10/765 using rules for classification or partitioning the feature space
• CPC Class Codes: G06V 20/59 inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
• CPC Class Codes: G06V 40/103 : Static body considered as a whole, e.g. static pedestrian or occupant recognition

Abstract

A segmentation system is disclosed that allows a segmented image of a vehicle occupant to be identified within an overall image (the “ambient image”) of the area that includes the image of the occupant. The segmented image from a past sensor measurement within can help determine a region of interest within the most recently captured ambient image. To further reduce processing time, the system can be configured to assume that the bottom of segmented image does not move. Differences between the various ambient images captured by the sensor can be used to identify movement by the occupant, and thus the boundary of the segmented image. A template image is then fitted to the boundary of the segmented image for an entire range of predetermined angles. The validity of each fit within the range of angles can be evaluated. The template image can also be modified for future ambient images.

Claims

1. A method for isolating a current segmented image from a current ambient image captured by a sensor, said image segmentation method comprising:

comparing the current ambient image to a prior ambient image;

identifying a border of the current segmented image by differences between the current ambient image and the prior ambient image; and

matching a template to the identified border with a Hausdorf distance heuristic.

2. The method of claim 1, wherein the prior ambient image is captured less than approximately {fraction (1/40)} of a second before the current ambient image is captured.

3. The method of claim 1, further comprising determining an area of interest in the current ambient image.

4. The method of claim 3, further comprising ignoring the portions of the current ambient image that are not within the area of interest.

5. The method of claim 3, wherein determining an area of interest in the ambient image includes predicting the location of the current segmented image from the prior segmented image.

6. The method of claim 5, wherein a Kalman filter is used to predict the location of the current segmented image from the prior segmented image.

7. The method of claim 3, wherein the area of interest is a rectangle in the current ambient image.

8. The method of claim 3, wherein a bottom area in the prior segmented image is ignored in the current ambient image.

9. The method of claim 1, wherein a plurality of pixels in the current ambient image are compared to a corresponding plurality of pixels in the prior ambient image.

10. The method of claim 9, wherein each pixel in said plurality of pixels in the current ambient image is compared to a corresponding pixel in said plurality of pixels in the prior ambient image.

11. The method of claim 1, further comprising applying a low-pass filter to the identified border.

12. The method of claim 1, further comprising performing an image gradient heuristic to locate an area of change between the current ambient image and the prior ambient image.

13. The method of claim 1, further comprising thresholding the identified border.

14. The method of claim 1, further comprising selecting the prior segmented image as the current segmented image.

15. The method of claim 1, further comprising invoking a clean gradient image heuristic.

16. The method of claim 1, wherein matching the template includes rotating the template through a range of angles.

17. The method of claim 16, wherein the range of angles is from approximately −

6 degrees and +6 degrees.

18. The method of claim 16, wherein the angles in said range of angles are predetermined.

19. The method of claim 1, wherein the template is a binary image.

20. The method of claim 1, further comprising modifying the template.

21. The method of claim 20, wherein modifying the template includes setting a cubic spline fit.

22. The method of claim 21, wherein modifying the template includes setting a new set of control points.

23. The method of claim 1, further comprising fitting an ellipse to the template.

24. The method of claim 23, wherein fitting an ellipse to the template includes invoking direct least squares fitting heuristic.

25. The method of claim 24, wherein fitting the ellipse includes copying a lower portion of a previous ellipse.

26. A method for isolating a current segmented image from a current ambient image, comprising:

identifying a region of interest in the current ambient image from a previous ambient image;

applying a low-pass filter to an image difference determined by comparing the region of interest in the current ambient image to a corresponding area in the previous ambient image;

performing an image gradient calculation for finding a region in the current ambient image with a rapidly changing image amplitude;

thresholding the image difference with a predetermined cumulative distribution function;

cleaning the results of the image gradient calculation;

matching a template image to the cleaned results with a Hausdorf distance heuristic; and

fitting an ellipse to the template image.

27. A segmentation system for isolating a segmented image from an ambient image, comprising:

an ambient image, including a segmented image and an area of interest;

a gradient image module, including a gradient image, wherein said gradient image module generates said gradient image in said area of interest; and

a template module, including a template, a template match, and a Hausdorf heuristic, wherein said template module generates said template match from said template, said gradient image, and said Hausdorf heuristic.

28. The system of claim 27, wherein said template module assumes said segmented image remains in a seated position.

29. The system of claim 27, wherein said template module rotates said template.

31. The system of claim 27, further comprising:

a product image, a binary image, and a non-binary image;

wherein said template is a binary image and said gradiant image is a non-binary image; and

wherein said product image is generated by multiplying said template with said gradiant image.

30. The system of 29, further comprising a range of angles including a plurality of predefined angles, wherein said template module rotates said template in each of said plurality of predefined angles.