Method and apparatus for determining characteristics of an object from a contour image

• US 20080317355A1
• Filed: 06/21/2007
• Published: 12/25/2008
• Est. Priority Date: 06/21/2007
• Status: Abandoned Application

• Current Assignee: TRW Automotive USLLC (Zeppelin - Stiftung der Stadt Friedrichshafen)
• Original Assignee: TRW Automotive USLLC (Zeppelin - Stiftung der Stadt Friedrichshafen)
• Inventors: Luo, Yun, Parent, David
• Application Number:
  US11/820,814
• Publication Number:
  US 20080317355A1
• Time in Patent Office: Days
• US Class Current: 382/199
• CPC Class Codes: B60R 21/01538 for image processing, e.g. cameras or sensor arrays
• CPC Class Codes: G06V 20/59 inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition

Abstract

Systems and methods are provided for determining an associated occupant class for a vehicle occupant from an image of a vehicle interior. An image characterizer (154) determines a centroid of the image of the vehicle occupant is determined and produces an image representative signal that represents the image data as a series of discrete values according to its position relative to the determined centroid. A frequency domain transform (156) converts the image representative signal to a frequency domain to produce a plurality of coefficients. A pattern recognition classifier (56) determines an associated output class for the occupant utilizing at least two of the plurality of coefficients. A controller interface (58) regulates an actuatable occupant restraint device according to the determined output class.

Claims

1. A method for classifying an image of a vehicle occupant into one of a plurality of output classes to regulate the operation of a vehicle occupant protection system, comprising:

determining a centroid of the image of the vehicle occupant;

producing an image representative signal that represents the image data as a series of discrete values according to its position relative to the determined centroid;

converting the image representative signal to a frequency domain to produce a plurality of coefficients;

determining an associated output class for the occupant utilizing at least two of the plurality of coefficients; and

regulating an actuatable occupant restraint device according to the determined output class.

2. The method of claim 1, wherein producing at least one image representative signal comprises determining a distance between the centroid and the contour along each of a plurality of angles and combining the determined distances over predetermined intervals of arc to produce the image representative signal.

3. The method of claim 1, wherein converting the image representative signal to a frequency domain comprises determining a plurality of frequency coefficients representing frequency components of the image representative signal and normalizing the plurality of frequency coefficients according to a zeroth order frequency coefficient such that the coefficient values are invariant across changes in the scale of the image.

4. The method of claim 1, further comprising:

acquiring an image of a vehicle interior; and

isolating a portion of the image that represents the vehicle occupant, such that the contour of the occupant is determined from the isolated portion of the image.

5. The method of claim 4, wherein isolating a portion of the image comprises thresholding the image to identify an image foreground and binarizing the image to isolate the foreground region as a plurality of binarized pixels.

6. The method of claim 5, wherein isolating a portion of the image comprises clustering the plurality of binarized pixels into at least one pixel blob and selecting a largest pixel blob within a region of interest.

7. The method of claim 1, wherein producing a image representative signal comprises:

transforming image data within the contour to a polar coordinate representation having an origin at the determined centroid; and

taking a plurality of samples from the transformed image data to provide the image representative data.

8. The method of claim 7, wherein converting the image representative signal to a frequency domain comprises:

applying a discrete cosine transform to the image representative signal along a radial direction; and

applying a discrete Fourier transform along the angular direction.

9. A system for determining an associated occupant class for a vehicle occupant from an image of a vehicle interior comprising:

an image generator that isolates a portion of the image that represents the vehicle occupant and determines a contour of the occupant from the isolated portion of the image of the vehicle interior;

a centroid locator that determines a centroid of the image contour;

a image characterizer that produces an image representative signal that represents the distance between the centroid and the contour along each of a plurality of angles;

a frequency domain transform that converts the contour signal to a frequency domain to produce a plurality of frequency coefficients;

a coefficient selector that selects a subset of the plurality of frequency coefficients as the plurality of feature values; and

a pattern recognition classifier that determines an associated output class for the occupant utilizing the selected subset of parameters.

10. The system of claim 9, wherein the image generator isolates the portion of the image representing the vehicle occupant by thresholding the image to identify an image foreground, binarizing the image to isolate the foreground region comprising a plurality of binarized pixels, clustering the plurality of binarized pixels into at least one pixel blob, and selecting a largest pixel blob within a region of interest.

11. The system of claim 9, wherein the image characterizer determines a distance between the centroid and the contour along each of a plurality of angles and combines the determined distances over predetermined intervals of arc to produce the contour signal.

12. The system of claim 9, further comprising a sensor mounted in the headliner of the vehicle interior that produces an overhead image of one of a front passenger seat and a rear passenger seat.

13. A vehicle occupant protection system, comprising:

an actuatable vehicle occupant restraint device; and

a controller for the actuatable vehicle restraint device, comprising the system of claim 9, the actuation of the actuatable vehicle occupant restraint device being regulated by the controller in response to the determined output class.

14. A computer readable medium comprising executable instructions that, when executed by a data processing system, generate a plurality of feature values representing a vehicle occupant from an image portion taken from an image of the vehicle interior, the executable instructions comprising:

a centroid location routine that determines a centroid of the image portion;

an image characterizing routine that transforms image data within the image portion to a polar coordinate representation having an origin at the determined centroid;

taking a plurality of samples from the transformed image data to provide the image representative signal;

a frequency domain transform that converts the image representative signal to a frequency domain to produce a plurality of frequency coefficients; and

a coefficient selection routine that selects a subset of the plurality of frequency coefficients as the plurality of feature values.

15. The computer readable medium of claim 14, wherein converting the image representative signal to a frequency domain comprises:

applying a discrete cosine transform to the image representative signal along a radial direction; and

applying a discrete Fourier transform along the angular direction.

16. The computer readable medium of claim 14, the executable instructions further comprising a pattern recognition classifier that determines an associated occupant class for the vehicle occupant from a plurality of associated occupant classes.

17. The computer readable medium of claim 14, the executable instructions further comprising an image generation routine that isolates a portion of the image representing the vehicle occupant, determines a contour of the object of interest, and provides the determined contour to the centroid location routine.

18. The computer readable medium of claim 17, wherein the image generation routine isolates the portion of the image representing the vehicle occupant by thresholding the image to identify an image foreground, binarizing the image to isolate the foreground region comprising a plurality of binarized pixels, clustering the plurality of binarized pixels into at least one pixel blob, and selecting a largest pixel blob within a region of interest.

19. The computer readable medium of claim 14, wherein the frequency domain transform normalizes the plurality of frequency coefficients according to a zeroth order frequency coefficient.

20. A vehicle occupant protection system, comprising:

an actuatable vehicle occupant restraint device; and

a controller for the actuatable vehicle restraint device, comprising;

a processor that is operative to execute the executable instructions associated with the computer readable medium of claim 14.