Method and apparatus for arbitrating outputs from multiple pattern recognition classifiers

• US 7,471,832 B2
• Filed: 02/24/2004
• Issued: 12/30/2008
• Est. Priority Date: 02/24/2004
• Status: Expired due to Fees

• Current Assignee: TRW Automotive USLLC (Zeppelin - Stiftung der Stadt Friedrichshafen)
• Original Assignee: TRW Automotive USLLC (Zeppelin - Stiftung der Stadt Friedrichshafen)
• Inventors: Luo, Yun, Wallace, Jon K., Khairallah, Farid
• Primary Examiner(s): Desire; Gregory M
• Application Number:
  US10/785,278
• Publication Number:
  US 20050185845A1
• Time in Patent Office: 1,771 Days
• Field of Search: 382/103, 382/190, 382/224, 382/228, 382/284, 382/104, 382/159, 701/45, 701/47, 701/49, 280/732, 280/735, 348/148, 348/228
• US Class Current: 382/224
• CPC Class Codes: G06F 18/24317 Piecewise classification, i.e. whereby each classification requires several discriminant rules
• CPC Class Codes: G06F 18/254 of classification results, e.g. of results related to same input data
• CPC Class Codes: G06V 10/764 using classification, e.g. of video objects
• CPC Class Codes: G06V 10/809 of classification results, e.g. where the classifiers operate on the same input data
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands

Abstract

A system (400) for classifying an input image into one of a plurality of output classes includes a plurality of pattern recognition classifiers (420, 422, 424). Each of the plurality of pattern recognition classifiers determines a candidate output class and at least one rejected output class for the input image from an associated subset of the plurality of output classes. Each classifier generates a confidence value associated with the classifier based on the determination. An arbitrator (430) selects a classifier having the best associated confidence value and eliminates the at least one rejected class determined at the selected classifier from consideration as the associated class for the input image.

Claims

1. A computer readable medium, storing computer executable instructions thereon for classifying an input image into one of a plurality of output classes comprising at least three classes, said executable instructions, when executed by a processor, performing the following process:

determining a candidate output class, at least one rejected output class, and an associated confidence value from a set of associated output classes at each of a plurality of classifiers;

selecting a classifier from the plurality of classifiers having a best confidence value;

eliminating the at least one rejected class at the selected classifier from consideration as the associated class for the input image; and

iteratively repeating the following steps until only one output class remains;

defining a subset of classifiers associated with the candidate output class from the selected classifier;

selecting a new classifier having the best associated confidence value within the defined subset; and

eliminating the at least one rejected classes determined at the selected new classifier from consideration as the associated class for the input image.

2. A system for classifying image data associated with a vehicle occupant safety system into an associated one of a plurality of output classes, said system comprising:

a camera that images a vehicle interior to provide an input image;

a plurality of pattern recognition classifiers, each of the plurality of pattern recognition classifiers having associated first and second output classes from the plurality of output classes and being operative to select one of the first and second output classes as a candidate output class for the input image and the other of the first and second output classes as a rejected output class and generate a confidence value associated with the classifier based on the selection;

an arbitrator that conducts an iterative process until only one of the plurality of pattern recognition classifiers, and its associated selected output class, remain, wherein at each iteration, the arbitrator selects a classifier having a best associated confidence value from a classifier set initially comprising the plurality of classifiers, determines the rejected class associated with the selected classifier, and removes each classifier within the classifier set having the rejected class as one of its associated first and second output classes, such that in the next iteration, the classifier set will include only classifiers that do not have the rejected class as one of its associated first and second output classes.

3. The system of claim 2, wherein the candidate class determined by the one remaining classifier is accepted as the output class associated with the input image, and the accepted class is provided as an input to the vehicle occupant safety system.

4. The system of claim 2 wherein at least one of the plurality of output classes represents a human adult seated within the vehicle interior.

5. The system of claim 2 wherein at least one of the plurality of output classes represents a rearward facing infant seat positioned within the vehicle interior.

6. The system of claim 2 wherein at least one of the plurality of output classes represents a human head.

7. The system of claim 2 wherein the vision system is operative to produce a two-dimensional image of the vehicle interior.

8. The system of claim 2 wherein the vision system is operative to produce a three-dimensional image of the vehicle interior.

9. The system of claim 8 wherein the vision system comprises a stereo camera that images the vehicle interior as a stereo disparity map.

10. A method for classifying an input image into an associated one of a plurality of output classes comprising the steps of:

determining a candidate output class, at least one rejected output class, and an associated confidence value from a set of associated output classes at each of a plurality of classifiers;

selecting a classifier from the plurality of classifiers having a best confidence value;

eliminating the at least one rejected class at the selected classifier from consideration as the associated class for the input image; and

iteratively repeating the following steps until only one output class remains;

defining a subset of classifiers associated with the candidate output class from the selected classifier;

selecting a new classifier having the best associated confidence value within the defined subset; and

eliminating the at least one rejected classes determined at the selected new classifier from consideration as the associated class for the input image.

11. The method of claim 10 further comprising accepting the one remaining output class as the associated output class for the input image, and providing the accepted output class to a vehicle occupant safety system.

12. The method of claim 10 further comprising extracting feature data from the input image and providing the extracted feature data to the plurality of classifiers.

13. The method of claim 12 wherein extracting feature data from the input image includes extracting at least one feature value from at least one region of interest within the image.

14. The method of claim 12 wherein the at least one feature value includes an average grayscale value associated with each region of interest.

15. The method of claim 12 wherein the at least one feature value includes a coarseness measure associated with each region of interest.

16. The method of claim 12 wherein the at least one feature value includes a contrast measure associated with each region of interest.