Method and apparatus for determining an occupant's head location in an actuatable occupant restraining system

• US 7,379,559 B2
• Filed: 05/28/2003
• Issued: 05/27/2008
• Est. Priority Date: 05/28/2003
• Status: Expired due to Fees

• Current Assignee: TRW Automotive USLLC (Zeppelin - Stiftung der Stadt Friedrichshafen)
• Original Assignee: TRW Automotive USLLC (Zeppelin - Stiftung der Stadt Friedrichshafen)
• Inventors: Dziadula, Robert, Luo, Yun, Wallace, Jon K., Khairallah, Farid
• Primary Examiner(s): Ahmed; Samir
• Assistant Examiner(s): Bhatnagar; Anand
• Application Number:
  US10/447,248
• Publication Number:
  US 20040240706A1
• Time in Patent Office: 1,826 Days
• Field of Search: 382/100, 382/103, 382/107, 382/154, 382/165, 382/181, 382/199, 701/1, 701/36, 701/45, 340/907, 340/933, 348/113, 348/135
• US Class Current: 382/100
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06V 40/165 using facial parts and geometric relationships

Abstract

An apparatus (20) for determining a location of a person'"'"'s head (90) includes stereo vision system (60) for imaging an area of interest such as the interior of a vehicle (26). The vision system provides an image signal of the area of interest. An analyzer (80) analyzes the image signal to identify head candidates (90′, 210, 212, 214, 216) in the area of interest and provides data regarding any identified head candidates in the area of interest. A processor (80) processes the provided data regarding identified head candidates to locate the person'"'"'s head. In an air bag restraining system (22), a controller (50) monitors the location of the person'"'"'s head and controls an air bag (34) in response to a sensed crash condition (52) and the location of the person'"'"'s head.

Claims

1. An apparatus for determining a location of a person'"'"'s head, said apparatus comprising:

a vision system for imaging an area of interest and providing an image signal of the area of interest;

an analyzer for analyzing the image signal to identify a plurality of head candidates in the area of interest and for providing data regarding the plurality of head candidates, the provided data comprising at least one of the size, shape, and texture of each of the plurality of the head candidates; and

a processor for processing the provided data regarding each of the identified head candidates to determine which of the plurality of head candidates represents the person'"'"'s head.

2. The apparatus of claim 1 wherein the vision system includes a stereo camera.

3. The apparatus of claim 1 wherein the analyzer includes means for computing head size.

4. The apparatus of claim 1 wherein the processor includes means for filtering shadow effects using 2D templates and 3D images.

5. The apparatus of claim 1 wherein said analyzer includes means for performing a head candidate algorithm using the image signal to identify the head candidates in the area of interest.

6. The apparatus of claim 5 wherein said analyzer further includes means for determining position of the identified head candidates.

7. The apparatus of claim 5 wherein said means for performing the head candidate algorithm includes first determining means for determining a blob image from the image signal.

8. The apparatus of claim 7 wherein said means for performing the head candidate algorithm further includes second determining means for determining a contour of the blob image and establishing a contour image in response thereto.

9. The apparatus of claim 8 wherein said means for performing the head candidate algorithm further includes third determining means for determining turning point locations of the contour image.

10. The apparatus of claim 9 wherein said means for performing the head candidate algorithm further includes means for performing an ellipse fitting algorithm for determining the quality of ellipse fits of the contour image between determined turning point locations.

11. The apparatus of claim 5 wherein said means for performing the head candidate algorithm includes means for determining at least two of a 3D spherical shape head candidate, a contour based head candidate, and a motion based head candidate from the image signal.

12. The apparatus of claim 1 wherein said processor includes means for performing a hypothesis elimination algorithm to filter identified head candidates and locate the person'"'"'s head.

13. The apparatus of claim 1 wherein said processor includes means for modeling multiple head features including at least one of motion and moments to determine which of the plurality of head candidates represents the person'"'"'s head.

14. The apparatus of claim 1 wherein the analyzer includes means for performing a hill climbing algorithm on the image signal to identify any of said head candidates.

15. The apparatus of claim 1 wherein said processor includes at least one of a neural network and support vector machine to verify an identified head candidate as the person'"'"'s head.

16. The apparatus of claim 1 further including means for tracking the position of the person'"'"'s head.

17. The apparatus of claim 1 further including an air bag and means for controlling the air bag in response to the location of the person'"'"'s head.

18. An air bag restraining system for helping to protect an occupant of a vehicle upon the occurrence of a vehicle crash event, said apparatus comprising:

an air bag restraining device for, when actuated, helping to protect the vehicle occupant;

crash sensor for sensing a vehicle crash event and, when a crash event occurs, providing a crash signal;

air bag controller for monitoring the crash sensor and controlling actuation of the air bag restraining device;

a stereo vision system for imaging an interior area of the vehicle and providing an image signal of the area of interest; and

a vision system controller connected to the air bag controller for analyzing the image signal from the stereo vision system to identify a plurality of head candidates in the interior of the vehicle, for providing data regarding the plurality of head candidates, the provided data comprising at least one of the size, shape, and texture of the head candidate;

processing the provided data regarding each of the plurality of head candidates to determine which of the plurality of head candidates represents the occupant'"'"'s head, and providing a signal indicative of the occupant'"'"'s head location to the air bag controller;

the air bag controller controlling actuation of the air bag restraining device in response to both the crash signal and the signal indicative of the location of the occupant'"'"'s head.

19. A method for determining a location of a person'"'"'s head, said method comprising the steps of:

imaging an area of interest and providing an image signal of the area of interest;

analyzing the image signal to identify a plurality of head candidates in the area of interest and providing data regarding the plurality of head candidates, the provided data comprising at least one of the size, shape, and texture of each of the plurality of the head candidates; and

processing the provided data regarding each of the plurality of head candidates to determine which of the plurality of head candidates represents the person'"'"'s head.

20. The method of claim 19 wherein the step of imaging system includes using a stereo camera.

21. The method of claim 19 wherein the step of analyzing the image signal includes computing head size.

22. The method of claim 19 wherein the step of processing includes filtering shadow effects using 2D templates and 3D images.

23. The method of claim 19 wherein the step of analyzing includes performing a head candidate algorithm using the image signal to identify the head candidates in the area of interest.

24. The method of claim 23 wherein the step of analyzing further includes the step of determining position of the identified head candidates.

25. The method of claim 23 wherein the step of performing the head candidate algorithm includes determining a blob image from the image signal.

26. The method of claim 25 wherein the step of performing the head candidate algorithm further includes determining a contour of the blob image and establishing a contour image in response thereto.

27. The method of claim 26 wherein the step of performing the head candidate algorithm further includes determining turning point locations of the contour image.

28. The method of claim 27 wherein the step of performing the head candidate algorithm further includes performing an ellipse fitting algorithm for determining the quality of ellipse fits of the contour image between determined turning point locations.

29. The method of claim 23 wherein the step of performing the head candidate algorithm includes determining at least two of a 3D spherical shape head candidate, a contour based head candidate, and a motion based head candidate from the image signal.

30. The method of claim 19 wherein step of processing includes performing a hypothesis elimination algorithm to filter identified head candidates and locate the person'"'"'s head.

31. The method of claim 19 wherein the step of processing includes modeling multiple head features including at least one of motion and moments and to determine which of the plurality of head candidates represents the person'"'"'s head.

32. The method of claim 19 wherein the step of analyzing includes performing a hill climbing algorithm on the image signal to identify any of the head candidates.

33. The method of claim 19 wherein the step of processing includes using at least one of a neural network and support vector machine to verify and identified head candidate as the person'"'"'s head.

34. The method of claim 19 further including the step of tracking position of the person'"'"'s head.

35. The method of claim 19 further including the steps of providing an air bag restraining device and controlling the air bag restraining device in response to the location of the person'"'"'s head.

36. A method for controlling an air bag restraining system to help protect an occupant of a vehicle upon the occurrence of a vehicle crash event, said method comprising the steps of:

providing an air bag restraining device for, when actuated, helping to protect the vehicle occupant;

sensing a vehicle crash event and providing a crash signal upon the occurrence of a vehicle crash event;

monitoring the crash sensor;

imaging an interior area of the vehicle and providing an image signal of the area of interest;

analyzing the image signal to identify a plurality of head candidates in the interior of the vehicle, for providing data regarding the plurality of head candidates, the provided data comprising at least one of the size, shape, and texture of each of the plurality of the head candidates;

providing data regarding any identified head candidates;

processing the provided data regarding each of the plurality of head candidates to determine which of the plurality of head candidates represents the occupant'"'"'s head;

providing a signal indicative of the occupant'"'"'s head location;

controlling actuation of the air bag restraining device in response to both the crash signal and the signal indicative of the location of the occupant'"'"'s head.