Method and device for monitoring the interior and surrounding area of a vehicle

• US 6,920,234 B1
• Filed: 05/05/2000
• Issued: 07/19/2005
• Est. Priority Date: 05/08/1999
• Status: Expired due to Fees

• Current Assignee: Robert Bosch GmbH
• Original Assignee: Robert Bosch GmbH
• Inventors: Hürtgen, Bernd, Koenig, Winfried, Pöchmüller, Werner
• Primary Examiner(s): Boudreau, Leo
• Assistant Examiner(s): Lu, Tom Y.
• Application Number:
  US09/743,305
• Time in Patent Office: 1,901 Days
• Field of Search: 382/103, 382/104, 382143-144, 382148-149, 396/9, 396/322, 396/326, 396/332, 396/427, 396/471, 348/148, 348/143, 348/144, 348/149
• US Class Current: 382/103
• CPC Class Codes: G08B 13/19645 Multiple cameras, each having view on one of a plurality of scenes, e.g. multiple cameras for multi-room surveillance or for tracking an object by view hand-over
• CPC Class Codes: G08B 13/19647 Systems specially adapted for intrusion detection in or around a vehicle
• CPC Class Codes: G08B 13/19695 Arrangements wherein non-video detectors start video recording or forwarding but do not generate an alarm themselves

Abstract

A method and device for capturing a surrounding area and interior of a motor vehicle are described. The device for performing the method includes a camera device that has a beam path that points in a direction of the surrounding area of the vehicle, in particular a road, and has a beam path that points in a direction of the vehicle interior. A processing unit controls and evaluates the image information obtained.

Claims

1. A method for monitoring an interior of a motor vehicle and a surrounding area of the motor vehicle, comprising:

(1) capturing an image of at least part of the surrounding area of the motor vehicle by a first optical opening of a camera device;

(2) capturing an image of at least part of the interior of the motor vehicle by a second optical opening of the camera device, the steps (1) and (2) being performed alternately; and

(3) transmitting the images obtained in steps (1) and (2) to a processing unit.

2. The method according to claim 1, wherein:

the at least part of the surrounding area of the vehicle is in a direction of travel.

3. The method according to claim 1, wherein:

the at least part of the interior of the vehicle includes parts of a body of a driver.

4. The method according to claim 1, wherein step (1) includes illuminating the interior of the vehicle by a radiation source, the radiation source emitting a radiation at least substantially invisible to the human eye.

5. The method according to claim 4, wherein:

the radiation source is an infra-red radiation source.

7. The method according to claim 1, wherein:

only an image of an area surrounding the motor vehicle visible to the camera device is captured in the step (1); and

only an image of the interior of the motor vehicle visible to the camera device is captured in the step (2).

8. The method according to claim 7, wherein:

switching back and forth between the step (1) the step (2) is accomplished via at least one light valve.

9. The method according to claim 8, wherein:

the at least one light valve is an electro-optical light valve.

10. The method according to claim 1, wherein an image captured is only a partial area of a maximum image that may be captured by the camera device, the partial area of the maximum image including at least one of image rows, image columns, and image pixels, and wherein the method further comprises:

switching back and forth between capturing a partial area of the interior and a partial area of the surrounding area;

processing by the processing unit the partial areas captured; and

capturing a next partial area.

11. The method according to claim 1, further comprising:

capturing a face of a driver, the face including eyes of the driver.

12. The method according to claim 1, further comprising:

capturing at least one of road markings and a position of the vehicle relative to the road markings.

13. The method according to claim 11, further comprising:

evaluating at least one of the face of the driver and a position of the vehicle relative to road markings to determine at least one of whether the eyes of the driver are open and whether the vehicle is moving beyond a predefined area of the road markings; and

issuing at least one of a visual warning and an audible warning based on the evaluation.

14. The method according to claim 1, further comprising:

capturing road signs.

15. The method according to claim 1, further comprising:

determining at least one of a number of people in the vehicle and a seat occupancy.

16. The method according to claim 15, further comprising:

deactivating at least one of an airbag and a seat heater of a corresponding seat when the corresponding seat is one of empty and occupied by a child seat.

17. The method according to claim 1, further comprising:

capturing lip movements of a person in the vehicle to support a speech input system.

18. The method according to claim 17, wherein:

the person is a driver of the vehicle.

6. A method for monitoring an interior of a motor vehicle and a surrounding area of the motor vehicle, comprising:

(1) capturing an image of at least part of the surrounding area of the motor vehicle by a camera device;

(2) capturing an image of at least part of the interior of the motor vehicle by the camera device, the steps (1) and (2) being performed alternately; and

(3) transmitting the images obtained in steps (1) and (2) to a processing unit;

wherein step (2) includes;

superimposing the at least part of the interior of the vehicle visible to the camera device on the at least part of the surrounding area of the vehicle visible to the camera device; and

determining the image of the at least part of the interior of the vehicle by subtracting the image of the at least part of the surrounding area.

19. A device for monitoring an interior of a motor vehicle and a surrounding area of the motor vehicle, comprising:

a camera device having a first optical opening and a second optical opening, wherein the camera device is configured to alternately capture an image of at least part of the interior of the motor vehicle by the first optical opening and capture an image of at least part of the surrounding area of the motor vehicle by the second optical opening; and

a processing unit connected to the camera device, the images captured by the camera device transmitted to the processing unit.

20. The device according to claim 19, wherein:

a first beam path of the camera device points in a direction of a road in front of the vehicle; and

a second beam path of the camera device points in a direction of the interior.

21. The device according to claim 20, wherein:

the second beam path of the camera device points in a direction of a driver in the interior.

22. The device according to claim 19, further comprising:

an illumination unit configured to emit a radiation at least substantially invisible to the human eye, the illumination unit controlled by the processing unit.

23. The device according to claim 22, wherein:

the radiation is infra-red radiation.

24. The device according to claim 19, further comprising:

an infra-red filter arranged in the camera device.

25. The device according to claim 24, wherein:

the infra-red filter is arranged in the second beam path in the direction of the interior.

26. The device according to claim 19, further comprising:

at least one light valve arranged in the camera device.

27. The device according to claim 26, wherein:

the at least one light valve is a liquid crystal cell.

28. The device according to claim 19, further comprising:

at least one deviation mirror arranged in the camera device.

29. The device according to claim 28, wherein:

the at least one deviation mirror is semi-transparent.

30. The device according to claim 29, wherein:

the at least one deviation mirror is one of concave and convex.

31. The device according to claim 19, wherein:

the camera device has a single camera.

32. The device according to claim 31, wherein:

the single camera is one of a CCD camera and a CMOS camera.

33. The device according to claim 19, wherein:

the camera device has at least two cameras for capturing images stereoscopically.

34. The device according to claim 19, further comprising:

at least one of visual output units and acoustic output units connected to the processing unit, the at least one of visual output units and acoustic output units configured to issue a warning to a driver when one of eyes of the driver are closed and the vehicle is about to move beyond a marked area of a road.

35. The device according to claim 19, wherein:

the camera device is one of arranged in an upper part of a windshield and integrated into a roof of the vehicle.

36. The device according to claim 28, further comprising:

an adjustment device configured to adjust the at least one deviation mirror so that at least eyes and lips of a driver can be seen in the image of the interior of the vehicle captured by the camera device.

37. A device for monitoring an interior of a motor vehicle and a surrounding area of the motor vehicle, comprising:

a camera device having a first optical opening and a second optical opening, wherein the camera device is configured to alternately capture an image of at least part of the interior of the motor vehicle by the first optical opening and capture an image of at least part of the surrounding area of the motor vehicle by the second optical opening; and

a processing unit connected to the camera device, the images captured by the camera device transmitted to the processing unit;

wherein the image of at least part of the interior of the motor vehicle is determined by;

superimposing the at least part of the interior of the vehicle visible to the camera device on the at least part of the surrounding area of the vehicle visible to the camera device; and

determining the image of the at least part of the interior of the vehicle by subtracting the image of the at least part of the surrounding area.