Stereo camera supporting apparatus, stereo camera supporting method, calibration detection apparatus, calibration correction apparatus, and stereo camera system

• US 20050237385A1
• Filed: 06/28/2005
• Published: 10/27/2005
• Est. Priority Date: 05/29/2003
• Status: Abandoned Application

• Current Assignee: Olympus Corporation
• Original Assignee: Olympus Corporation
• Inventors: Miyoshi, Takashi, Iwaki, Hidekazu, Arai, Kazuhiko, Kosaka, Akio
• Application Number:
  US11/169,098
• Publication Number:
  US 20050237385A1
• Time in Patent Office: Days
• US Class Current: 348/42
• CPC Class Codes: G01B 11/00 Measuring arrangements characterised by the use of optical techniques
• CPC Class Codes: G01C 11/02 Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
• CPC Class Codes: G06T 7/85 Stereo camera calibration
• CPC Class Codes: G06V 10/147 Details of sensors, e.g. sensor lenses fingerprint or palmprint sensors G06V40/13; vascular sensors G06V40/145; eye sensors G06V40/19
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle

Abstract

A stereo camera supporting apparatus of the present invention comprises a joining member constituted in such a manner as to support a stereo camera on a vehicle, and a control device which controls posture or position of the stereo camera supported on the vehicle by the joining member. The control device controls the posture or position of the stereo camera with respect to video obtained by the stereo camera in such a manner that a contour portion present in the highest level position in a contour of a noted subject in the video is positioned in a frame upper end of the video or its vicinity irrespective of a change of the posture or position of the vehicle.

Claims

1. A stereo camera supporting apparatus which supports a stereo camera constituted in such a manner as to obtain a plurality of images having parallax errors by a plurality of visual points detached from one another, the apparatus comprising:

a joining member constituted by joining a support member disposed on a vehicle on which the stereo camera is provided, to a member to be supported disposed in a predetermined portion of the stereo camera in such a manner that a relation between both the members is variable in a predetermined range to thereby support the stereo camera on the vehicle; and

a control unit which controls posture or position of the stereo camera supported on the vehicle by the joining member,

the control unit controlling the posture or position of the stereo camera with respect to an image obtained by the stereo camera, so that a contour portion of an object, which lies at the highest position in the image, is located at or near the upper frame edge of the image, regardless of a change in the posture or position of the vehicle.

2. The stereo camera supporting apparatus according to claim 1, wherein the control unit performs a control operation based on a detection output of a detection unit which detects the posture or position of the vehicle.

3. The stereo camera supporting apparatus according to claim 1, wherein the control unit performs a control operation depending on an output of a video recognition unit which evaluates and recognizes a characteristic of the video obtained by the stereo camera.

4. The stereo camera supporting apparatus according to claim 1, wherein the control unit performs a control operation depending on a detection output of detection means for detecting the posture or position of the vehicle, and an output of a video recognition unit which evaluates and recognizes a characteristic of the video obtained by the stereo camera.

5. The stereo camera supporting apparatus according to claim 2, wherein the detection unit comprises at least one of a tilt detection unit which detects tilt of the vehicle, and a height detection unit which detects a level position of a predetermined portion of the vehicle.

6. The stereo camera supporting apparatus according to claim 4, wherein the detection unit comprises at least one of a tilt detection unit which detects tilt of the vehicle, and a height detection unit which detects a level position of a predetermined portion of the vehicle.

7. The stereo camera supporting apparatus according to claim 5, wherein the tilt detection unit detects a relative angle with respect to a vertical direction or a horizontal direction.

8. The stereo camera supporting apparatus according to claim 6, wherein the tilt detection unit detects a relative angle with respect to a vertical direction or a horizontal direction.

9. The stereo camera supporting apparatus according to claim 5, wherein the height detection unit detects a relative position with respect to a ground contact face of the vehicle.

10. The stereo camera supporting apparatus according to claim 6, wherein the height detection unit detects a relative position with respect to a ground contact face of the vehicle.

11. The stereo camera supporting apparatus according to any one of claims 1 to 3, wherein the control unit performs a feedback control.

12. The stereo camera supporting apparatus according to any one of claims 1 to 3, wherein the control unit performs a feedforward control.

16. The stereo camera supporting apparatus according to claim 1, wherein the control unit is constituted in such a manner as to perform a control operation using a detection output of a detection unit which detects the posture or position of the vehicle as a state variable without depending on the video by the stereo camera.

13. A stereo camera supporting apparatus which supports a stereo camera constituted in such a manner as to obtain a plurality of images having parallax errors by a plurality of visual points detached from one another, the apparatus comprising:

a joining member constituted by joining a support member disposed on an object side on which the stereo camera is provided, to a member to be supported disposed in a predetermined portion of the stereo camera in such a manner that a relation between both the members is variable in a predetermined range to thereby support the stereo camera on the object; and

a control unit which controls posture or position of the stereo camera supported on the object by the joining member,

the control unit being constituted to be capable of controlling the posture or position of the stereo camera in such a manner that a contour portion present in the highest level position in a contour of a noted subject in video obtained by the stereo camera is positioned in a frame upper end of the video or its vicinity irrespective of a change of the relative posture or position between the object and the noted subject in an imaging view field.

14. A stereo camera supporting method which supports a stereo camera constituted in such a manner as to obtain a plurality of images having parallax errors by a plurality of visual points detached from one another, the method comprising:

joining a support member disposed on a vehicle side on which the stereo camera is provided, to a member to be supported disposed in a predetermined portion of the stereo camera in such a manner that a relation between both the members is variable in a predetermined range; and

controlling posture or position of the stereo camera supported on the vehicle by the joining in such a manner that a contour portion present in the highest level position in a contour of a noted subject in video obtained by the stereo camera is positioned in a frame upper end of the video or its vicinity irrespective of a change of the posture or position of the vehicle.

15. A stereo camera supporting method which supports a stereo camera constituted in such a manner as to obtain a plurality of images having parallax errors by a plurality of visual points detached from one another, the method comprising:

joining a support member disposed on an object side on which the stereo camera is provided, to a member to be supported disposed in a predetermined portion of the stereo camera in such a manner that a relation between both the members is variable in a predetermined range; and

controlling posture or position of the stereo camera supported on the object by the joining in such a manner that a contour portion present in the highest level position in a contour of a noted subject in video obtained by the stereo camera is positioned in a frame upper end of the video or its vicinity irrespective of a change of the relative posture or position between the object and the noted subject in an imaging view field.

17. A stereo camera system comprising a stereo camera constituted in such a manner as to obtain a plurality of images having parallax errors by a plurality of visual points detached from one another, the system comprising:

a joining member constituted by joining a support member disposed on a vehicle side on which the stereo camera is provided, to a member to be supported disposed in a predetermined portion of the stereo camera in such a manner that a relative position between both the members is variable in a predetermined range to thereby support the stereo camera on the vehicle; and

a control unit which controls posture or position of the stereo camera supported on the vehicle by the joining member,

the control unit controlling the posture or position of the stereo camera with respect to an image obtained by photographing an object lying in a view field of the stereo camera, from a view point set in or near an imaging optical system of the stereo camera, so that a contour portion of an object, which lies at the highest position in the image, is located at or near the upper frame edge of the image, regardless of a change in the posture or position of the vehicle.

18. The stereo camera system according to claim 17, further comprising:

an information processing unit which calculates a distance of the noted subject based on video information obtained by the photographing by the stereo camera.

19. The stereo camera system according to claim 18, wherein the information processing unit produces data to reflect the video indicating a situation of a road in a display unit applied to the vehicle based on video information obtained by the photographing by the stereo camera.

20. The stereo camera system according to claim 18, wherein the information processing unit produces data to superimpose, display, and reflect an index indicating a point group on a road present at an equal distance from the vehicle in the video indicating a situation of a road in a display stage applied to the vehicle based on the video information obtained by the photographing by the stereo camera.

21. The stereo camera system according to claim 18, wherein the information processing unit produces date to allow a warning unit applied to the vehicle to issue a warning based on the video information obtained by the photographing by the stereo camera.

22. The stereo camera system according to claim 17, wherein the control unit controls, at a starting time, the stereo camera into such a posture that a center line of a view field at a photographing time in view of an imaging view field of the stereo camera from a visual point set in the optical imaging system or its vicinity is substantially in a horizontal direction.

23. The stereo camera system according to claim 17, wherein the control unit controls, at a starting time, the stereo camera into such a posture that a center line of a view field at a photographing time in view of an imaging view field of the stereo camera from a visual point set in the optical imaging system or its vicinity substantially maintains a last state set in the previous control.

24. The stereo camera system according to claim 17, wherein the control unit controls, at a starting time, the stereo camera into such a posture that a center line of a view field at a photographing time in view of an imaging view field of the stereo camera from a visual point set in the optical imaging system or its vicinity is substantially below a horizontal direction.

25. The stereo camera system according to claim 17, wherein the control unit controls, at a high-speed driving time of the vehicle, the stereo camera into such a posture that a center line of a view field at a photographing time in view of an imaging view field of the stereo camera from a visual point set in the optical imaging system or its vicinity is relatively downward, and to control, at a low-speed driving time, the stereo camera into such a posture that the center line is relatively upward.

26. The stereo camera system according to claim 17, wherein the control unit controls the posture of the stereo camera to be upward, when it is recognized that the highest level portion of the contour of the noted subject meets a high subject departing further upward from the upper end of the frame of the video.