Autonomous vehicle and motion control therefor

• US 20040101161A1
• Filed: 05/02/2003
• Published: 05/27/2004
• Est. Priority Date: 11/21/2002
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Son, Young, Kwak, Joo-young, Roh, Kyoung-sig
• Granted Patent: US 7,440,585 B2
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: G05D 1/0246 using a video camera in combination with image processing means
• CPC Class Codes: G05D 1/0251 extracting 3D information from a plurality of images taken from different locations, e.g. stereo vision stereoscopic image analysis H04N13/00; depth recovery from images G06T7/593
• CPC Class Codes: G05D 1/0259 using magnetic or electromagnetic means
• CPC Class Codes: G05D 1/027 comprising intertial navigation means, e.g. azimuth detector inertial navigation G01C21/16; inertial navigation combined with non-inertial navigation instruments G01C21/165
• CPC Class Codes: G06T 7/579 from motion
• CPC Class Codes: G06V 10/147 Details of sensors, e.g. sensor lenses fingerprint or palmprint sensors G06V40/13; vascular sensors G06V40/145; eye sensors G06V40/19
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads

Abstract

There are provided an autonomous vehicle, and an apparatus and method for estimating the motion of the autonomous vehicle and detecting three-dimensional (3D) information of an object appearing in front of the moving autonomous vehicle. The autonomous vehicle measures its orientation using an acceleration sensor and a magnetic flux sensor, and extracts epipolar geometry information using the measured orientation information. Since the corresponding points between images required for extracting the epipolar geometry information can be reduced to two, it is possible to more easily and correctly obtain motion information of the autonomous vehicle and 3D information of an object in front of the autonomous vehicle.

Claims

1. An autonomous vehicle, comprising:

a corresponding point detection unit for detecting corresponding points from at least two consecutive images obtained through a camera;

an orientation measuring unit for computing orientation information of the autonomous vehicle;

an epipolar computation unit for computing epipolar geometry information based on the orientation information and the information on corresponding points;

a motion analysis unit for analyzing motion of the autonomous vehicle based on the computed epipolar geometry information; and

a three-dimensional (3D) information analysis unit for analyzing 3D information of an object existing in front of the autonomous vehicle based on the computed epipolar geometry information.

2. The autonomous vehicle according to claim 1, wherein the camera has the same coordinate axes with the autonomous vehicle.

3. The autonomous vehicle according to claim 1, wherein the images are obtained through a single camera at a predetermined frame rate.

4. The autonomous vehicle according to claim 1, wherein images are obtained simultaneously through a stereo camera or at least two or more cameras.

5. The autonomous vehicle according to claim 1, wherein the orientation measuring unit includes an acceleration sensor for measuring gravity and a magnetic flux sensor for measuring terrestrial magnetism, and wherein the orientation information of the autonomous vehicle is computed with respect to a fixed ground coordinate system using the absolute values of the values obtained through the acceleration sensor and the magnetic flux sensor.

6. The autonomous vehicle according to claim 1, wherein the epipolar computation unit computes the epipolar geometry information based on the orientation information computed by the orientation measuring unit and the information on at least two corresponding points.

7. The autonomous vehicle according to claim 6, wherein the epipolar geometry information is computed in accordance with the following equations if a matrix expressing the orientation of the autonomous vehicle with respect to any two consecutive images can be measured:

8. The autonomous vehicle according to claim 1, wherein the 3D information of the object in front of the autonomous vehicle includes information on a distance between the autonomous vehicle and the object, and information on a 3D shape of the object.

9. An apparatus for estimating the motion of an autonomous vehicle, comprising:

a corresponding point detection unit for detecting corresponding points from at least two consecutive images obtained through a camera;

an orientation measuring unit for computing orientation information of the autonomous vehicle;

an epipolar computation unit for computing epipolar geometry information based on the orientation information and the information on corresponding points; and

a motion analysis unit for analyzing the motion of the autonomous vehicle based on the computed epipolar geometry information.

10. The apparatus for estimating the motion of an autonomous vehicle according to claim 9, wherein the camera has the same coordinate axes with the autonomous vehicle.

11. The apparatus for estimating the motion of an autonomous vehicle according to claim 9, wherein the images are obtained through a single camera at a predetermined frame rate.

12. The apparatus for estimating the motion of an autonomous vehicle according to claim 9, wherein images are obtained simultaneously through a stereo camera or at least two or more cameras.

13. The apparatus for estimating the motion of an autonomous vehicle according to claim 9, wherein the orientation measuring unit includes an acceleration sensor for measuring gravity and a magnetic flux sensor for measuring terrestrial magnetism, and wherein the orientation information of the autonomous vehicle is computed with respect to a fixed ground coordinate system using the absolute values of the values obtained through the acceleration sensor and the magnetic flux sensor.

14. The apparatus for estimating the motion of an autonomous vehicle according to claim 9, wherein the epipolar computation unit computes the epipolar geometry information based on the orientation information computed by the orientation measuring unit and information on at least two corresponding points.

15. The apparatus for estimating the motion of an autonomous vehicle according to claim 14, wherein the epipolar geometry information is computed in accordance with the following equations if a matrix expressing the orientation of the autonomous vehicle with respect to any two consecutive images can be measured:

16. The apparatus for estimating the motion of an autonomous vehicle according to claim 9, wherein the 3D information of the object in front of the autonomous vehicle includes information on a distance between the autonomous vehicle and the object, and information on a 3D shape of the object.

17. An apparatus for detecting three-dimensional (3D) information of an object existing in front of an autonomous vehicle, comprising:

a corresponding point detection unit for detecting corresponding points from at least two consecutive images obtained through a camera;

an orientation measuring unit for computing orientation information of the autonomous vehicle;

an epipolar computation unit for computing epipolar geometry information based on the orientation information and the information on corresponding points; and

a 3D information analysis unit for analyzing 3D information of the object existing in front of the autonomous vehicle based on the computed epipolar geometry information.

18. The apparatus for detecting three-dimensional (3D) information of an object existing in front of an autonomous vehicle according to claim 17, wherein the camera has the same coordinate axes with the autonomous vehicle.

19. The apparatus for detecting three-dimensional (3D) information of an object existing in front of an autonomous vehicle according to claim 17, wherein the images are obtained through a single camera at a predetermined frame rate.

20. The apparatus for detecting three-dimensional (3D) information of an object existing in front of an autonomous vehicle according to claim 17, wherein images are obtained simultaneously through a stereo camera or at least two or more cameras.

21. The apparatus for detecting three-dimensional (3D) information of an object existing in front of an autonomous vehicle according to claim 17, wherein the orientation measuring unit includes an acceleration sensor for measuring gravity and a magnetic flux sensor for measuring terrestrial magnetism, and wherein the orientation information of the autonomous vehicle is computed with respect to a fixed ground coordinate system using the absolute values of the values obtained through the acceleration sensor and the magnetic flux sensor.

22. The apparatus for detecting three-dimensional (3D) information of an object existing in front of an autonomous vehicle according to claim 17, wherein the epipolar computation unit computes the epipolar geometry information based on the orientation information computed by the orientation measuring unit and the information on at least two corresponding points.

23. The apparatus for detecting three-dimensional (3D) information of an object existing in front of an autonomous vehicle according to claim 22, wherein the epipolar geometry information is computed in accordance with the following equations if a matrix expressing the orientation of the autonomous vehicle with respect to any two consecutive images can be measured:

24. The apparatus for detecting three-dimensional (3D) information of an object existing in front of an autonomous vehicle according to claim 17, wherein the 3D information of the object in front of the autonomous vehicle includes information on a distance between the autonomous vehicle and the object, and information on a 3D shape of the object.

25. A method for controlling the motion of an autonomous vehicle, comprising the steps of:

(a) detecting corresponding points from at least two consecutive images obtained through a camera;

(b) computing orientation information of the autonomous vehicle;

(c) computing epipolar geometry information based on the orientation information and the information on corresponding points;

(d) analyzing the motion of the autonomous vehicle based on the computed epipolar geometry information; and

(e) analyzing three-dimensional information of an object existing in front of the autonomous vehicle based on the computed epipolar geometry information.

26. The method for controlling the motion of an autonomous vehicle according to claim 25, wherein the camera has the same coordinate axes with the autonomous vehicle.

27. The method for controlling the motion of an autonomous vehicle according to claim 25, wherein the images are obtained through a single camera at a predetermined frame rate.

28. The method for controlling the motion of an autonomous vehicle according to claim 25, wherein images are obtained simultaneously through a stereo camera or at least two or more cameras.

29. The method for controlling the motion of an autonomous vehicle according to claim 25, wherein step (b) includes:

(b-1) measuring gravity;

(b-2) measuring terrestrial magnetism; and

(b-3) computing the orientation information of the autonomous vehicle with respect to a fixed ground coordinate system using the absolute values of the values obtained in steps (b-1) and (b-2).

30. The method for controlling the motion of an autonomous vehicle according to claim 25, wherein step (c) includes computing the epipolar geometry information based on the orientation information computed in step (b) and the information on at least two corresponding points.

31. The method for controlling the motion of an autonomous vehicle according to claim 30, wherein the epipolar geometry information is computed in accordance with the following equations if a matrix expressing the orientation of the autonomous vehicle with respect to any two consecutive images can be measured:

32. The method for controlling the motion of an autonomous vehicle according to claim 25, wherein the 3D information of the object in front of the autonomous vehicle includes information on a distance between the autonomous vehicle and the object, and information on a 3D shape of the object.

49. A computer readable recording medium that stores a computer program to implement a method according to claim 25.

33. A method for estimating the motion of an autonomous vehicle, comprising the steps of:

(a) detecting corresponding points from at least two consecutive images obtained through a camera;

(b) computing orientation information of the autonomous vehicle;

(c) computing epipolar geometry information based on the orientation information and the information on corresponding points; and

(d) analyzing motion of the autonomous vehicle based on the computed epipolar geometry information.

34. The method for estimating the motion of an autonomous vehicle according to claim 33, wherein the camera has the same coordinate axes with the autonomous vehicle.

35. The method for estimating the motion of an autonomous vehicle according to claim 33, wherein the images are obtained through a single camera at a predetermined frame rate.

36. The method for estimating the motion of an autonomous vehicle according to claim 33, wherein images are obtained simultaneously through a stereo camera or at least two or more cameras.

37. The method for estimating the motion of an autonomous vehicle according to claim 33, wherein step (b) includes:

(b-1) measuring gravity;

(b-2) measuring terrestrial magnetism; and

(b-3) computing the orientation information of the autonomous vehicle with respect to a fixed ground coordinate system using the absolute values of the values obtained in steps (b-1) and (b-2).

38. The method for estimating the motion of an autonomous vehicle according to claim 33, wherein step (c) includes computing the epipolar geometry information based on the orientation information computed in step (b) and the information on at least two corresponding points.

39. The method for estimating the motion of an autonomous vehicle according to claim 38, wherein the epipolar geometry information is computed in accordance with the following equations if a matrix expressing the orientation of the autonomous vehicle with respect to any two consecutive images can be measured:

40. The method for estimating the motion of an autonomous vehicle according to claim 33, wherein the 3D information of the object in front of the autonomous vehicle includes information on a distance between the autonomous vehicle and the object, and information on a 3D shape of the object.

50. A computer readable recording medium that stores a computer program to implement a method according to claim 33.

41. A method for detecting three-dimensional (3D) information of an object existing in front of an autonomous vehicle, comprising the steps of:

(a) detecting corresponding points from at least two consecutive images obtained through a camera;

(b) computing orientation information of the autonomous vehicle;

(c) computing epipolar geometry information based on the orientation information and the information on corresponding points; and

(d) analyzing 3D information of the object existing in front of the autonomous vehicle based on the computed epipolar geometry information.

42. The method for detecting three-dimensional (3D) information of an object existing in front of an autonomous vehicle according to claim 41, wherein the camera has the same coordinate axes with the autonomous vehicle.

43. The method for detecting three-dimensional (3D) information of an object existing in front of an autonomous vehicle according to claim 41, wherein the images are obtained through a single camera at a predetermined frame rate.

44. The method for detecting three-dimensional (3D) information of an object existing in front of an autonomous vehicle according to claim 41, wherein images are obtained simultaneously through a stereo camera or at least two or more cameras.

45. The method for detecting three-dimensional (3D) information of an object existing in front of an autonomous vehicle according to claim 41 wherein step (b) includes:

(b-1) measuring gravity;

(b-2) measuring terrestrial magnetism; and

(b-3) computing the orientation information of the autonomous vehicle with respect to a fixed ground coordinate system using absolute values of the values obtained in steps (b-1) and (b-2).

46. The method for detecting three-dimensional (3D) information of an object existing in front of an autonomous vehicle according to claim 41, wherein step (c) includes computing the epipolar geometry information based on the orientation information computed in step (b) and the information on at least two corresponding points.

47. The method for detecting three-dimensional (3D) information of an object existing in front of an autonomous vehicle according to claim 46, wherein the epipolar geometry information is computed in accordance with the following equations if a matrix expressing the orientation of the autonomous vehicle with respect to any two consecutive images can be measured:

48. The method for detecting three-dimensional (3D) information of an object existing in front of an autonomous vehicle according to claim 41, wherein the 3D information of the object in front of the autonomous vehicle includes information on a distance between the autonomous vehicle and the object, and information on a 3D shape of the object.

51. A computer readable recording medium that stores a computer program to implement a method according to claim 41.