System, method, and medium for detecting moving object using structured light, and mobile robot including system thereof

• US 7,983,449 B2
• Filed: 07/02/2007
• Issued: 07/19/2011
• Est. Priority Date: 07/05/2006
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Park, Dong-ryeol, Park, Jun-ho, Bang, Seok-won
• Primary Examiner(s): Bella; Matthew C
• Assistant Examiner(s): NAKHJAVAN, SHERVIN K
• Application Number:
  US11/772,500
• Publication Number:
  US 20080008353A1
• Time in Patent Office: 1,478 Days
• Field of Search: 382/103, 382/107, 348/169, 348/208.14, 901/47
• US Class Current: 382/103
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 7/254 involving subtraction of images
• CPC Class Codes: G06V 10/145 Illumination specially adapted for pattern recognition, e.g. using gratings
• CPC Class Codes: G06V 10/24 Aligning, centring, orientation detection or correction of the image

Abstract

A system, a method, and medium for detecting a moving object using a structured light, and a mobile robot including the system are provided. The system includes an image obtaining unit to obtain a first image at a predetermined position and a second image at a position after a movement of the system by using a light source; an image predicting unit to predict the second image at the position after the movement of the system by using the first image and information with respect to the movement of the system; and a comparing/analyzing unit to compare and analyze the second image obtained by the image obtaining unit and the second image predicted by the image predicting unit.

Claims

1. A system for detecting a moving object, the system comprising:

an image obtaining unit to obtain a first image of an obstacle at a predetermined position and a second image of the obstacle at a position after a movement of the system by using a light source;

an image predicting unit to predict the second image at the position after the movement of the system by using the first image and information pertaining to the movement of the system; and

a comparing/analyzing unit to compare and analyze the second image obtained by the image obtaining unit and the second image predicted by the image predicting unit to detect the moving object using at least one processor,

wherein the image obtaining unit obtains first and second images of the obstacle by receiving the light source, which is generated in a plane and reflected from the obstacle, through a single camera sensor,

wherein the image obtaining unit obtains a distance data between the light source and the obstacle at the positions at which the first image and the second image are obtained, and

wherein the comparing/analyzing unit compares and analyzes a distance data at the position at which the second image is obtained by the image obtaining unit and a distance data of the predicted second image.

2. The system of claim 1, wherein the light source comprises a near-infrared laser beam.

3. The system of claim 1, wherein:

a moving vector T indicating a movement of the system after the first image is obtained, a rotational matrix R from a rotational angle θ

of the system after the first image is obtained, and a distance vector T1 between the single camera sensor and the rotational axis of the system are represented as follows;

4. The system of claim 3, wherein the predetermined algorithm satisfies a following condition when representing a visual angle of the light source as an α

;

5. The system of claim 4, wherein the distance data calculated from the obtained image is a distance data from the light source to the obstacle calculated by applying a triangular method to a coordinate value of the obtained image.

6. The system of claim 3, wherein when a maximum value and a minimum value in a vector X′

of the predicted distance data A′

extracted by the data extracting unit are indicated as x′

_max and x′

_min, respectively, the comparing/analyzing unit compares the distance data between x′

_max and x′

_min in the distance data calculated from the obtained second image with the predicted distance data extracted by the data extracting unit.

8. The system of claim 3, wherein the distance data calculated from the obtained image is a distance data from the light source to the obstacle calculated by applying a triangular method to a coordinate value of the obtained image.

7. The system of 6, wherein the distance data calculated from the obtained image is a distance data from the light source to the obstacle calculated by applying a triangular method to a coordinate value of the obtained image.

9. A method for detecting a moving object, the method comprising:

obtaining a first image of an obstacle at a predetermined position by using a light source;

predicting a second image of the obstacle at a position after the movement of the system by using the first image and information pertaining to the movement of the system;

obtaining the second image at the position after the movement of the system; and

comparing the predicted second image with the obtained second image to detect the moving object using at least one processor,

wherein an image obtaining unit obtains first and second images of the obstacle by receiving the light source, which is generated in a plane and reflected from the obstacle, through a single camera sensor,

wherein said obtaining a first image includes obtaining a distance data between the light source and the obstacle at the position at which the first image is obtained and said obtaining the second image includes obtaining a distance data between the light source and the obstacle at the position at which the second image is obtained, and

wherein said comparing includes comparing a distance data at the position at which the second image is obtained with a distance data of the predicted second image.

10. The method of claim 9, wherein the light source comprises a near-infrared laser beam.

11. The method of claim 9, wherein:

a moving vector T indicating a movement of the system after the first image is obtained, a rotational matrix R from a rotational angle θ

of the system after the first image is obtained, and a distance vector T1 between the single camera sensor and the rotational axis of the system are represented as follows;

12. The method of claim 11, wherein the predetermined algorithm satisfies a following condition when representing a visual angle of the light source as an α

;

14. The method of claim 11, wherein when a maximum value and a minimum value in a vector X′

of the predicted distance data extracted in the extracting the predicted distance data A(are indicated as x(max and x(min, respectively, in the comparing the second image predicted in the predicting a second image with the second image obtained in the obtaining the second image and detecting the moving object, the distance data between x(max and x(min in the distance data calculated from the obtained second image is compared with the predicted distance data extracted in the extracting the predicted distance data A′

.

15. The method of claim 14, wherein the distance data calculated from the obtained image is a distance data from the light source to the obstacle calculated by applying a triangular method to a coordinate value of the obtained image.

16. The method of claim 11, wherein the distance data calculated from the obtained image is a distance data from the light source to the obstacle calculated by applying a triangular method to a coordinate value of the obtained image.

17. At least one non-transitory computer readable medium storing computer readable instructions that control at least one processor to implement the method of claim 9.

13. The method of 12, wherein the distance data calculated from the obtained image is a distance data from the light source to the obstacle calculated by applying a triangular method to a coordinate value of the obtained image.

18. A mobile robot for detecting a moving object, the robot comprising:

a system to detect a moving object; and

a driving system to drive the mobile robot which calculates position and recognizes the moving object,

wherein the system to detect the moving object includes;

an image obtaining unit to obtain a first image of the object at a predetermined position and a second image of the object at a position after a movement of the system by a light source;

an image predicting unit to predict the second image at the position after the movement of the system by using the first image and information pertaining to the movement of the system; and

a comparing/analyzing unit to compare and analyze the second image obtained by the image obtaining unit and the second image predicted by the image predicting unit to detect the moving object,

wherein the image obtaining unit obtains first and second images of the object by receiving the light source, which is generated in a plane and reflected from the object, through a single camera sensor,

wherein the image obtaining unit obtains a distance data between the light source and the object at the positions at which the first image and the second image are obtained, and

wherein the comparing / analyzing unit compares and analyzes a distance data at the position at which the second image is obtained by the image obtaining unit and a distance data of the predicted second image.

19. The mobile robot of claim 18, wherein the light source comprises a near-infrared laser beam.

20. The mobile robot of claim 18, wherein:

a moving vector T indicating a movement of the system after the first image is obtained, a rotational matrix R from a rotational angle θ

of the system after the first image is obtained, and a distance vector T between the single camera sensor and the rotational axis of the system are represented as follows;

21. The mobile robot of claim 20, wherein the predetermined algorithm satisfies a following condition when representing a visual angle of the light source as α

;

22. The mobile robot of claim 21, wherein the distance data calculated from the obtained image is a distance data from the light source to the object calculated by applying a triangular method to a coordinate value of the obtained image.

23. The mobile robot of claim 20, wherein when a maximum value and a minimum value in a vector X′

of the predicted distance data extracted by the data extracting unit are indicated as x′

_max and x′

_min, respectively, the comparing/analyzing unit compares the distance data between x′

_max and x′

_min in the distance data calculated from the obtained second image with the predicted distance data extracted by the data extracting unit.

24. The mobile robot of claim 23, wherein the distance data calculated from the obtained image is a distance data from the light source to the object calculated by applying a triangular method to a coordinate value of the obtained image.

25. The mobile robot of claim 20, wherein the distance data calculated from the obtained image is a distance data from the light source to the object calculated by applying a triangular method to a coordinate value of the obtained image.