Methods and systems for obstacle detection using structured light
First Claim
1. An obstacle detector for a mobile robot, the detector comprising:
- at least one light source configured to project light in a path of the robot wherein light projected in the path of the robot has structure, andwherein the light source is pulsed in a determined sequence;
a visual sensor for capturing a plurality of images comprising reflections of the projected light, wherein at least a portion of the plurality of images are captured by the visual sensor while the robot is in motion;
a processing unit for detecting reflections, wherein the processing unit is configured to;
generate at least two difference images from a first plurality of image pairs, a given image pair in the first plurality of images pairs comprising a first image captured with the at least one light source on and a second image captured with the at least one light source off; and
mathematically generate at least one filtered image to suppress movement artifacts, based at least in part on at least two difference images generated from respective pairs of images captured by the visual sensor;
compare pixels of the at least one filtered image to a threshold value to detect reflections from the light source;
a tilt sensor, included in the robot, configured to sense a tilt of the robot caused by a floor surface over which wheels of the robot are traversing;
wherein the tilt sensor included in the robot is configured to determine an orientation of the robot with respect to at least the floor surface the wheels of robot are traversing; and
an obstacle detection unit configured to detect an object in the filtered image and determine whether the object is an obstacle or is the surface the robot is traversing based on the detected reflections from the at least one filtered image, wherein the obstacle detection unit is configured to apply tilt compensation with respect to one or more images, comprising one or more images of reflected light, based at least in part on information from the tilt sensor to facilitate determination as to whether the object is an obstacle or is the surface the robot is traversing.
8 Assignments
0 Petitions
Accused Products
Abstract
An obstacle detector for a mobile robot while the robot is in motion is disclosed. The detector preferably includes at least one light source configured to project pulsed light in the path of the robot; a visual sensor for capturing a plurality of images of light reflected from the path of the robot; a processing unit configured to extract the reflections from the images; and an obstacle detection unit configured to detect an obstacle in the path of the robot based on the extracted reflections. In the preferred embodiment, the reflections of the projected light are extracted by subtracting pairs of images in which each pair includes a first image captured with the at least one light source on and a second image captured with the at least one light source off, and then combining images of two or more extracted reflections to suppress the background.
-
Citations
24 Claims
-
1. An obstacle detector for a mobile robot, the detector comprising:
-
at least one light source configured to project light in a path of the robot wherein light projected in the path of the robot has structure, and wherein the light source is pulsed in a determined sequence; a visual sensor for capturing a plurality of images comprising reflections of the projected light, wherein at least a portion of the plurality of images are captured by the visual sensor while the robot is in motion; a processing unit for detecting reflections, wherein the processing unit is configured to; generate at least two difference images from a first plurality of image pairs, a given image pair in the first plurality of images pairs comprising a first image captured with the at least one light source on and a second image captured with the at least one light source off; and mathematically generate at least one filtered image to suppress movement artifacts, based at least in part on at least two difference images generated from respective pairs of images captured by the visual sensor; compare pixels of the at least one filtered image to a threshold value to detect reflections from the light source; a tilt sensor, included in the robot, configured to sense a tilt of the robot caused by a floor surface over which wheels of the robot are traversing; wherein the tilt sensor included in the robot is configured to determine an orientation of the robot with respect to at least the floor surface the wheels of robot are traversing; and an obstacle detection unit configured to detect an object in the filtered image and determine whether the object is an obstacle or is the surface the robot is traversing based on the detected reflections from the at least one filtered image, wherein the obstacle detection unit is configured to apply tilt compensation with respect to one or more images, comprising one or more images of reflected light, based at least in part on information from the tilt sensor to facilitate determination as to whether the object is an obstacle or is the surface the robot is traversing. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17)
-
-
18. A method of detecting obstacles in a path of a robot, the method comprising:
-
repeatedly pulsing at least one light source on and off in accordance with a determined sequence; capturing a plurality of images of light reflected from the path of the robot, wherein at least a portion of the plurality of images are captured by a sensor while the robot is in motion; generating, by at least one processing unit, two or more difference images by subtracting pairs of the plurality of images, wherein a given pair of images in the plurality of images comprises a first image with the at least one light source on and a second image with the light source off; mathematically generating, by at least one processing unit, at least one filtered image to suppress movement artifacts, based at least in part on at least two difference images generated from respective pairs of images captured by the visual sensor; comparing pixels of the at least one filtered image to a threshold value to detect reflections from the light source; detecting an object based on a location of the detected reflections from the light source in the filtered images; receiving tilt information from a tilt sensor included in the robot, the tilt information indicating an orientation of the robot with respect to at least a surface the robot is traversing, the tilt sensor configured to sense a tilt of the robot caused by a floor surface over which wheels of the robot are traversing; applying tilt compensation with respect to one or more images, comprising one or more images of reflected light, based at least in part on information from the tilt sensor to facilitate determination as to whether the object is an obstacle or is the surface the robot is traversing. - View Dependent Claims (19, 20, 21, 22, 23, 24)
-
Specification