AUTONOMOUS CLEANING ROBOT

• US 20170090456A1
• Filed: 09/25/2015
• Published: 03/30/2017
• Est. Priority Date: 09/25/2015
• Status: Abandoned Application

• Current Assignee: Multimedia Image Solution Limited
• Original Assignee: Multimedia Image Solution Limited
• Inventors: Mao, Kaixuan, Deng, Hui, Tien-Spalding, Caroline
• Application Number:
  US14/866,831
• Publication Number:
  US 20170090456A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G05B 19/404 characterised by control arrangements for compensation, e.g. for backlash, overshoot, tool offset, tool wear, temperature, machine construction errors, load, inertia G05B19/19, G05B19/41 take precedence
• CPC Class Codes: G05B 2219/45098 Vacuum cleaning robot
• CPC Class Codes: G05D 1/0246 using a video camera in combination with image processing means
• CPC Class Codes: Y10S 901/01 Mobile robot
• CPC Class Codes: Y10S 901/46 Sensing device

Abstract

An autonomous cleaning robot performs a cleaning function and determines if an obstacle is in its path while performing the cleaning function. When an obstacle is in its path, the autonomous cleaning robot determines if a height of the obstacle is under a clearance height of the autonomous cleaning robot. When the height of the obstacle is under the clearance height of the autonomous cleaning robot, the autonomous cleaning robot determines if the obstacle is to be avoided. When the obstacle is to be avoided, the autonomous cleaning robot changes its path to avoid traversing over the obstacle.

Claims

1. A method executed by an autonomous cleaning robot, comprising:

performing a cleaning function along a path;

determining if an obstacle is in the path of the autonomous cleaning robot;

when the obstacle is in the path of the autonomous cleaning robot, determining if a height of the obstacle is under a clearance height of the autonomous cleaning robot;

when the height of the obstacle is under the clearance height of the autonomous cleaning robot, determining if the obstacle is to be avoided; and

when the obstacle is to be avoided, changing the path of the autonomous cleaning robot to avoid traversing over the obstacle.

2. The method of claim 1, wherein determining if the obstacle is to be avoided comprises:

receiving an image from a camera of the autonomous cleaning robot;

determining a visual or thermal signature of the obstacle from the image; and

searching through visual or thermal signatures of obstacles to be avoided to find a matching visual or thermal signature to the visual or thermal signature of the obstacle from the image.

3. The method of claim 2, wherein determining if the obstacle is in a path of the autonomous cleaning robot and determining if the obstacle is under the clearance height of the autonomous cleaning robot comprise using video analysis, a laser sensor, or an ultrasonic sensor.

4. The method of claim 1, wherein determining if the obstacle is to be avoided comprises:

receiving an odor signature from an odor sensor of the autonomous cleaning robot; and

searching through odor signatures of obstacles to be avoided to find a matching odor signature to the odor signature.

5. The method of claim 4, wherein determining if the obstacle is in a path of the autonomous cleaning robot and determining if the obstacle is under the clearance height of the autonomous cleaning robot comprise using video analysis, a laser sensor, or an ultrasonic sensor.

6. The method of claim 1, wherein determining if the obstacle is to be avoided comprises:

receiving an image or an odor signature from the camera or the odor sensor of the autonomous cleaning robot; and

transmitting the image or the odor signature to a local or a remote computer, wherein in real-time the local or remote computer determines if the obstacle is to be avoided and transmits a result to the autonomous cleaning robot.

7. The method of claim 6, wherein determining if the obstacle is in the path of the autonomous cleaning robot and determining if the height of the obstacle is under the clearance height of the autonomous cleaning robot comprise:

receiving a video from the camera of the autonomous cleaning robot; and

transmitting the video to the local or remote computer, wherein in real-time the local or remote computer analyzes the video to determine if the obstacle is in the path of the autonomous cleaning robot and if the obstacle is under the clearance height of the autonomous cleaning robot.

8. The method of claim 1, further comprising:

based on a first video captured by a camera of the autonomous cleaning robot in a first pass through a room;

mapping the room;

detecting objects in the room; and

recording the locations of the objects in the room;

based on a second video captured by the camera of the autonomous cleaning robot in a second pass through the room, detecting if any object has been moved or is missing; and

when an object has been moved or is missing, transmitting a message reporting the object has moved or is missing to a computer or a user device.

9. The method of claim 1, further comprising:

transmitting a first video captured by a camera of the autonomous cleaning robot in a first pass through a room to a local or remote computer, wherein in real-time the local or remote computer maps the room, detects objects in the room, and records the locations of the objects in the room based on the first video; and

transmitting a second video captured by the camera of the autonomous cleaning robot in a second pass through the room to the local or remote computer, wherein in real-time the local or remote computer detects if any object has been moved or is missing based on the second video and, when an object has moved or is missing, transmits a message reporting the object has moved or is missing to a user device.

10. The method of claim 1, further comprising:

determining a visual or thermal signature of an object in a video captured by a camera of the autonomous cleaning robot;

searching through visual or thermal signatures of pests to find a matching visual or thermal signature to the visual or thermal signature of the object;

when the matching visual or thermal signature is found, transmitting a message reporting a pest to a computer or a user device.

11. The method of claim 1, further comprising:

receiving a video from a camera of the autonomous cleaning robot; and

transmitting the video to a local or remote computer, wherein in real-time the local or remote computer determines a visual or thermal signature of an object in the video, searches through visual or thermal signatures of pests to find a matching visual or thermal signature to the visual or thermal signature of the object, and, when the matching visual or thermal signature is found, transmitting a message reporting a pest to a user device.

12. The method of claim 1, further comprising:

receiving an image of a missing object;

determining a visual or thermal signature of the missing object in the image;

receiving a video captured by a camera of the autonomous cleaning robot;

generating visual or thermal signatures of objects in the video;

searching through the visual or thermal signatures of the objects in the video to find a matching visual or thermal signature to the visual or thermal signature of the missing object; and

when the matching visual or thermal signature is found, transmitting a message reporting the missing object to a computer or a user device.

13. The method of claim 1, further comprising transmitting a video captured by a camera of the autonomous cleaning robot to a local or remote computer, wherein the local or remote computer generates visual or thermal signatures of objects in the video, searches through the visual or thermal signatures of the objects in the video find a matching visual or thermal signature to the visual or thermal signature of the missing object, and, when the matching visual or thermal signature is found, transmitting a message reporting the missing object to a user device.

14. The method of claim 1, further comprising:

when the obstacle is not to be avoided, determining if the obstacle is to be cleaned with a different cleaning method than a current cleaning method; and

when the obstacle is to be cleaned with the different cleaning method, changing from the current cleaning method to the different cleaning method.

15. An autonomous cleaning robot, comprising:

a cleaning unit;

a drive unit;

a camera;

an obstacle sensor;

a memory comprising nonvolatile instructions; and

a processor executing the nonvolatile instructions to;

use the obstacle sensors determine if an obstacle is in a path of the autonomous cleaning robot;

when the obstacle is in the path of the autonomous cleaning robot, use the obstacle sensor to determine if a height of the obstacle is under a clearance height of the autonomous cleaning robot;

when the height of the obstacle is under the clearance height of the autonomous cleaning robot, use the camera to capture an image of the obstacle and analyze the image to determine if the obstacle is to be avoided; and

when the obstacle is to be avoided, change the path of the autonomous cleaning robot to avoid traversing over the obstacle.

16. The autonomous cleaning robot of claim 15, wherein the obstacle sensors comprise laser or ultrasonic sensors.

17. The autonomous cleaning robot of claim 15, further comprising an odor sensor, wherein the processor further executes the instructions to use the odor sensor to capture an odor signature and analyze the odor signature to determine if the obstacle is to be avoided.

18. The autonomous cleaning robot of claim 15, wherein the processor further executes the nonvolatile instructions to:

based on a first video captured by the camera in a first pass through a room;

mapping the room;

detecting objects in the room; and

recording the locations of the objects in the room;

based on a second video captured by the camera in a second pass through the room, detecting if any object has been moved or is missing; and

when an object has been moved or is missing, transmitting a message reporting the object has moved or is missing to a computer or a user device.

19. The autonomous cleaning robot of claim 18, wherein the processor further executes the nonvolatile instructions to:

determining a visual or thermal signature of a target object;

receiving a video captured by a camera;

generating visual or thermal signatures of objects in the video;

searching through the visual or thermal signatures of the objects in the video to find a matching visual or thermal signature to the visual or thermal signature of the target object; and

when the matching visual or thermal signature is found, transmitting a message reporting the target object to a computer or a user device.

20. The autonomous cleaning robot of claim 19, wherein the processor further executes the nonvolatile instructions to:

when the obstacle is not to be avoided, determining if the obstacle is to be cleaned with a different cleaning method than a current cleaning method; and

when the obstacle is to be cleaned with the different cleaning method, changing from the current cleaning method to the different cleaning method.