Companion robot and method for controlling companion robot

• US 10,603,796 B2
• Filed: 09/26/2017
• Issued: 03/31/2020
• Est. Priority Date: 10/20/2016
• Status: Active Grant

• Current Assignee: Futaihua Industry (Shenzhen) Co., Ltd. (Hon Hai Precision Industry Co., Ltd.), Hon Hai Precision Industry Co., Ltd.
• Original Assignee: Futaihua Industry (Shenzhen) Co., Ltd. (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Zhang, Xue-Qin
• Primary Examiner(s): Amin, Bhavesh V
• Application Number:
  US15/715,259
• Publication Number:
  US 20180111272A1
• Time in Patent Office: 917 Days
• Field of Search: None
• CPC Class Codes: B25J 11/00 Manipulators not otherwise provided for
• CPC Class Codes: B25J 11/009 Nursing, e.g. carrying sick persons, pushing wheelchairs, distributing drugs
• CPC Class Codes: B25J 13/00 Controls for manipulators programme controls B25J9/16; control in general G05
• CPC Class Codes: B62D 57/032 with alternately or sequentially lifted supporting base and legs; with alternately or sequentially lifted feet or skid B62D57/024 takes precedence
• CPC Class Codes: G05D 1/0214 in accordance with safety or protection criteria, e.g. avoiding hazardous areas monitoring the location of vehicles within a certain area, e.g. forbidden or allowed areas, in traffic control systems for road vehicles G08G1/13
• CPC Class Codes: G05D 1/0246 using a video camera in combination with image processing means
• CPC Class Codes: G05D 1/0255 using acoustic signals, e.g. ultra-sonic singals sonar systems designed for anti-collision purposes G01S15/93
• CPC Class Codes: Y10S 901/01 Mobile robot

Abstract

A companion robot includes a body, a sensing unit, a positioning unit, a network unit, an input unit, a storage device, and at least one processor. The processor controls the companion robot to receive a destination, generate a walking path of the companion robot according to the destination and a current location of the companion robot, obtain a walking direction and a walking speed of a user, and control the companion robot to walk along the walking path according to the walking direction and the walking speed.

Claims

1. A companion robot comprising:

an input unit;

a microphone;

an image capturing device;

a positioning unit;

a storage device; and

at least one processor, wherein the storage device stores one or more programs, which when executed by the at least one processor, cause the at least one processor to;

provide two modes of operation, the two modes of operation being selectable, the two modes of operation comprising a first mode and a second mode;

receive a destination through the input unit when the companion robot is in the first mode;

recognize hand gestures captured by the image capturing device, and voice commands captured by the microphone, to set the destination when the companion robot is in the second mode;

generate a walking path of the companion robot according to the destination and a current location of the companion robot, the current location obtained by the positioning unit;

obtain a walking direction and a walking speed of a target; and

control the companion robot to walk along the walking path according to the walking direction and the walking speed of the target.

2. The companion robot of claim 1, further comprising a network unit, wherein the network unit communicates with an electronic device;

the processor obtains the walking direction and the walking speed of the target from the electronic device through the network unit.

3. The companion robot of claim 1, further comprising a scanning device for detecting a road condition;

wherein the processor is further configured to obtain a road condition from the scanning device.

4. The companion robot of claim 1, further comprising a sensing unit, wherein the sensing unit comprises at least one of a microphone, an image capturing device, a range sensor, a speed sensor, and an ultrasonic sensor.

5. The companion robot of claim 4, wherein the microphone is used for receiving voice input from a target;

the image capturing device is used for collecting images or videos;

the range sensor is used for determining a distance between the companion robot and the target;

the speed sensor is used for detecting a speed of the companion robot;

the ultrasonic sensor is used for detecting obstacles along the walking path.

6. The companion robot of claim 5, wherein:

when a walking speed of the target is detected to be faster than a walking speed of the companion robot and a distance between the target and the companion robot is greater than a predetermined distance, the processor controls the companion robot to walk faster; and

when a walking speed of the target is detected to be slower than a walking speed of the companion robot and a distance between the target and the companion robot is less than a predetermined distance, the processor controls the companion robot to walk slower.

7. The companion robot of claim 1, wherein the processor is further configured to establish basic target information of the target;

the companion robot uses the basic target information to recognize the target.

8. The companion robot of claim 1, wherein the processor is further configured to:

determine whether the companion robot is stuck; and

send a message to an electronic device informing that the companion robot is stuck.

9. The companion robot of claim 8, wherein the processor is further configured to:

receive control information from the electronic device; and

control the companion robot according to the control information.

10. The companion robot of claim 9, wherein the control information comprises the walking direction and a walking speed of the companion robot and the processor controls the companion robot to broadcast a message.

11. A method implemented by a companion robot for controlling the companion robot, the companion robot comprising a positioning unit, the method comprising:

providing two modes of operation, the two modes of operation being selectable, the two modes of operation comprising a first mode and a second mode;

receiving a destination through an input unit when the companion robot is in the first mode;

recognizing hand gestures captured by a image capturing device, and voice commands captured by a microphone, to set the destination when the companion robot is in the second mode;

generating a walking path of the companion robot according to the destination and a current location of the companion robot, wherein the current location is obtained by the positioning unit;

obtaining a walking direction and a walking speed of a target; and

controlling the companion robot to walk along the walking path according to the walking direction and the walking speed of the target.

12. The method of claim 11, wherein:

when a walking speed of the target is detected to be faster than a walking speed of the companion robot and a distance between the target and the companion robot is greater than a predetermined distance, the companion robot is controlled to walk faster; and

when a walking speed of the target is detected to be slower than a walking speed of the companion robot and a distance between the target and the companion robot is less than a predetermined distance, the companion robot is controlled to walk slower.

13. The method of claim 11 further comprising establishing basic target information of the target;

the basic target information configured to recognize the target.

14. The method of claim 11 further comprising:

determining whether the companion robot is stuck; and

sending a message to the electronic device informing that the companion robot is stuck.

15. The method of claim 14 further comprising:

receiving control information from the electronic device; and

controlling the companion robot according to the control information.

16. The method of claim 15, wherein the control information comprises the walking direction and walking speed of the companion robot and the processor controls the companion robot to broadcast a message.