CONTROL OF ROBOTIC VEHICLES BASED ON ATTENTION LEVEL OF OPERATOR

• US 20190310629A1
• Filed: 04/10/2018
• Published: 10/10/2019
• Est. Priority Date: 04/10/2018
• Status: Abandoned Application

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: TAVEIRA, Michael
• Application Number:
  US15/949,307
• Publication Number:
  US 20190310629A1
• Time in Patent Office: Days
• CPC Class Codes: B64U 10/13 Flying platforms
• CPC Class Codes: B64U 2201/00 UAVs characterised by their flight controls
• CPC Class Codes: B64U 2201/20 Remote controls
• CPC Class Codes: G05D 1/0011 associated with a remote control arrangement
• CPC Class Codes: G05D 1/0061 for transition from automatic pilot to manual pilot and vice versa

Abstract

Embodiments include devices and methods for controlling a robotic vehicle. In one example, the method may include determining an attention level of an operator controlling the robotic vehicle, determining that the attention level of the operator is below an acceptable level and automatically controlling the robotic vehicle in response to determining that the attention level of the operator is below an acceptable level.

Claims

1. A method of controlling a robotic vehicle, comprising:

determining, by one or more processors, an attention level of an operator controlling the robotic vehicle;

determining, by one or more processors, that the attention level of the operator is below an acceptable level; and

automatically controlling the robotic vehicle, by one or more processors, in response to determining that the attention level of the operator is below an acceptable level.

2. The method of claim 1, wherein automatically controlling the robotic vehicle comprises controlling the robotic vehicle by one or more processors of the robotic vehicle without receiving further commands from the operator.

3. The method of claim 1, wherein automatically controlling the robotic vehicle comprises requesting control commands from a source other than the operator.

4. The method of claim 1, wherein automatically controlling the robotic vehicle comprises:

determining whether to automatically control the robotic vehicle, in response to determining that the attention level of the operator is below an acceptable level; and

automatically controlling the robotic vehicle in response to determining to automatically control the robotic vehicle.

5. The method of claim 4, wherein determining whether to automatically control the robotic vehicle comprises determining whether one or more conditions are satisfied for overriding operator control of the robotic vehicle.

6. The method of claim 1, further comprising:

determining that the attention level of the operator has risen above the acceptable level; and

returning control of the robotic vehicle to the operator in response to the determination.

7. The method of claim 1, further comprising:

determining a time duration of the attention level of the operator being below the acceptable level; and

modifying automatically controlling the robotic vehicle based on the time duration.

8. The method of claim 7,

wherein automatically controlling the robotic vehicle comprises controlling the robotic vehicle to perform a first action;

and

wherein modifying automatically controlling of the robotic vehicle comprises controlling the robotic vehicle to perform a second action different from the first action.

9. The method of claim 1, further comprising:

detecting a change in the attention level of the operator while the attention level of the operator is below the acceptable level; and

modifying automatically controlling the robotic vehicle based on the change.

10. The method of claim 9,

wherein automatically controlling the robotic vehicle comprises controlling the robotic vehicle to perform a first action;

and

wherein modifying automatically controlling of the robotic vehicle comprises controlling the robotic vehicle to perform a second action different from the first action.

11. The method of claim 1, determining an attention level of an operator controlling the robotic vehicle is based on determining, by one or more processors, that a remote operator is controlling a robotic vehicle.

12. The method of claim 1, wherein determining that the robotic vehicle is being controlled by an operator is based on one or more of the robotic vehicle being in an operator mode of operation or receiving one or more commands from a wireless communication device associated with the operator.

13. The method of claim 1, further comprising monitoring the attention level of the operator.

14. The method of claim 13, wherein the monitoring is in response to determining that the robotic vehicle is being controlled by an operator.

15. The method of claim 13, wherein the monitoring is in response to a trigger.

16. The method of claim 1, wherein an acceptable level comprises a threshold attention level value, and wherein determining that the attention level of the operator is below an acceptable level comprises comparing the determined attention level of the operator to the threshold attention level value.

17. The method of claim 1, wherein the attention level of the operator is determined based on one or more of behavior information of the operator, behavior information of the robotic vehicle, information regarding the environmental conditions of the operator and/or environmental information of the robotic vehicle.

18. The method of claim 17, wherein behavior information regarding the operator comprises information regarding the operator engaging in one or more activities other than controlling the robotic vehicle.

19. The method of claim 17, wherein behavior information regarding the robotic vehicle comprises information regarding the robotic vehicle behaving in an unexpected manner.

20. A robotic vehicle, comprising:

a processor configured with processor-executable instructions to;

determine an attention level of the operator controlling a robotic vehicle;

determine that the attention level of the operator is below an acceptable level; and

automatically control the robotic vehicle in response to determining that the attention level of the operator is below an acceptable level.

21. The robotic vehicle of claim 20, wherein the processor is further configured with processor-executable instructions to:

monitor the attention level of the operator in response to automatically controlling the robotic vehicle.

22. The robotic vehicle of claim 21, wherein the processor is further configured with processor-executable instructions to:

determine that the attention level of the operator has risen above the acceptable level based on the monitoring; and

return control of the robotic vehicle to the operator in response to the determination.

23. The robotic vehicle of claim 20, wherein the processor is further configured with processor-executable instructions to:

determine a time duration of the attention level of the operator being below the acceptable level; and

modify automatically controlling the robotic vehicle based on the time duration.

24. The robotic vehicle of claim 20, wherein the processor is further configured with processor-executable instructions to:

detect a change in the attention level of the operator while the attention level of the operator is below the acceptable level; and

modify automatically controlling the robotic vehicle based on the change.

25. The robotic vehicle of claim 20, wherein an acceptable level comprises a threshold attention level value and wherein determining that the attention level of the operator is below an acceptable level comprises comparing the determined attention level of the operator to the threshold attention level value.

26. The robotic vehicle of claim 20, wherein the attention level of the operator is determined based on one or more of behavior information of the operator, behavior information of the robotic vehicle, information regarding the environmental conditions of the operator and/or environmental information of the robotic vehicle.

27. The robotic vehicle of claim 26, wherein behavior information regarding the operator comprises information regarding the operator engaging in one or more activities other than controlling the robotic vehicle.

28. The robotic vehicle of claim 26, wherein behavior information regarding the robotic vehicle comprises information regarding the robotic vehicle behaving in an unexpected manner.

29. One or more processors configured with processor-executable instructions to:

determine that an operator is controlling a robotic vehicle;

determine an attention level of the operator;

determine that the attention level of the operator is below an acceptable level; and

automatically control the robotic vehicle in response to determining that the attention level of the operator is below an acceptable level.

30. A robotic vehicle, comprising:

means for determining that a remote operator is controlling a robotic vehicle;

determining an attention level of the operator;

determining that the attention level of the operator is below an acceptable level; and

automatically controlling the robotic vehicle in response to determining that the attention level of the operator is below an acceptable level.