DRONE CONTROLLING DEVICE AND METHOD

• US 20160364004A1
• Filed: 06/11/2015
• Published: 12/15/2016
• Est. Priority Date: 06/11/2015
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Ekandem, Joshua, Anderson, Glen J., Durham, Lenitra M., Beckwith, Richard T., Raffa, Giuseppe, Sherman, Jamie, Yuen, Kathy
• Granted Patent: US 10,310,617 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: B64C 13/04 actuated personally
• CPC Class Codes: B64C 13/24 Transmitting means
• CPC Class Codes: B64U 10/00 Type of UAV
• CPC Class Codes: B64U 2201/20 Remote controls
• CPC Class Codes: G05D 1/0016 characterised by the operator's input device input arrangements for computing systems in general G06F3/00
• CPC Class Codes: G05D 1/0033 by having the operator tracking the vehicle either by direct line of sight or via one or more cameras located remotely from the vehicle
• CPC Class Codes: G05D 1/101 specially adapted for aircraft
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06V 20/13 Satellite images
• CPC Class Codes: G06V 20/17 taken from planes or by drones
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113
• CPC Class Codes: G08C 17/02 using a radio link

Abstract

In embodiments, apparatuses, methods and storage media (transitory and non-transitory) are described that receive sensor data from one or more sensor devices that depict a user gesture in three dimensional space, determine a flight path based at least in part on the sensor data, and store the flight path in memory for use to control operation of a drone. Other embodiments may be described and/or claimed.

Claims

1. An electronic drone controlling device comprising:

one or more processors;

a memory coupled with the one or more processors;

a translation module operated by the one or more processors to;

receive sensor data from one or more sensor devices that depict a user gesture in three dimensional space;

determine a flight path based at least in part on the sensor data; and

store the flight path in the memory for use to control operation of a drone.

2. The electronic drone controlling device of claim 1, wherein the one or more sensor devices include at least one of a position sensor, an accelerometer, a gyroscope, a magnetometer, an ultrasonic sensor, an inertial sensor, or an optical sensor.

3. The electronic drone controlling device of claim 1, wherein the drone includes the one or more sensor devices, and the user gesture is made using the drone.

4. The electronic drone controlling device of claim 3, further comprising a navigation module operated by the one or more processors to direct the drone to fly based at least in part on the flight path.

5. The electronic drone controlling device of claim 4, wherein the navigation module is further to:

receive a flight modification command from a mobile communications device;

alter the flight path based at least in part on the flight modification command; and

direct the drone to fly based at least in part on the altered flight path.

6. The electronic drone controlling device of claim 5, wherein the flight modification command includes at least one of a scale command or a repetition command.

7. The electronic drone controlling device of claim 6, wherein the flight modification command is a voice command.

8. The electronic drone controlling device of claim 4, wherein the navigation module is further to:

receive active mode sensor data from a mobile communications device; and

direct the drone to fly based at least in part on the active mode sensor data.

9. The electronic drone controlling device of claim 8, wherein the active mode sensor data is based at least in part on an acceleration of the mobile communications device, and wherein the navigation module is further to:

alter the flight path in a manner proportional to the acceleration; and

direct the drone to fly based at least in part on the altered flight path.

10. The electronic drone controlling device of claim 4, wherein the navigation module is further to:

receive a stop flight command from a mobile communications device; and

direct the drone to fly to within a predefined distance from the mobile communications device.

11. The electronic drone controlling device of claim 4, wherein the navigation module is further to:

receive sensor data from an object;

determine a movement path of the object based at least in part on the sensor data;

alter the flight path based at least in part on the movement path to generate a mimic object flight path; and

direct the drone to fly based at least in part on the mimic object flight path.

12. The electronic drone controlling device of claim 4, wherein the navigation module is further to:

receive object tracking sensor data from one or more object tracking sensors;

determine a movement path of an object based at least in part on the object tracking sensors;

alter the flight path based at least in part on the movement path to generate a mimic object flight path; and

direct the drone to fly based at least in part on the mimic object flight path.

13. A computer implemented drone controlling method comprising:

receiving sensor data, at a computing device, from one or more sensor devices that depict a user gesture in three dimensional space;

determining, by the computing device, a flight path based at least in part on the sensor data; and

storing, by the computing device, the flight path for use to control operation of a drone.

14. The method of claim 13, wherein the drone includes the one or more sensor devices and the user gesture is made using the drone.

15. The method of claim 13, wherein a mobile communications device includes the one or more sensor devices and the user gesture is made using the mobile communications device.

16. The method of claim 13, further comprising:

receiving, by the computing device, a flight modification command; and

directing the drone to fly based at least in part on the flight modification command.

17. The method of claim 13, further comprising:

receiving, by the computing device, an active mode command; and

directing the drone to fly based at least in part on active mode sensor data from a mobile communications device.

18. At least one computer-readable medium comprising instructions stored thereon that, in response to execution of the instructions by one or more processors of a computing device, cause the computing device to:

receive sensor data from one or more sensor devices that depict a user gesture in three dimensional space;

determine a flight path based at least in part on the sensor data; and

store the flight path in a memory for use to control operation of a drone.

19. The at least one computer-readable medium of claim 18, wherein the one or more sensor devices include at least one of a position sensor, an accelerometer, a gyroscope, a magnetometer, an ultrasonic sensor, an inertial sensor, or an optical sensor.

20. The at least one computer-readable medium of claim 18, wherein:

the computing device is further caused to transmit the flight path to a drone;

a mobile communications device includes the one or more sensor devices; and

the user gesture is made using the mobile communications device.

21. The at least one computer-readable medium of claim 20, wherein the user gesture is a first user gesture and the computing device is further caused to:

receive a mode command indicating whether the computing device is in an active mode;

receive active sensor data from the one or more sensor devices that depict a second user gesture in three dimensional space; and

transmit a signal to the drone while the drone is flying based at least in part on the active sensor data in response to the mode command indicates the computing device is in an active mode.

22. The at least one computer-readable medium of claim 20, wherein the computing device is further caused to:

receive a flight modification command; and

transmit a flight modification signal to the drone while the drone is flying based at least in part on the modification command, wherein the modification command includes at least one of a scale command or a repetition command.

23. The at least one computer-readable medium of claim 22, wherein the modification command is a voice command.

24. The at least one computer-readable medium of claim 20, wherein the computing device is further caused to:

receive a stop flight command; and

transmit a signal to the drone while the drone is flying based at least in part on the stop flight command, wherein the signal includes data directing the drone to return to a starting point.

25. The at least one computer-readable medium of claim 20, wherein the computing device is further caused to receive a drone selection command, wherein the computing device is caused to transmit the flight path to a drone based at least in part on the drone selection command.