DRONE CONTROL THROUGH IMAGERY

• US 20170102699A1
• Filed: 12/22/2014
• Published: 04/13/2017
• Est. Priority Date: 12/22/2014
• Status: Abandoned Application

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Anderson, Glen J.
• Application Number:
  US14/579,253
• Publication Number:
  US 20170102699A1
• Time in Patent Office: Days
• CPC Class Codes: B64C 39/024 of the remote controlled vehicle type, i.e. RPV
• CPC Class Codes: B64U 10/13 Flying platforms
• CPC Class Codes: B64U 2101/30 for imaging, photography or videography
• CPC Class Codes: B64U 2201/20 Remote controls
• CPC Class Codes: G05D 1/0016 characterised by the operator's input device input arrangements for computing systems in general G06F3/00
• CPC Class Codes: G05D 1/0038 by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation images analyzed by a computer and used for automatic navigation G05D1/0246
• CPC Class Codes: G06V 20/13 Satellite images
• CPC Class Codes: G06V 20/17 taken from planes or by drones

Abstract

A system may include a communication subsystem to receive image data from a drone; an object detection and recognition module to generate a model representation of the image data, the model representation identifying at least one actionable object in the image data; a display device to present the image data; and a control module to: detect a control input associated with an object of the at least one actionable object; and transmit a control instruction to the drone based on the control input.

Claims

1. A system for transmission of instructions to a drone, the system comprising:

a communication subsystem to receive image data from the drone;

an object detection and recognition module to generate a model representation of the image data, the model representation identifying at least one actionable object in the image data;

a display device to present the image data; and

a control module to;

detect a control input associated with an object of the at least one actionable object; and

transmit a control instruction to the drone based on the control input.

2. The system of claim 1, wherein to generate the model representation of the image data, the object detection and recognition module is to:

transmit the image data from to an object detection server; and

receive the model representation from the object detection server, the model representation including at least one location in the image data of the at least one actionable object.

3. The system of claim 1, further comprising:

a command database; and

wherein the control module is to query the command database with the control input to receive a control instruction.

4. The system of claim 3, wherein the query includes a type of the drone.

5. The system of claim 1, wherein the object in the image data is highlighted on the display device.

6. The system of claim 1, wherein the control module is to receive a selection input on the object and the display device is to highlight the object in the image data.

7. The system of claim 1, wherein the communication subsystem is to receive an acknowledgment from the drone that the control instruction was executed.

8. The system of claim 7, wherein the communication subsystem is to receive updated image data from the drone;

and the object detection and recognition module is to update the model representation of the image data based on the updated image data.

9. A method for transmitting instructions to an drone, the method comprising:

receiving, at a remote control, image data from the drone;

generating a model representation of the image data, the model representation identifying at least one actionable object in the image data;

presenting the image data on a display device of the remote control;

detecting a control input associated with an object of the at least one actionable object; and

transmitting a control instruction to the drone based on the control input.

10. The method of claim 9, wherein generating the model representation of the image data comprises:

transmitting the image data from the remote control to an object detection server; and

receiving the model representation from the object detection server, the model representation including at least one location in the image data of the at least one actionable object.

11. The method of claim 9, further comprising:

querying a command database with the control input; and

receiving the control instruction in response to the query.

12. The method of claim 11, wherein querying the command database includes querying the command database with a type of the drone.

13. The method of claim 9, further comprising:

highlighting the object in the image data presented on the display device.

14. The method of claim 9, further comprising:

receiving a selection input on the object; and

highlighting the object in the image data on the display device.

15. The method of claim 9, further comprising:

receiving an acknowledgment from the drone that the control instruction was executed.

16. The method of claim 15, further comprising:

receiving updated image data from the drone; and

updating the model representation of the image data based on the updated image data.

17. At least one machine-readable medium including instructions, which when executed by a machine, cause the machine to perform operations comprising:

receiving, at a remote control, image data from an drone;

generating a model representation of the image data, the model representation identifying at least one actionable object in the image data;

presenting the image data on a display device of the remote control;

detecting a control input associated with an object of the at least one actionable object; and

transmitting a control instruction to the drone based on the control input.

18. The at least one machine-readable medium of claim 17, wherein the operation of generating the model representation of the image data comprises:

transmitting the image data from the remote control to an object detection server; and

receiving the model representation from the object detection server, the model representation including at least one location in the image data of the at least one actionable object.

19. The at least one machine-readable medium of claim 17, wherein the operations further comprise:

querying a command database with the control input; and

receiving the control instruction in response to the query.

20. The at least one machine-readable medium of claim 17, wherein querying a command database with the control input includes querying the command database with a type of the drone.

21. The at least one machine-readable medium of claim 17, wherein the operations further comprise:

receiving a selection input on the object; and

highlighting the object in the image data on the display device.

22. The at least one machine-readable medium of claim 17, wherein the operations further comprise:

highlighting the object in the image data presented on the display device.

23. The at least one machine-readable medium of claim 17, wherein the operations further comprise:

receiving an acknowledgment from the drone that the control instruction was executed.

24. The at least one machine-readable medium of claim 23, wherein the operations further comprise:

receiving updated image data from the drone; and

updating the model representation of the image data based on the updated image data.

25. The at least one machine-readable medium of claim 17, wherein the control input is a touch gesture on the display device.