Method and device for controlling and monitoring the surrounding areas of an unmanned aerial vehicle (UAV)

• US 8,744,647 B2
• Filed: 01/25/2013
• Issued: 06/03/2014
• Est. Priority Date: 03/22/2012
• Status: Active Grant

• Current Assignee: Flir Unmanned Aerial Systems AS (Teledyne Technologies Incorporated)
• Original Assignee: Prox Dynamics AS (Teledyne Technologies Incorporated)
• Inventors: Paulsen, Dag Henning, Muren, Petter
• Primary Examiner(s): MARC-COLEMAN, MARTHE Y
• Application Number:
  US13/749,918
• Publication Number:
  US 20140067162A1
• Time in Patent Office: 494 Days
• Field of Search: 701/2, 701/3, 701/23, 701467-469, 244/190, 244/189, 244/75.1, 244/3.15, 382/154, 342/147
• US Class Current: 701/2
• CPC Class Codes: B64C 19/00 Aircraft control not otherwise provided for
• CPC Class Codes: G05D 1/0038 by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation images analyzed by a computer and used for automatic navigation G05D1/0246
• CPC Class Codes: G05D 1/0044 by providing the operator with a computer generated representation of the environment of the vehicle, e.g. virtual reality, maps maps used for automatic navigation G05D1/0274; flight directors G01C23/005

Abstract

A method and a remote control for controlling and monitoring surrounding areas of an Unmanned Aerial Vehicle (UAV) by an operator with a remote control comprising a flight display are provided. The method and remote control provide an advantageously effect for the purposes of controlling and monitoring the surroundings of a UAV by combining the image captured by a UAV camera with a transparently overlaid positional and navigation map providing a perception enabling the operator to have a complete overall view of the situation, utilizing a common screen section of a flight display and thereby not having to shift eye view. Viewing images and positional and navigation information should not interfere with each other.

Claims

1. A method for controlling, and monitoring surrounding areas of, an Unmanned Aerial Vehicle (UAV) by an Operator with a remote control, comprising:

providing a flight display, and a UAV equipped with a camera and a positioning device providing an image of surrounding areas and positioning data of an operating field of the UAV, wirelessly transmitted to a remote control;

displaying the image captured by the camera on the flight display;

providing a transparent layer upon the image comprising a cardinal-oriented map of a range of the operating field including at least a cardinal point, a UAV symbol oriented on the flight display relative to the cardinal point corresponding to a real compass direction of the UAV provided by the positioning device, the cardinal-oriented map including an Operator position symbol;

a waypoint symbol positioned relative to the UAV symbol corresponding in distance and direction to a real geographical relation between the UAV and the waypoint;

displaying one or more rings indicating a scale of the cardinal-oriented map, the one or more rings being centered around the Operator position symbol which coincides with a center of the flight display.

2. The method according to claim 1, wherein the Operator position symbol is positioned relative to the UAV symbol and the waypoint symbol corresponding in distance and direction to a real geographical relation between the Operator and the UAV and the waypoint, respectively.

3. The method according to claim 1, wherein the one or more rings are marked with a radius stating the scale of the cardinal-oriented map.

4. The method according to claim 1, further comprising when the UAV passes a predefined distance from the Operator position, then switching the scale of the cardinal-oriented map, and changing the one or more rings in terms of size and scale indication.

5. The method according to claim 1, further comprising when the UAV passes a predefined distance to the waypoint position, then switching the scale of the cardinal-oriented map and coinciding a center of the one or more rings with the waypoint symbol.

6. The method according to claim 1, wherein the image is a video image or one or more snapshots.

7. A remote control adjusted to control, and monitor surrounding areas of, an Unmanned Aerial Vehicle (UAV) by an Operator, the remote control comprising:

a flight display in communication with the remote control, the remote control being in communication with an UAV that is equipped with a camera and a positioning device providing an image, live or still a series of snapshots, of the surrounding areas and positioning data of the operating field of the UAV, wirelessly transmitted to the remote control, the flight display being;

adjusted to display the image captured by the camera on the flight display;

provide a transparent layer upon the image comprising a cardinal-oriented map of a range of the operating field including at least a cardinal point, a UAV symbol oriented on the flight display relative to the cardinal point corresponding to a real compass direction of the UAV provided by the positioning device, and a waypoint symbol positioned relative to the UAV symbol corresponding in distance and direction to a real geographical relation between the UAV and the waypoint, the cardinal-oriented map including an Operator position symbol; and

display one or more rings indicating a scale of the cardinal-oriented map, the one or more rings being centered around the Operator position symbol which coincides with a center of the flight display.

8. A method for controlling, and monitoring surrounding areas of, an Unmanned Aerial Vehicle (UAV) by an Operator with a remote control, comprising:

providing a flight display, and a UAV equipped with a camera and a positioning device providing an image of surrounding areas and positioning data of an operating field of the UAV, wirelessly transmitted to a remote control;

displaying the image captured by the camera on the flight display;

providing a transparent layer upon the image comprising a cardinal-oriented map of a range of the operating field including at least a cardinal point, a UAV symbol oriented on the flight display relative to the cardinal point corresponding to a real compass direction of the UAV provided by the positioning device;

a waypoint symbol positioned relative to the UAV symbol corresponding in distance and direction to a real geographical relation between the UAV and the waypoint;

displaying one or more rings indicating a scale of the cardinal-oriented map; and

when the UAV passes a predefined distance to the waypoint position, then switching the scale of the cardinal-oriented map and coinciding a center of the one or more rings with the waypoint symbol.