Unmanned aerial vehicle, control systems for unmanned aerial vehicle and control method thereof
First Claim
1. An Unmanned Aerial Vehicle (UAV) control method adapted to a UAV with a camera for shooting a target comprising:
- obtaining a first image at a first timing;
obtaining a second image by the camera at a second timing after the first timing;
calculating a plurality of feature points respectively according to the first image and the second image by a computing device;
extracting a first feature point set and a second feature point set by the computing device, wherein the first feature point set comprises at least three feature points from the plurality of the feature points of the first image, and the second feature point set comprises at least three feature points from the plurality of the feature points of the second image;
calculating a first-axial displacement and a second-axial displacement according to the first feature point set and the second feature point set by the computing device;
calculating a first region of interest (ROI) area and a second ROI area respectively according to the first feature point set and the second feature point set by the computing device and calculating a third-axial displacement according to the first ROI area and the second ROI area; and
adjusting a camera pose or a flight path of the UAV according to the first-axial displacement, the second-axial displacement and the third-axial displacement by a control device.
1 Assignment
0 Petitions
Accused Products
Abstract
A UAV (Unmanned Aerial Vehicle) control method comprises: obtaining a first image; obtaining a second image after obtaining the first image; calculating a plurality of feature points respectively according to the first image and the second image by a computing device, extracting a first feature point set and a second feature point set by the computing device; calculating a first-axial displacement and a second-axial displacement according to the first feature point set and the second feature point set by the computing device; calculating a first ROI (Region Of Interest) area, a second ROI and a third-axial displacement according to the first feature point set and the second feature point set by the computing device; adjusting a camera pose or a flight path of the UAV according to the first-axial displacement, the second-axial displacement and the third-axial displacement.
49 Citations
10 Claims
-
1. An Unmanned Aerial Vehicle (UAV) control method adapted to a UAV with a camera for shooting a target comprising:
-
obtaining a first image at a first timing; obtaining a second image by the camera at a second timing after the first timing; calculating a plurality of feature points respectively according to the first image and the second image by a computing device; extracting a first feature point set and a second feature point set by the computing device, wherein the first feature point set comprises at least three feature points from the plurality of the feature points of the first image, and the second feature point set comprises at least three feature points from the plurality of the feature points of the second image; calculating a first-axial displacement and a second-axial displacement according to the first feature point set and the second feature point set by the computing device; calculating a first region of interest (ROI) area and a second ROI area respectively according to the first feature point set and the second feature point set by the computing device and calculating a third-axial displacement according to the first ROI area and the second ROI area; and adjusting a camera pose or a flight path of the UAV according to the first-axial displacement, the second-axial displacement and the third-axial displacement by a control device. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. An Unmanned Aerial Vehicle (UAV) control system comprising:
-
a camera configured to shoot a first image and a second image during a flight of a UAV, wherein the first image is shot at a first timing, the second image is shot at a second timing, and the first timing is earlier than the second timing; a computing device electrically connected to the camera, wherein the computing device is configured to calculate a displacement vector of the UAV during the first timing and the second timing based on the first image and the second image; and a control device electrically connected to the computing device, wherein the computing device is configured to selectively adjust a gimbal for adjusting a camera pose or a flight path of the UAV according to the displacement vector, wherein the displacement vector comprises a first-axial displacement, a second-axial displacement, and a third-axial displacement, and the computing device further comprises; a displacement computing device configured to calculate a plurality of feature points respectively according to the first image and the second image, to extract a first feature point set and a second feature point set, wherein the first feature point set comprises at least three feature points from the plurality of feature points of the first image and the second feature point set comprises at least three feature points from the plurality of feature points of the second image, and to calculate the first-axial displacement and the second-axial displacement according to the first feature point set and the second feature point set; and a depth computing device coupled to the displacement computing device, wherein the depth computing device is configured to calculate a first region of interest £
ROI) area and a second ROI area according to the first feature point set and the second feature point set and to calculate a third-axial displacement according to the first ROI area and the second ROI area. - View Dependent Claims (8, 9)
-
-
10. An Unmanned Aerial Vehicle (UAV) comprising:
-
a flight system comprising a propeller configured to provide an upward buoyancy for the UAV by rotation;
a motor coupled to the propeller with a spindle for providing a rotation power; and
a motor drive electrically connected to the motor and configured to drive the motor according to a flight control instruction;a control system comprising;
a camera configured to shoot a first image and a second image during a flight of the UAV, wherein the first image is shot at a first timing, the second image is shot at a second timing, and the first timing is earlier than the second timing;
a computing device electrically connected to the camera, wherein the computing device is configured to calculate a displacement vector of the UAV during the first timing and the second timing based on the first image and the second image; and
a control device electrically connected to the computing device, wherein the control device is configured to selectively send a gimbal adjustment instruction for adjusting a camera pose or to send the flight control instruction for adjusting a flight path of the UAV according to the displacement vector;a gimbal electrically connected to the camera and the control device, wherein the gimbal comprises a servomotor and the gimbal is configured to receive the gimbal adjustment instruction to drive the servomotor for adjusting the camera pose; and a frame configured to carry the flight system, the control system and the gimbal; wherein the displacement vector comprises a first-axial displacement, a second-axial displacement, and a third-axial displacement, and the computing device further comprises; a displacement computing device configured to calculate a plurality of feature points respectively according to the first image and the second image, to extract a first feature point set and a second feature point set, wherein the first feature point set comprises at least three feature points from the plurality of feature points of the first image and the second feature point set comprises at least three feature points from the plurality of feature points of the second image, and to calculate the first-axial displacement and the second-axial displacement according to the first feature point set and the second feature point set; and a depth computing device coupled to the displacement computing device, wherein the depth computing device is configured to calculate a first region of interest (ROI) area and a second ROI area according to the first feature point set and the second feature point set and to calculate a third-axial displacement according to the first ROI area and the second ROI area.
-
Specification