CONTROL METHOD FOR PHOTOGRAPHING USING UNMANNED AERIAL VEHICLE, PHOTOGRAPHING METHOD USING UNMANNED AERIAL VEHICLE, MOBILE TERMINAL, AND UNMANNED AERIAL VEHICLE

• US 20180241936A1
• Filed: 04/20/2018
• Published: 08/23/2018
• Est. Priority Date: 11/04/2015
• Status: Active Grant

• Current Assignee: Tencent Technology Company Limited (Tencent Holdings Limited)
• Original Assignee: Tencent Technology Company Limited (Tencent Holdings Limited)
• Inventors: LI, Jialun, LI, Kaifeng, NING, Jing
• Granted Patent: US 10,623,621 B2
• Time in Patent Office: Days
• CPC Class Codes: B64C 27/08 with two or more rotors
• CPC Class Codes: B64C 39/024 of the remote controlled vehicle type, i.e. RPV
• CPC Class Codes: B64U 2101/30 for imaging, photography or videography
• CPC Class Codes: B64U 2201/20 Remote controls
• CPC Class Codes: G05D 1/0011 associated with a remote control arrangement
• CPC Class Codes: G05D 1/0016 characterised by the operator's input device input arrangements for computing systems in general G06F3/00
• CPC Class Codes: G05D 1/0022 characterised by the communication link data switching networks in general H04L12/00
• CPC Class Codes: G05D 1/0038 by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation images analyzed by a computer and used for automatic navigation G05D1/0246
• CPC Class Codes: G05D 1/0094 involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target
• CPC Class Codes: G05D 1/10 Simultaneous control of position or course in three dimensions G05D1/12 takes precedence
• CPC Class Codes: G05D 1/101 specially adapted for aircraft
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G08C 17/02 using a radio link
• CPC Class Codes: G08C 2201/30 User interface
• CPC Class Codes: G08C 2201/32 Remote control based on movements, attitude of remote control device
• CPC Class Codes: G08C 2201/91 Remote control based on location and proximity
• CPC Class Codes: G08C 2201/93 : Remote control using other portable devices, e.g. mobile phone, PDA, laptop
• CPC Class Codes: H04N 1/00127 : Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
• CPC Class Codes: H04N 1/00251 : with an apparatus for taking photographic images, e.g. a camera
• CPC Class Codes: H04N 1/00307 : with a mobile telephone apparatus constructional features of portable telephone sets H04M1/0202; mobile radio systems H04W84/00
• CPC Class Codes: H04N 1/00411 : the display also being used for user input, e.g. touch screen
• CPC Class Codes: H04N 1/00424 : using a list of graphical elements, e.g. icons or icon bar
• CPC Class Codes: H04N 1/00435 : arranged in a predetermined sequence, e.g. using next and previous buttons
• CPC Class Codes: H04N 1/00482 : outputting a plurality of job set-up options, e.g. number of copies, paper size or resolution
• CPC Class Codes: H04N 2201/0013 : Arrangements for the control of the connected apparatus by the still picture apparatus arrangements for the control of a still picture apparatus by the connected apparatus H04N2201/0074; control of image communication with the connected apparatus H04N2201/0015
• CPC Class Codes: H04N 2201/0055 : By radio
• CPC Class Codes: H04N 2201/0096 : Portable devices
• CPC Class Codes: H04N 23/62 : Control of parameters via user interfaces
• CPC Class Codes: H04N 23/63 : by using electronic viewfinders
• CPC Class Codes: H04N 23/661 : Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/662 : by using master/slave camera arrangements for affecting the control of camera image capture, e.g. placing the camera in a desirable condition to capture a desired image
• CPC Class Codes: H04N 23/667 : Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 23/67 : Focus control based on electronic image sensor signals
• CPC Class Codes: H04N 23/69 : Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 23/695 : Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
• CPC Class Codes: H04W 76/14 : Direct-mode setup

Abstract

A method for operating an unmanned aerial vehicle (UAV) is performed by a mobile terminal. The mobile terminal displays an image transmission interface on a touchscreen of the mobile terminal, the image transmission interface including a picture taken by the UAV that is wirelessly connected to the mobile terminal. After detecting a touch control signal applied on the touchscreen, the mobile terminal acquires an operation gesture according to the touch control signal and generating a corresponding operation command according to the operation gesture and a current control mode of the image transmission interface. Finally, the mobile terminal sends the operation command to the UAV. The UAV then performs a predefined operation according to the operation command.

Claims

1. A method for operating an unmanned aerial vehicle (UAV) performed by a mobile terminal having one or more processors and memory for storing a plurality of instructions to be executed by the one or more processors, the method comprising:

displaying an image transmission interface on a touchscreen of the mobile terminal, the image transmission interface including a picture taken by the UAV that is wirelessly connected to the mobile terminal;

detecting a touch control signal applied on the touchscreen;

acquiring an operation gesture according to the touch control signal;

generating a corresponding operation command according to the operation gesture and a current control mode of the image transmission interface; and

sending the operation command to the UAV, wherein the UAV is configured to perform a predefined operation according to the operation command.

2. The method according to claim 1, wherein the step of generating a corresponding operation command according to the operation gesture and a current control mode of the image transmission interface comprises:

monitoring the current control mode of the image transmission interface;

in accordance with a determination that the current control mode is an aircraft control mode, generating, according to the operation gesture, a corresponding operation command for controlling an aircraft to move; and

in accordance with the current control mode is a camera control mode, generating, according to the operation gesture, a corresponding operation command for controlling a lens to rotate.

3. The method according to claim 2, wherein the step of generating, according to the operation gesture, a corresponding operation command for controlling an aircraft to move comprises:

monitoring a moving direction of a single touch point; and

generating, according to the moving direction of the single touch point, an operation command for controlling an aircraft to move in a corresponding direction.

4. The method according to claim 3, wherein the moving direction of the single touch point comprises:

moving up, moving down, moving left or moving right, and the operation command correspondingly controls an aircraft to move as follows;

the aircraft moves up, the aircraft moves down, the aircraft moves left or the aircraft moves right.

5. The method according to claim 2, wherein the step of generating, according to the operation gesture, a corresponding operation command for controlling an aircraft to move comprises:

monitoring moving directions of two touch points;

in accordance with a determination that the two touch points move away from each other, generating an operation command for controlling an aircraft to move forward; and

in accordance with a determination that the two touch points move towards each other, generating an operation command for controlling an aircraft to move backward.

6. The method according to claim 2, wherein the step of generating, according to the operation gesture, a corresponding operation command for controlling a lens to rotate comprises:

monitoring a moving direction of a single touch point, and generating, according to the moving direction of the single touch point, an operation command for controlling a lens to rotate in a corresponding direction.

7. The method according to claim 6, wherein the moving direction of the single touch point comprises:

moving up or moving down, and the operation command correspondingly controls a lens to;

pitch up or pitch down.

8. The method according to claim 2, wherein the step of generating, according to the operation gesture, a corresponding operation command for controlling a lens to rotate comprises:

monitoring moving directions of two touch points;

in accordance with a determination that the two touch points move away from each other, generating an operation command for controlling a lens to increase a focal length; and

in accordance with a determination that the two touch points move towards each other, generating an operation command for controlling a lens to reduce a focal length.

9. The method according to claim 2, wherein the step of generating a corresponding operation command according to the operation gesture and a current control mode of the image transmission interface further comprises:

monitoring the current control mode of the image transmission interface;

in accordance with a determination that the current control mode is the camera control mode, monitoring a moving direction of a single touch point; and

in accordance with a determination that the moving direction of the single touch point is moving vertically, generating an operation command for controlling a lens to pitch in a corresponding direction, and when the moving direction of the single touch point is moving horizontally, generating an operation command for controlling an aircraft to move in a corresponding direction.

10. A mobile terminal comprising:

one or more processors;

memory; and

a plurality of computer readable instructions stored in the memory, wherein the computer readable instructions, when executed by the one or more processors, cause the one or more processors to perform the following steps;

displaying an image transmission interface on a touchscreen of the mobile terminal, the image transmission interface including a picture taken by an unmanned aerial vehicle (UAV) that is wirelessly connected to the mobile terminal;

detecting a touch control signal applied on the touchscreen;

acquiring an operation gesture according to the touch control signal;

generating a corresponding operation command according to the operation gesture and a current control mode of the image transmission interface; and

sending the operation command to the UAV, wherein the UAV is configured to perform a predefined operation according to the operation command.

11. The mobile terminal according to claim 10, wherein the step of generating a corresponding operation command according to the operation gesture and a current control mode of the image transmission interface comprises:

monitoring the current control mode of the image transmission interface;

in accordance with a determination that the current control mode is an aircraft control mode, generating, according to the operation gesture, a corresponding operation command for controlling an aircraft to move; and

in accordance with the current control mode is a camera control mode, generating, according to the operation gesture, a corresponding operation command for controlling a lens to rotate.

12. The mobile terminal according to claim 11, wherein the step of generating, according to the operation gesture, a corresponding operation command for controlling an aircraft to move comprises:

monitoring a moving direction of a single touch point; and

generating, according to the moving direction of the single touch point, an operation command for controlling an aircraft to move in a corresponding direction.

13. The mobile terminal according to claim 12, wherein the moving direction of the single touch point comprises:

moving up, moving down, moving left or moving right, and the operation command correspondingly controls an aircraft to move as follows;

the aircraft moves up, the aircraft moves down, the aircraft moves left or the aircraft moves right.

14. The mobile terminal according to claim 11, wherein the step of generating, according to the operation gesture, a corresponding operation command for controlling an aircraft to move comprises:

monitoring moving directions of two touch points;

in accordance with a determination that the two touch points move away from each other, generating an operation command for controlling an aircraft to move forward; and

in accordance with a determination that the two touch points move towards each other, generating an operation command for controlling an aircraft to move backward.

15. The mobile terminal according to claim 11, wherein the step of generating, according to the operation gesture, a corresponding operation command for controlling a lens to rotate comprises:

monitoring a moving direction of a single touch point, and generating, according to the moving direction of the single touch point, an operation command for controlling a lens to rotate in a corresponding direction.

16. The mobile terminal according to claim 15, wherein the moving direction of the single touch point comprises:

moving up or moving down, and the operation command correspondingly controls a lens to;

pitch up or pitch down.

17. The mobile terminal according to claim 11, wherein the step of generating, according to the operation gesture, a corresponding operation command for controlling a lens to rotate comprises:

monitoring moving directions of two touch points;

in accordance with a determination that the two touch points move away from each other, generating an operation command for controlling a lens to increase a focal length; and

in accordance with a determination that the two touch points move towards each other, generating an operation command for controlling a lens to reduce a focal length.

18. The mobile terminal according to claim 11, wherein the step of generating a corresponding operation command according to the operation gesture and a current control mode of the image transmission interface further comprises:

monitoring the current control mode of the image transmission interface;

in accordance with a determination that the current control mode is the camera control mode, monitoring a moving direction of a single touch point; and

in accordance with a determination that the moving direction of the single touch point is moving vertically, generating an operation command for controlling a lens to pitch in a corresponding direction, and when the moving direction of the single touch point is moving horizontally, generating an operation command for controlling an aircraft to move in a corresponding direction.

19. A non-transitory computer-readable storage medium storing instructions, the instructions, when executed by a mobile terminal having one or more processors, cause the one or more processors to perform a plurality of operations including:

displaying an image transmission interface on a touchscreen of the mobile terminal, the image transmission interface including a picture taken by an unmanned aerial vehicle (UAV) that is wirelessly connected to the mobile terminal;

detecting a touch control signal applied on the touchscreen;

acquiring an operation gesture according to the touch control signal;

generating a corresponding operation command according to the operation gesture and a current control mode of the image transmission interface; and

sending the operation command to the UAV, wherein the UAV is configured to perform a predefined operation according to the operation command.

20. The non-transitory computer-readable storage medium according to claim 19, wherein the step of generating a corresponding operation command according to the operation gesture and a current control mode of the image transmission interface comprises:

monitoring the current control mode of the image transmission interface;

in accordance with a determination that the current control mode is an aircraft control mode, generating, according to the operation gesture, a corresponding operation command for controlling an aircraft to move; and

in accordance with the current control mode is a camera control mode, generating, according to the operation gesture, a corresponding operation command for controlling a lens to rotate.