Control method for photographing using unmanned aerial vehicle, photographing method using unmanned aerial vehicle, mobile terminal, and unmanned aerial vehicle

• US 10,674,062 B2
• Filed: 04/20/2018
• Issued: 06/02/2020
• Est. Priority Date: 11/04/2015
• Status: Active Grant

• Current Assignee: Tencent Technology Company Limited (Tencent Holdings Limited)
• Original Assignee: Tencent Technology Company Limited (Tencent Holdings Limited)
• Inventors: Li, Jialun, Li, Kaifeng, Ning, Jing
• Primary Examiner(s): Ustaris, Joseph G
• Assistant Examiner(s): Shahnami, Amir
• Application Number:
  US15/959,007
• Publication Number:
  US 20180237140A1
• Time in Patent Office: 774 Days
• Field of Search: 348144
• CPC Class Codes: B64C 27/08 with two or more rotors
• CPC Class Codes: B64C 39/024 of the remote controlled vehicle type, i.e. RPV
• CPC Class Codes: B64U 2101/30 for imaging, photography or videography
• CPC Class Codes: B64U 2201/20 Remote controls
• CPC Class Codes: G05D 1/0011 associated with a remote control arrangement
• CPC Class Codes: G05D 1/0016 characterised by the operator's input device input arrangements for computing systems in general G06F3/00
• CPC Class Codes: G05D 1/0022 characterised by the communication link data switching networks in general H04L12/00
• CPC Class Codes: G05D 1/0038 by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation images analyzed by a computer and used for automatic navigation G05D1/0246
• CPC Class Codes: G05D 1/0094 involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target
• CPC Class Codes: G05D 1/10 Simultaneous control of position or course in three dimensions G05D1/12 takes precedence
• CPC Class Codes: G05D 1/101 specially adapted for aircraft
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G08C 17/02 using a radio link
• CPC Class Codes: G08C 2201/30 User interface
• CPC Class Codes: G08C 2201/32 Remote control based on movements, attitude of remote control device
• CPC Class Codes: G08C 2201/91 Remote control based on location and proximity
• CPC Class Codes: G08C 2201/93 : Remote control using other portable devices, e.g. mobile phone, PDA, laptop
• CPC Class Codes: H04N 1/00127 : Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
• CPC Class Codes: H04N 1/00251 : with an apparatus for taking photographic images, e.g. a camera
• CPC Class Codes: H04N 1/00307 : with a mobile telephone apparatus constructional features of portable telephone sets H04M1/0202; mobile radio systems H04W84/00
• CPC Class Codes: H04N 1/00411 : the display also being used for user input, e.g. touch screen
• CPC Class Codes: H04N 1/00424 : using a list of graphical elements, e.g. icons or icon bar
• CPC Class Codes: H04N 1/00435 : arranged in a predetermined sequence, e.g. using next and previous buttons
• CPC Class Codes: H04N 1/00482 : outputting a plurality of job set-up options, e.g. number of copies, paper size or resolution
• CPC Class Codes: H04N 2201/0013 : Arrangements for the control of the connected apparatus by the still picture apparatus arrangements for the control of a still picture apparatus by the connected apparatus H04N2201/0074; control of image communication with the connected apparatus H04N2201/0015
• CPC Class Codes: H04N 2201/0055 : By radio
• CPC Class Codes: H04N 2201/0096 : Portable devices
• CPC Class Codes: H04N 23/62 : Control of parameters via user interfaces
• CPC Class Codes: H04N 23/63 : by using electronic viewfinders
• CPC Class Codes: H04N 23/661 : Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/662 : by using master/slave camera arrangements for affecting the control of camera image capture, e.g. placing the camera in a desirable condition to capture a desired image
• CPC Class Codes: H04N 23/667 : Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 23/67 : Focus control based on electronic image sensor signals
• CPC Class Codes: H04N 23/69 : Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 23/695 : Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
• CPC Class Codes: H04W 76/14 : Direct-mode setup

Abstract

A multimedia synchronization method is performed by an aircraft that is wirelessly connected to a plurality of mobile terminals. After receiving a first authorized-user identifier sent by a first mobile terminal, the aircraft receives an aircraft operation command and a photographing command sent by the first mobile terminal. The aircraft performs aircraft flight control according to the aircraft operation command and collects multimedia data in a target photographing region according to the photographing command. Finally, the aircraft stores the multimedia data for which the first authorized-user identifier is used as an index identifier. The aircraft synchronizes the multimedia data to the first mobile terminal and a second mobile terminal that accesses the multimedia data.

Claims

1. A multimedia synchronization method performed by an aircraft having one or more processors and memory for storing a plurality of instructions to be executed by the one or more processors, wherein the aircraft is wirelessly connected to a plurality of mobile terminals, the method comprising:

receiving a first authorized-user identifier sent by a first mobile terminal;

receiving an aircraft operation command and a photographing command sent by the first mobile terminal;

performing aircraft flight control according to the aircraft operation command, and collecting multimedia data in a target photographing region according to the photographing command;

storing the multimedia data for which the first authorized-user identifier is used as an index identifier; and

synchronizing the multimedia data to the first mobile terminal, further comprising;

generating a thumbnail corresponding to the multimedia data for which the first authorized-user identifier is used as an index identifier;

sending the thumbnail in real time to the first mobile terminal that currently operates an aircraft;

receiving a real-time viewing command of the first mobile terminal for the thumbnail; and

synchronizing, to the first mobile terminal, the multimedia data corresponding to the thumbnail according to the real-time viewing command.

2. The method according to claim 1, wherein the operation of storing the multimedia data for which the first authorized-user identifier is used as an index identifier comprises:

establishing a corresponding unique index for each piece of multimedia data obtained through photographing; and

establishing a media database for the first authorized-user identifier, wherein the media database stores the multimedia data for which the first authorized-user identifier is used as an index identifier and the corresponding index.

3. The method according to claim 1, further comprising:

after synchronizing the multimedia data to the first mobile terminal;

receiving a multimedia viewing command sent by a second mobile terminal, wherein the multimedia viewing command carries the first authorized-user identifier; and

after the first authorized-user identifier is authenticated, searching for multimedia data by using the first authorized-user identifier as an index identifier, and synchronizing the multimedia data to the second mobile terminal.

4. The method according to claim 1, further comprising:

after synchronizing the multimedia data to the first mobile terminal;

receiving a multimedia viewing command sent by a second mobile terminal; and

acquiring the first authorized-user identifier submitted by the first mobile terminal that currently operates an aircraft, searching for multimedia data by using the first authorized-user identifier as an index identifier, and synchronizing the multimedia data to the second mobile terminal.

5. The method according to claim 1, further comprising:

after synchronizing the multimedia data to the first mobile terminal;

receiving a multimedia viewing command sent by a second mobile terminal, wherein the multimedia viewing command carries a second authorized-user identifier; and

monitoring whether friend link data exists between the first authorized-user identifier submitted by the first mobile terminal that currently operates an aircraft and the second authorized-user identifier, and if friend link data exists, searching for multimedia data by using the first authorized-user identifier as an index identifier, and synchronizing the multimedia data to the second mobile terminal.

6. The method according to claim 1,

after synchronizing the multimedia data to the first mobile terminal:

receiving a second authorized-user identifier sent by a second mobile terminal;

performing authentication on the second authorized-user identifier, searching a server for at least one first authorized-user identifier that is stored in an aircraft and has friend link data with the second authorized-user identifier, sending the found first authorized-user identifier to the second mobile terminal, and displaying a multimedia folder of the first authorized-user identifier on an application interface of the second mobile terminal; and

receiving a viewing command sent by the second mobile terminal for the multimedia folder, writing the viewing command to the first authorized-user identifier corresponding to the multimedia folder, searching for multimedia data by using the first authorized-user identifier as an index identifier, and synchronizing the multimedia data to the second mobile terminal.

7. The method according to claim 1, further comprising:

after synchronizing the multimedia data to the first mobile terminal;

receiving a multimedia synchronization command sent by a second mobile terminal;

comparing multimedia data in the second mobile terminal with multimedia data locally stored in an aircraft; and

in accordance with a determination that the multimedia data in the second mobile terminal is inconsistent with the multimedia data locally stored in the aircraft, synchronizing, to the second mobile terminal, the multimedia data locally stored in the aircraft.

8. An aircraft comprising:

one or more processors;

memory; and

a plurality of computer readable instructions stored in the memory, wherein the computer readable instructions, when executed by the one or more processors, cause the one or more processors to perform the following operations;

receiving a first authorized-user identifier sent by a first mobile terminal;

receiving an aircraft operation command and a photographing command sent by the first mobile terminal;

performing aircraft flight control according to the aircraft operation command, and collecting multimedia data in a target photographing region according to the photographing command;

storing the multimedia data for which the first authorized-user identifier is used as an index identifier; and

synchronizing the multimedia data to the first mobile terminal, further comprising;

generating a thumbnail corresponding to the multimedia data for which the first authorized-user identifier is used as an index identifier;

sending the thumbnail in real time to the first mobile terminal that currently operates an aircraft;

receiving a real-time viewing command of the first mobile terminal for the thumbnail; and

synchronizing, to the first mobile terminal, the multimedia data corresponding to the thumbnail according to the real-time viewing command.

9. The aircraft according to claim 8, wherein the operation of storing the multimedia data for which the first authorized-user identifier is used as an index identifier comprises:

establishing a corresponding unique index for each piece of multimedia data obtained through photographing; and

establishing a media database for the first authorized-user identifier, wherein the media database stores the multimedia data for which the first authorized-user identifier is used as an index identifier and the corresponding index.

10. The aircraft according to claim 8, wherein the operations further comprise:

after synchronizing the multimedia data to the first mobile terminal;

receiving a multimedia viewing command sent by a second mobile terminal, wherein the multimedia viewing command carries the first authorized-user identifier; and

after the first authorized-user identifier is authenticated, searching for multimedia data by using the first authorized-user identifier as an index identifier, and synchronizing the multimedia data to the second mobile terminal.

11. The aircraft according to claim 8, wherein the operations further comprise:

after synchronizing the multimedia data to the first mobile terminal;

receiving a multimedia viewing command sent by a second mobile terminal; and

acquiring the first authorized-user identifier submitted by the first mobile terminal that currently operates an aircraft, searching for multimedia data by using the first authorized-user identifier as an index identifier, and synchronizing the multimedia data to the second mobile terminal.

12. The aircraft according to claim 8, wherein the operations further comprise:

after synchronizing the multimedia data to the first mobile terminal;

receiving a multimedia viewing command sent by a second mobile terminal, wherein the multimedia viewing command carries a second authorized-user identifier; and

monitoring whether friend link data exists between the first authorized-user identifier submitted by the first mobile terminal that currently operates an aircraft and the second authorized-user identifier, and if friend link data exists, searching for multimedia data by using the first authorized-user identifier as an index identifier, and synchronizing the multimedia data to the second mobile terminal.

13. The aircraft according to claim 8, wherein the operations further comprise:

after synchronizing the multimedia data to the first mobile terminal;

receiving a second authorized-user identifier sent by a second mobile terminal;

performing authentication on the second authorized-user identifier, searching a server for at least one first authorized-user identifier that is stored in an aircraft and has friend link data with the second authorized-user identifier, sending the found first authorized-user identifier to the second mobile terminal, and displaying a multimedia folder of the first authorized-user identifier on an application interface of the second mobile terminal; and

receiving a viewing command sent by the second mobile terminal for the multimedia folder, writing the viewing command to the first authorized-user identifier corresponding to the multimedia folder, searching for multimedia data by using the first authorized-user identifier as an index identifier, and synchronizing the multimedia data to the second mobile terminal.

14. The aircraft according to claim 8, wherein the operations further comprise:

after synchronizing the multimedia data to the first mobile terminal;

receiving a multimedia synchronization command sent by a second mobile terminal;

comparing multimedia data in the second mobile terminal with multimedia data locally stored in an aircraft; and

in accordance with a determination that the multimedia data in the second mobile terminal is inconsistent with the multimedia data locally stored in the aircraft, synchronizing, to the second mobile terminal, the multimedia data locally stored in the aircraft.

15. A non-transitory computer-readable storage medium storing instructions, the instructions, when executed by an aircraft having one or more processors, cause the one or more processors to perform a plurality of operations including:

receiving a first authorized-user identifier sent by a first mobile terminal;

receiving an aircraft operation command and a photographing command sent by the first mobile terminal;

performing aircraft flight control according to the aircraft operation command, and collecting multimedia data in a target photographing region according to the photographing command;

storing the multimedia data for which the first authorized-user identifier is used as an index identifier; and

synchronizing the multimedia data to the first mobile terminal, further comprising;

generating a thumbnail corresponding to the multimedia data for which the first authorized-user identifier is used as an index identifier;

sending the thumbnail in real time to the first mobile terminal that currently operates an aircraft;

receiving a real-time viewing command of the first mobile terminal for the thumbnail; and

synchronizing, to the first mobile terminal, the multimedia data corresponding to the thumbnail according to the real-time viewing command.

16. The non-transitory computer-readable storage medium according to claim 15, wherein the operation of storing the multimedia data for which the first authorized-user identifier is used as an index identifier comprises:

establishing a corresponding unique index for each piece of multimedia data obtained through photographing; and

establishing a media database for the first authorized-user identifier, wherein the media database stores the multimedia data for which the first authorized-user identifier is used as an index identifier and the corresponding index.

17. The non-transitory computer-readable storage medium according to claim 15, wherein the operations further comprise:

after synchronizing the multimedia data to the first mobile terminal;

receiving a multimedia viewing command sent by a second mobile terminal, wherein the multimedia viewing command carries the first authorized-user identifier; and

after the first authorized-user identifier is authenticated, searching for multimedia data by using the first authorized-user identifier as an index identifier, and synchronizing the multimedia data to the second mobile terminal.