Mobile terminal and method for controlling the same

• US 9,841,759 B2
• Filed: 06/30/2016
• Issued: 12/12/2017
• Est. Priority Date: 07/29/2015
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Jung, Jaesik, Min, Jiho
• Primary Examiner(s): Kiswanto, Nicholas
• Assistant Examiner(s): TAVERAS, KENNY ABEL
• Application Number:
  US15/197,973
• Publication Number:
  US 20170031355A1
• Time in Patent Office: 530 Days
• CPC Class Codes: B64U 10/13 Flying platforms
• CPC Class Codes: B64U 2101/30 for imaging, photography or videography
• CPC Class Codes: B64U 2201/20 Remote controls
• CPC Class Codes: G05D 1/0016 characterised by the operator's input device input arrangements for computing systems in general G06F3/00
• CPC Class Codes: G05D 1/0038 by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation images analyzed by a computer and used for automatic navigation G05D1/0246
• CPC Class Codes: G05D 1/0094 involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

Disclosed are a mobile terminal and a method for controlling the same. The mobile terminal which wirelessly communicates with an unmanned aircraft including a camera, includes a wireless communication unit configured to receive a capturing image including a plurality of images captured by the camera; a memory configured to store flight information of the unmanned aircraft corresponding to each of the plurality of images; a display unit configured to output the captured image; and a controller configured to transmit a flight control command which is formed by flight information corresponding to at least one image to the unmanned aircraft, based on a recapturing command to at least one image among the plurality of images.

Claims

1. A mobile terminal configured to wirelessly communicate with an unmanned aircraft that includes a camera, comprising:

a wireless communication unit in wireless communication with the unmanned aircraft to receive a captured image from the camera;

a memory configured to store flight information of the unmanned aircraft corresponding to the captured image;

a display unit configured to output the captured image; and

a controller configured to generate a recapturing command associated with the captured image,

wherein, in response to the recapturing command, the controller generates a flight control command based on the stored flight information corresponding to the captured image and transmits the flight control command to the unmanned aircraft,

wherein the captured image includes a plurality of images captured along a flight route, and

wherein the controller is configured to generate the recapturing command based on a time point of a touch applied while the plurality of images are being reproduced, and the flight control command is generated based on the flight information corresponding to one or more of the plurality of images corresponding to the time point of the applied touch.

2. The mobile terminal of claim 1, wherein the display unit is configured to output a map screen including a flight route of the unmanned aircraft.

3. The mobile terminal of claim 2, wherein the controller is configured to set a recapturing route for recapturing the captured image based on a touch applied to the map screen.

4. The mobile terminal of claim 3, wherein the captured image includes a plurality of images along the flight route and, when a touch is applied to select a region of the flight route, the controller is configured to control the display unit to output one or more of the plurality of images that correspond to the selected region of the flight route.

5. The mobile terminal of claim 3, wherein the controller is configured to set the recapturing route based on a drag touch input applied along the flight route.

6. The mobile terminal of claim 1, wherein the display unit is configured to output a reproduction bar that indicates a reproduction time of the plurality of images, and

wherein the display unit is configured to display an error icon together with the reproduction bar that indicates existence of one or more error images and receive the touch for the recapturing command to recapture images to replace the one or more error images.

7. The mobile terminal of claim 1, wherein the controller is configured to select a specific object included in the captured image based on the touch, and to generate the flight control command based on the stored flight information corresponding to one or more of the plurality of images that includes the specific object.

8. The mobile terminal of claim 7, wherein the controller is configured to extract one or more of the plurality of images that includes the specific object, and control the display unit to output a group image by classifying the extracted images according to captured time.

9. The mobile terminal of claim 1, wherein the controller is configured to receive the touch on the plurality of images in a prescribed direction that tracks backward along the flight route, and generate the flight control command to recapture images along a region of the flight route corresponding to where the touch is released.

10. The mobile terminal of claim 9, wherein the display unit is configured to sequentially output the plurality of images included in the captured image based on the touch.

11. The mobile terminal of claim 9, wherein the controller is configured to generate the flight control command based on flight information corresponding to an image which is outputted at the time that the touch is released.

12. The mobile terminal of claim 1, wherein the controller is configured to control the display unit to change a flight route based on the flight information, or output the captured image in a changed form.

13. The mobile terminal of claim 1, wherein the flight information includes information on a flight restricted area or information on an altitude restricted area.

14. The mobile terminal of claim 1, wherein the controller is configured to generate the recapturing command when an error data is included in the flight information, and

wherein the error data includes movement information of the unmanned aircraft.

15. The mobile terminal of claim 1, wherein when a plurality of error images are selected in the captured image, the controller is configured to generate a shortest flight route based on flight information corresponding to the plurality of error images.

16. The mobile terminal of claim 1, wherein the controller is configured to receive power information of the unmanned aircraft and set a recapturing route to recapture one or more images using the power information.

17. The mobile terminal of claim 1, wherein the controller is configured to search for a substitute image from a prescribed server or from the memory, based on flight information corresponding to an error image included in the captured image.

18. The mobile terminal of claim 1, wherein the captured image includes a plurality of images and the display unit is configured to sequentially output thumbnail images for the plurality of images, and

wherein the controller is configured to select an error image based on a touch applied to at least one of the thumbnail images and generate the flight control command based on flight information associated with the error image.

19. A method for controlling a mobile terminal, comprising:

communicating in a wireless manner through a wireless communication unit with an unmanned aircraft that includes a camera;

receiving, through the wireless communication unit, a plurality of captured images captured by the camera along a flight route of the unmanned aircraft;

storing flight information of the unmanned aircraft corresponding to each of the plurality of captured images;

outputting the plurality of captured images to the display unit; and

generating, by a controller, a flight control command in response to a recapturing command applied to one or more of the plurality of captured images, the flight control command being based on the stored flight information corresponding to the one or more of the plurality of captured images; and

transmitting to the unmanned aircraft, by the wireless communication unit, the flight control command to recapture images,

wherein the recapturing command is generated based on a time point of a touch applied while the plurality of captured images are being reproduced, and the flight control command is generated based on the flight information corresponding to one or more of the plurality of captured images corresponding to the time point of the applied touch.