Mobile terminal and controlling method thereof

• US 10,284,766 B2
• Filed: 01/23/2018
• Issued: 05/07/2019
• Est. Priority Date: 06/02/2015
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Kwon, Yunmi, Lee, Kiseon
• Primary Examiner(s): Henn, Timothy J
• Application Number:
  US15/878,160
• Publication Number:
  US 20180160026A1
• Time in Patent Office: 469 Days
• CPC Class Codes: B64U 2101/30 for imaging, photography or videography
• CPC Class Codes: B64U 2201/20 Remote controls
• CPC Class Codes: G05D 1/0016 characterised by the operator's input device input arrangements for computing systems in general G06F3/00
• CPC Class Codes: G05D 1/0094 involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/66 Remote control of cameras or camera parts, e.g. by remote control devices
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Abstract

A mobile terminal and controlling method thereof are disclosed, by which a flying object equipped with a camera can be remotely controlled. The present disclosure includes a wireless communication unit configured to perform a communication with a flying object, a touchscreen configured to output a preview image received from the flying object, and a controller outputting a shot mode list on the preview image, the controller, if at least one shot mode is selected from the shot mode list, remotely controlling a flight location of the flying object in accordance with the selected at least one shot mode.

Claims

1. A mobile terminal, comprising:

a wireless communication unit configured to perform a communication with a flying object;

a touchscreen; and

a controller operably coupled with the wireless communication unit and the touchscreen and configured to;

cause the touchscreen to display a preview image received from the flying object, wherein the preview image is received via a camera of the flying object;

cause the touchscreen to display at least one of control buttons to remotely control the flight object;

remotely control a flight location of the flying object, a flying direction of the flying object, and a camera angle of the flying object according to an input received through at least one of the control buttons;

control the flying object to take a first picture including a subject located at a first location in the preview image in response to a user input for selecting the subject included in the preview image, wherein the user input comprises touching the subject included in the preview image; and

control the flying object to take a second picture when the subject is no longer located at the first location.

2. The mobile terminal of claim 1, wherein the controller is further configured to:

cause the touchscreen to display a shot mode list on the preview image; and

remotely control a flight location of the flying object according to a shot mode selected from the shot mode list.

3. The mobile terminal of claim 2, wherein the shot mode list includes a recommended shot mode depending on whether a shooting place is an indoor place.

4. The mobile terminal of claim 3, wherein the recommended shot mode includes a face shot mode when a shooting place is located indoor, and

wherein the recommended shot mode includes at least one of a full body shot mode and a landscape (or scenery) shot mode when the shooting place is located outdoor.

5. The mobile terminal of claim 2, wherein the shot mode list includes a prescribed number of shot modes frequently used by a user.

6. The mobile terminal of claim 2, wherein the controller is further configured to delete an item included in the shot mode list and dragged from the shot mode list in a first direction.

7. The mobile terminal of claim 2, wherein the controller is further configured to control the flying object to sequentially take shots in accordance with a plurality of shot modes, respectively, in response to selection of the plurality of shot modes from the shot mode list.

8. The mobile terminal of claim 1, wherein the controller is further configured to control the flying object to take a shot after expiration of a set timer in response to a drag input comprising dragging a pointer currently touching the preview image.

9. The mobile terminal of claim 8, wherein the controller is further configured to set an expiry time of the timer in accordance with a dragged length of the dragged pointer.

10. The mobile terminal of claim 1, wherein the controller is further configured to:

cause the flying object to move close to the mobile terminal in response to a user input for zooming in on the preview image; and

cause the flying object to move away from the mobile terminal in response to a user input for zooming out on the preview image.

11. The mobile terminal of claim 1, wherein the controller is further configured to control the flying object to take a picture in accordance with a shot mode applied to previously taken picture in response to selection of the previously taken picture.

12. The mobile terminal of claim 1, wherein the controller is further configured to merge the first picture and the second picture by pasting a region corresponding to a second location at which the subject is located in the second picture to a region corresponding to the first location at which the subject is located in the first picture.

13. The mobile terminal of claim 1, wherein the controller is further configured to:

cause the flying object to land nearby a preset communication device; and

terminate a connection between the flying object and the mobile terminal in response to sensing the flying object nearby the preset communication device.

14. The mobile terminal of claim 13, wherein the controller is further configured to:

cause the touchscreen to display a landing button; and

cause the touchscreen to display landing location menus for selecting a landing location of the flying object when the landing button is touched,

wherein the landing location menus includes a return button, a current location button and a move to the preset communication device.

15. A mobile terminal, comprising:

a wireless communication unit configured to perform a communication with a flying object;

a touchscreen; and

a controller operably coupled with the wireless communication unit and the touchscreen and configured to;

cause the touchscreen to display a preview image received from the flying object, wherein the preview image is received via a camera of the flying object;

cause the touchscreen to display at least one of control buttons to remotely control the flight object;

remotely control a flight location of the flying object, a flying direction of the flying object, and a camera angle of the flying object according to a input through at least one of the control buttons;

cause the flying object to land nearby a preset communication device; and

terminate a connection between the flying object and the mobile terminal in response to sensing the flying object nearby the preset communication device.

16. The mobile terminal of claim 15, wherein the controller is further configured to:

cause the touchscreen to display a landing button; and

cause the touchscreen to display landing location menus for selecting a landing location of the flying object when the landing button is touched,

wherein the landing location menus includes a return button, a current location button and a move to the preset communication device.