Mobile terminal and controlling method thereof

• US 9,918,002 B2
• Filed: 12/08/2015
• Issued: 03/13/2018
• Est. Priority Date: 06/02/2015
• Status: Expired due to Fees

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Kwon, Yunmi, Lee, Kiseon
• Primary Examiner(s): Henn, Timothy J
• Application Number:
  US14/963,058
• Publication Number:
  US 20160360087A1
• Time in Patent Office: 826 Days
• CPC Class Codes: B64C 39/024 of the remote controlled vehicle type, i.e. RPV
• CPC Class Codes: B64D 47/08 Arrangements of cameras
• CPC Class Codes: B64U 2101/30 for imaging, photography or videography
• CPC Class Codes: B64U 2201/20 Remote controls
• CPC Class Codes: G05D 1/0016 characterised by the operator's input device input arrangements for computing systems in general G06F3/00
• CPC Class Codes: G05D 1/0094 involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/66 Remote control of cameras or camera parts, e.g. by remote control devices
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof

Abstract

A mobile terminal and controlling method thereof are disclosed, by which a flying object equipped with a camera can be remotely controlled. The present disclosure includes a wireless communication unit configured to perform a communication with a flying object, a touchscreen configured to output a preview image received from the flying object, and a controller outputting a shot mode list on the preview image, the controller, if at least one shot mode is selected from the shot mode list, remotely controlling a flight location of the flying object in accordance with the selected at least one shot mode.

Claims

1. A mobile terminal, comprising:

a wireless communication unit configured to perform a communication with a flying object;

a touchscreen; and

a controller operably coupled with the wireless communication unit and the touchscreen and configured to;

cause the touchscreen to display a preview image received from the flying object, wherein the preview image is received via a camera of the flying object;

cause the touchscreen to display a shot mode list on the preview image;

remotely control a flight location of the flying object according to a shot mode selected from the shot mode list; and

cause change of the flight location of the flying object in response to a user input for selecting a subject included in the preview image such that the selected subject is not included in the preview image.

2. The mobile terminal of claim 1, wherein the shot mode list includes a recommended shot mode.

3. The mobile terminal of claim 2, wherein the controller is further configured to select the recommended shot mode based on whether a shooting place is located indoor, number of persons to be photographed, and weather.

4. The mobile terminal of claim 1, wherein the controller is further configured to delete an item included in the shot mode list and dragged from the shot mode list in a first direction.

5. The mobile terminal of claim 1, wherein the controller is further configured to control the flying object to sequentially take shots in accordance with a plurality of the shot modes selected from the shot mode list.

6. The mobile terminal of claim 1, wherein the controller is further configured to cause change of the flight location of the flying object in response to a user input for selecting a subject partially included in the preview image such that the selected subject is completely included in the preview image.

7. The mobile terminal of claim 1, wherein the controller is further configured to:

control the flying object to take a first picture including a subject located at a first location in the preview image in response to a user input for selecting the subject included in the preview image; and

control the flying object to take a second picture when the subject is no longer located at the first location.

8. The mobile terminal of claim 7, wherein the controller is further configured to merge the first picture and the second picture by pasting a region corresponding to a second location at which the subject is located in the second picture to a region corresponding to the first location at which the subject is located in the first picture.

9. The mobile terminal of claim 1, wherein the controller is further configured to control the flying object to take a picture in response to a touch input received via the preview image.

10. The mobile terminal of claim 1, wherein the controller is further configured to control the flying object to take a shot after expiration of a set timer in response to a drag input comprising dragging a pointer currently touching the preview image.

11. The mobile terminal of claim 10, wherein the controller is further configured to set an expiry time of the timer in accordance with a dragged length of the dragged pointer.

12. The mobile terminal of claim 1, wherein the controller is further configured to:

cause the flying object to move close to the mobile terminal in response to a user input for zooming in on the preview image; and

cause the flying object to move away from the mobile terminal in response to a user input for zooming out on the preview image.

13. The mobile terminal of claim 1, wherein the controller is further configured to cause the flying object to land nearby a preset communication device.

14. The mobile terminal of claim 13, wherein the controller is further configured to terminate a connection between the flying object and the mobile terminal in response to sensing the flying object nearby the preset communication device.

15. The mobile terminal of claim 1, wherein the controller is further configured to control the flying object to take a picture in accordance with a shot mode applied to previously taken picture in response to selection of the previously taken picture.

16. A flying object, comprising:

a wireless communication unit configured to perform a communication with a mobile terminal;

a motor;

at least one propeller operably coupled with the motor and configured to generate a lift for a flight;

a camera configured to take a shot; and

a controller operably coupled with the wireless communication unit, the motor, and the camera and configured to;

cause the wireless communication unit to transmit a preview image received via the camera to the mobile terminal such that the preview image is displayed on a touchscreen of the mobile terminal;

adjust a flight location in accordance with a shot mode indicated by shot mode information received from the mobile terminal;

control the camera to take a picture in response to formation of a shot composition corresponding to the shot mode; and

change the flight location in response to receiving a user input for selecting a subject included in the preview image such that the selected subject is not included in the preview image.

17. The flying object of claim 16, wherein:

the camera is rotatable; and

the controller is further configured to rotate the camera in response to a user'"'"'s gesture input detected by the camera.

18. A method for controlling a mobile terminal, comprising:

displaying a preview image received from a flying object on a touchscreen of the mobile terminal, wherein the preview image is received via a camera of the flying object;

displaying a shot mode list on the preview image;

selecting at least one shot mode from the shot mode list;

remotely controlling a flight location of the flying object according to the selected at least one shot mode; and

changing the flight location of the flying object in response to a user input for selecting a subject included in the preview image such that the selected subject is not included in the preview image.