Mobile terminal and method of controlling the same

• US 10,496,087 B2
• Filed: 07/26/2017
• Issued: 12/03/2019
• Est. Priority Date: 08/10/2016
• Status: Expired due to Fees

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Choi, Kyungdong
• Primary Examiner(s): Sood, Anshul
• Application Number:
  US15/660,871
• Publication Number:
  US 20180046179A1
• Time in Patent Office: 860 Days
• CPC Class Codes: B64U 10/13 Flying platforms
• CPC Class Codes: B64U 2101/30 for imaging, photography or videography
• CPC Class Codes: B64U 2201/10 autonomous, i.e. by navigating independently from ground or air stations, e.g. by using inertial navigation systems [INS]
• CPC Class Codes: B64U 2201/20 Remote controls
• CPC Class Codes: B64U 50/30 Supply or distribution of electrical power
• CPC Class Codes: B64U 70/90 Launching from or landing on platforms
• CPC Class Codes: G05D 1/0016 characterised by the operator's input device input arrangements for computing systems in general G06F3/00
• CPC Class Codes: G05D 1/0038 by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation images analyzed by a computer and used for automatic navigation G05D1/0246
• CPC Class Codes: G05D 1/0061 for transition from automatic pilot to manual pilot and vice versa
• CPC Class Codes: G05D 1/0676 specially adapted for landing
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06V 40/1365 Matching; Classification
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 3/003 to produce spatial visual effects

Abstract

The present invention provides a mobile terminal and a method of controlling the same. A mobile terminal according to an embodiment of the present invention includes a communication unit for transmitting/receiving data to/from a drone, an input unit for receiving a first signal for controlling operation of the drone, a display for displaying at least one of data received from the drone and a UI for operation control of the drone, and a controller for executing an application for operation control of the drone, transmitting the received first signal for controlling operation of the drone to the drone and transmitting a second signal for controlling operation of the drone to the drone according to generation of a predetermined event.

Claims

1. A mobile terminal comprising:

a communication unit for transmitting and receiving data to and from a drone;

an input unit for receiving a first signal for controlling an operation of the drone;

a display for displaying at least one of data received from the drone or a User Interface (UI) for the operation control of the drone; and

a controller operably coupled with the communication unit, the input unit, and the display, wherein the controller is for;

executing an application for the operation control of the drone;

transmitting the received first signal to the drone;

transmitting a second signal for controlling an operation of the drone to the drone according to generation of a predetermined event; and

identifying a user using fingerprint data when the predetermined event is receiving the fingerprint data,

wherein the display displays the UI differently based on whether the fingerprint data is received via a home button or via a touchscreen of the display.

2. The mobile terminal according to claim 1, wherein the controller controls the second signal to vary according to the predetermined event, causes the display to display the UI based on a type of the predetermined event and determines the second signal to be transmitted through the displayed UI.

3. The mobile terminal according to claim 2,

wherein, when the identified user has no authority to control operation of the drone, the controller controls the drone to maintain a first position, or to land at a second position,

wherein the first position includes a location and an altitude of the drone when the controller receives the fingerprint data,

wherein the second position includes a location of the drone when the controller receives the fingerprint data, a location of the mobile terminal when the controller receives the fingerprint data, an initial take off location of the drone, or a predetermined location for landing, and

wherein, when the identified user has authority to control operation of the drone, the UI includes detailed function items related to operation control of the drone, and the controller finishes operation control of the drone or controls the drone to maintain a location and an altitude when the controller receives the fingerprint data or moves to a predetermined location and altitude for standby until next fingerprint data is received.

4. The mobile terminal according to claim 3, wherein the controller provides the UI according to force-touch input in response to the force-touch input received after the fingerprint data is received or received along with the fingerprint data,

wherein the UI includes at least one of altitude control or forward/backward movement control according to the force-touch input, and

wherein, when a drag signal is received along with the force-touch input, the controller controls the drone to move in a direction corresponding to the received drag signal.

5. The mobile terminal according to claim 4, wherein the controller:

transmits a result of identification of the user of the fingerprint data to the drone according to the received fingerprint data;

receives a feedback signal from the drone according to whether the user has the authority to control operation of the drone; and

outputs at least one of a haptic effect, pop-up data, or audio data in response to the received feedback signal.

6. The mobile terminal according to claim 3, wherein:

the predetermined event is execution of a text or call application;

the controller provides the UI or transmits a control signal according to voice or gesture input of the user of the mobile terminal; and

the UI or the control signal includes at least one of lowering altitude, landing, takeoff, increasing altitude, execution of around-view, moving to a target at a fixed position and a fixed altitude, or capturing a selfie.

7. The mobile terminal according to claim 3, wherein:

the event corresponds to execution of a camera application; and

the controller;

activates at least one camera of the drone including a plurality of cameras according to the execution of the camera application;

requests reception of a captured image of the drone;

causes the display to display image data received from the drone; and

controls an angle of the drone or at least one camera included in the drone according to selection of the displayed image data.

8. The mobile terminal according to claim 3, wherein;

the predetermined event is related to a battery state and battery charge is lower than a predetermined threshold value; and

the controller;

provides the UI or transmits a control signal for controlling the drone to perform a predetermined operation;

periodically transmits the location of the mobile terminal until the mobile terminal is turned off due to battery or detects another mobile terminal for controlling the drone around the drone or the mobile terminal; and

determines whether the detected mobile terminal is a registered device and has the authority to control operation of the drone.

9. The mobile terminal according to claim 3, wherein the drone maintains the location and altitude for a predetermined time or lands at an initial takeoff place, the location, or a predetermined landing position when a control signal is not received for a predetermined time or connection between the drone and the mobile terminal is abruptly cancelled.