MOBILE TERMINAL AND CONTROLLING METHOD THEREOF

• US 20170329571A1
• Filed: 07/24/2016
• Published: 11/16/2017
• Est. Priority Date: 05/16/2016
• Status: Abandoned Application

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: HEO, Jeongyun, CHU, Junghoon, JANG, Yujune
• Application Number:
  US15/218,042
• Publication Number:
  US 20170329571A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06F 40/166 Editing, e.g. inserting or deleting
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: H04M 1/72436 for text messaging, e.g. short messaging services [SMS] or e-mails
• CPC Class Codes: H04M 2201/40 using speech recognition speech recognition per se G10L15/00

Abstract

Disclosed are a mobile terminal and controlling method thereof. The present invention includes a microphone, a sensing unit, a display unit, and a controller configured to output a first text to the display unit, wherein if a first trigger signal is sensed while the first text is outputted, the controller is further configured to activate a text edit mode, wherein after the text edit mode has been activated, the controller is further configured to sense a first voice input within a first preset time, and wherein if a second text corresponding to the first voice input corresponds to preset similarity with at least one portion of the first text, the controller is further configured to output a third text having the at least one portion of the first text substituted with the second text.

Claims

1. A mobile terminal, comprising:

a microphone;

a sensing unit;

a display; and

a controller operably coupled to the microphone, the sensing unit, and the display, wherein the controller is configured to;

cause the display to display a first text;

activate a text edit mode in response to a first input sensed by the sensing unit while the first text is displayed;

recognize a first voice input received via the microphone, the first voice input received within a first preset period of time after the text edit mode is activated; and

cause the display to display a third text based on similarity between a second text corresponding to the first voice input and at least one portion of the first text,

wherein the third text is a text in which the at least one portion of the first text is substituted with the second text.

2. The mobile terminal of claim 1, wherein the controller is further configured to:

activate a text add mode in response to a second input sensed by the sensing unit while the first text is displayed; and

cause the display to additionally display a fourth text corresponding to a second voice input received via the microphone, the second voice input recognized within a second preset period of time after the text add mode is activated.

3. The mobile terminal of claim 2, wherein the fourth text is displayed at a preset region of the display that is adjacent to the first text.

4. The mobile terminal of claim 1, wherein:

the controller is further configured to cause the display to display a cursor indicator at a preset location of the first text that is displayed; and

the preset location of the first text corresponds to a location that precedes or follows a character included in the first text.

5. The mobile terminal of claim 4, wherein:

the controller is further configured to cause the cursor indicator displayed on the first text to move in response to a second voice input received via the microphone; and

a moving distance of the cursor indicator is determined based on a number of characters corresponding to the second voice input.

6. The mobile terminal of claim 5, wherein the controller is further configured to cause the display to display a fourth text in response to a user input received while the cursor indicator is moving and a third voice input that is received via the microphone while the user input is received such that at least one portion of the first text is substituted with the fourth text corresponding to the third voice input.

7. The mobile terminal of claim 4, wherein the controller is further configured to cause the cursor indicator to move on the first text at a preset speed.

8. The mobile terminal of claim 7, wherein the controller is further configured to cause the display to additionally display a fourth text at a location of the cursor indicator in response to a user input received while the cursor indicator is moving and a second voice input received via the microphone after the user input is recognized, the fourth text corresponding to the second voice input.

9. The mobile terminal of claim 1, wherein the first input is either a preset gesture input or a touch input.

10. The mobile terminal of claim 9, wherein the controller is further configured to determine the at least one portion of the first text based on a time point at which the first input is received.

11. The mobile terminal of claim 1, wherein:

the controller is further configured to cause the display to display a send indicator while the first text is displayed; and

the send indicator is displayed during a second preset period of time following the first preset period of time.

12. The mobile terminal of claim 11, wherein the second preset period of time comprises a dispatch waiting time of the first text.

13. The mobile terminal of claim 11, further comprising a wireless communication unit, wherein the controller is further configured to cause the wireless communication unit to transmit the third text to an external device after the second preset period of time.

14. The mobile terminal of claim 1, wherein the controller is further configured to cause the display to display a send indicator after the first preset period of time.

15. The mobile terminal of claim 1, wherein:

the controller is further configured to cause the display to display a recommended operation menu based on content of the first text in response to a user input; and

the recommended operation menu comprises at least one selected from the group consisting of a symbol add menu, an emoticon add menu, and a photo add menu.

16. The mobile terminal of claim 1, wherein the controller is further configured to:

set a block at a region of the first text in response to a user input received during the text edit mode;

recognize a second voice input received via the microphone within a second preset period of time after recognizing the user input; and

cause the display to display the block-set region such that a text within the block-set region is substituted with a fourth text corresponding to the second voice input.

17. The mobile terminal of claim 16, wherein the block-set region is determined based on at least one of a size or a pressure of the user input received via the region of the first text.

18. A method for controlling a mobile terminal, the method comprising:

displaying a first text via a display,

activating a text edit mode in response to a first input sensed while the first text is displayed;

recognizing a first voice input received via a microphone within a first preset period of time after the text edit mode is activated; and

displaying a third text based on similarity between a second text corresponding to the first voice input and at least one portion of the first text,

wherein the third text is a text in which the at least one portion of the first text is substituted with the second text.

19. The method of claim 18, further comprising:

activating a text add mode in response to a second input that is sensed while the first text is displayed; and

additionally displaying a fourth text corresponding to a second voice input received via the microphone, the second voice input recognized within a second preset period of time after the text add mode is activated.

20. The method of claim 18, further comprising displaying a cursor indicator at a preset location of the first text that is displayed,

wherein the preset location of the first text corresponds to a location that precedes or follows a character included in the first text.