Mobile terminal and controlling method thereof

• US 9,711,142 B2
• Filed: 12/29/2015
• Issued: 07/18/2017
• Est. Priority Date: 07/20/2015
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Choi, Kyungdong
• Primary Examiner(s): GUERRA-ERAZO, EDGAR X
• Application Number:
  US14/982,898
• Publication Number:
  US 20170025122A1
• Time in Patent Office: 567 Days
• Field of Search: 704235, 704246, 704243, 704270, 7042701, 704275, 704260, 704258
• CPC Class Codes: G06F 1/3234 Power saving characterised by the action undertaken
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: H04M 1/271 controlled by voice recognition
• CPC Class Codes: H04M 1/578 associated with a synthesized vocal announcement
• CPC Class Codes: H04M 1/67 by electronic means
• CPC Class Codes: H04M 1/72403 with means for local support of applications that increase the functionality
• CPC Class Codes: H04M 1/72454 according to context-related or environment-related conditions
• CPC Class Codes: H04M 2201/39 using speech synthesis speech synthesis per se G10L13/00
• CPC Class Codes: H04M 2250/12 including a sensor for measuring a physical value, e.g. temperature or motion telephones including GPS signal receivers H04M2250/10
• CPC Class Codes: H04M 2250/74 with voice recognition means voice activated dialling H04M1/271; voice recognition algorithms G10L15/00

Abstract

A mobile terminal including a display; a proximity sensor configured to sense a predetermined action of a user; an audio output unit; and a controller configured to deactivate the display and enter the mobile terminal into a standby mode while maintaining the proximity sensor in an activated state, and in response to the proximity sensor sensing the predetermined action by the user, output audio data through the audio output unit while the display is deactivated corresponding to information collected about a previous event that occurred on the mobile terminal.

Claims

1. A mobile terminal, comprising:

a display;

a proximity sensor configured to sense proximity of an object;

an audio output unit; and

a controller configured to;

deactivate the display and enter the mobile terminal into a standby mode while maintaining the proximity sensor in an activated state, and

if the proximity of the object is sensed through the proximity sensor, output audio data through the audio output unit while the display is deactivated corresponding to information collected about a previous event that occurred on the mobile terminal.

2. The mobile terminal of claim 1, further comprising:

a microphone,

wherein if the proximity of the object is sensed through the proximity sensor, the controller is further configured to activate the microphone, obtain a voice signal through the microphone, convert the voice signal into text, and execute a function of an application corresponding to the converted text.

3. The mobile terminal of claim 2, wherein in response to the voice signal being input while the audio data is output through the audio output unit, the controller is further configured to preferentially process the voice signal more than the audio data.

4. The mobile terminal of claim 1, wherein the controller is further configured to:

output first audio data related to a first application through the audio output unit corresponding to the information collected about the event, and

if the proximity of the object is sensed through the proximity sensor, activate the display and display an executing screen of the first application on the display.

5. The mobile terminal of claim 4, wherein the executing screen of the first application includes detailed information of the event related to the first application.

6. The mobile terminal of claim 1, wherein the controller is further configured to:

display a lock screen on the display, and

if the proximity of the object is sensed through the proximity sensor,

activate an interface for receiving security information for releasing the lock screen.

7. The mobile terminal of claim 1, wherein the controller is further configured to:

display a lock screen on the display, and

if the proximity of the object is sensed through the proximity sensor, output only audio data corresponding to information of a preset event among multiple events.

8. The mobile terminal of claim 1, wherein the controller is further configured to:

in response to the output of the audio data starting, activate a touch sensor of the display,

in response to a touching of a preset region of the display while the audio data is output, pause the output of the audio data, and

in response to a touch release of the preset region of the display, resume the output of the audio data by starting with a timing point of pausing the output of the audio data.

9. The mobile terminal of claim 1, wherein the controller is further configured to:

if the proximity of the object is sensed through the proximity sensor while first audio data corresponding to information of a first event among multiple events is output through the audio output unit, stop the output of the first audio data, and

in response to the output of the first audio data being stopped, and the proximity of the object again being sensed, output second audio data through the audio output unit corresponding to information of a second event different from the first event among the multiple events.

10. The mobile terminal of claim 2, wherein the controller is further configured to:

output the audio data corresponding to the converted text through the audio output unit,

if the proximity of the object is sensed through the proximity sensor while outputting the audio data corresponding to the text or after outputting the audio data corresponding to the text,

re-obtain a voice signal through the microphone,

convert the re-obtained voice signal into second text, and

execute a function of an application corresponding to the converted second text.

11. The mobile terminal of claim 10, wherein the controller is further configured to output audio data through the audio output unit indicating a cancellation of executing the function of the application corresponding to the text converted from the obtained voice signal.

12. The mobile terminal of claim 1, wherein the collected information of the event comprises at least one of information corresponding to a call signal received during the standby mode, information corresponding to text message received during the standby mode, information corresponding to an SNS message received during the standby mode, a nearby environment notification information based on a location information of the mobile terminal, information based on a current time, information based on the location information of the mobile terminal, a recommended content information based on information of a user of the mobile terminal, or a recommended content information based on a use pattern of the mobile terminal.

13. The mobile terminal of claim 12, further comprising:

a microphone; and

a memory configured to store information of text having a positive meaning and information of text having a negative meaning,

wherein if the proximity of the object is sensed through the proximity sensor, the controller is further configured to;

activate the microphone,

obtain a voice signal through the microphone while an output of first audio data corresponding to information of a first event among multiple occurring events,

convert the obtained voice signal into text, determine whether the converted text corresponds to the positive meaning or the negative meaning based on the information saved in the memory, and

map a determination result of the text to the first event in the memory.

14. The mobile terminal of claim 13, wherein in response to the converted text being determined as having the positive meaning, the controller is further configured to increase a recommendation rate of a recommended content corresponding to the information of the first event.

15. The mobile terminal of claim 13, wherein in response to the converted text being determined as having the negative meaning, the controller is further configured to decrease a recommendation rate of a recommended content corresponding to the information of the first event.

16. A method of controlling a mobile terminal, the method comprising:

sensing, via a proximity sensor, proximity of an object;

deactivating, via a controller of the mobile terminal, a display of the mobile terminal, and enter the mobile terminal into a standby mode while maintaining the proximity sensor in an activated state; and

if the proximity of the object is sensed through the proximity sensor, outputting audio data through an audio output unit while the display is deactivated corresponding to information collected about a previous event that occurred on the mobile terminal.

17. The method of claim 16, further comprising:

if the proximity of the object is sensed through the proximity sensor, activating the microphone, obtaining a voice signal through the microphone, converting the voice signal into text, and executing a function of an application corresponding to the converted text.

18. The method of claim 17, wherein in response to the voice signal being input while the audio data is output through the audio output unit, preferentially processing, via the controller, the voice signal more than the audio data.

19. The method of claim 16, further comprising:

outputting first audio data related to a first application through the audio output unit corresponding to the information collected about the event; and

if the proximity of the object is sensed through the proximity sensor, activating the display and displaying an executing screen of the first application on the display.

20. The method of claim 19, wherein the executing screen of the first application includes detailed information of the event related to the first application.