TERMINAL AND HOME APPLIANCE SYSTEM INCLUDING THE SAME

• US 20160267910A1
• Filed: 03/09/2016
• Published: 09/15/2016
• Est. Priority Date: 03/13/2015
• Status: Active Grant

• Current Assignee: Dentons US LLP (Dentons Rodyk & Davidson LLP)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: SONG, Jihyun, LEE, Juwan, SEO, Daegeun, KIM, Lagyoung
• Granted Patent: US 10,573,302 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G08C 17/02 using a radio link
• CPC Class Codes: G08C 2201/42 Transmitting or receiving remote control signals via a network
• CPC Class Codes: G08C 2201/93 Remote control using other portable devices, e.g. mobile phone, PDA, laptop
• CPC Class Codes: G10L 15/00 Speech recognition G10L17/00 takes precedence
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: H04L 12/282 based on user interaction within the home receiver circuitry for displaying additional information being controlled by a remote control apparatus H04N21/42204

Abstract

A terminal includes a microphone, a display, an audio output module, a communication unit to exchange data with a server or a home appliance, and a controller to control display of a screen including information related to the home appliance and to control output of information corresponding to user voice based on the information related to the home appliance on the screen via the display or the audio output module when the user voice is received via the microphone. Therefore, it is possible to improve user convenience upon utilizing the home appliance.

Claims

1. A terminal comprising:

a microphone;

a display;

an audio output module;

a communication unit to exchange data with a server or a home appliance; and

a controller to control display of a screen including information related to the home appliance and to control output of information corresponding to user voice based on the information related to the home appliance on the screen via the display or the audio output module when the user voice is received via the microphone.

2. The terminal according to claim 1, wherein the controller controls extraction of the information corresponding to the user voice when the user voice is received via the microphone in a state of displaying the screen including the information related to the home appliance, and output of the extracted information via the display or the audio output module.

3. The terminal according to claim 1, wherein the controller controls reception of the information related to the home appliance from the server and display of the screen including the received information related to the home appliance.

4. The terminal according to claim 1, wherein the controller controls accessing of a web page related to the home appliance, display of a web page screen and output of information corresponding to the user voice on the web page screen via the display or the audio output module when the user voice is received via the microphone.

5. The terminal according to claim 1, wherein the controller controls execution of an application related to the home appliance according to input for executing the application related to the home appliance, display of an application screen related to the home appliance, and output of information corresponding to the user voice on the application screen via the display or the audio output module when the user voice is received via the microphone.

6. The terminal according to claim 2, wherein the controller controls transmission of the extracted information to the home appliance via the communication unit.

7. The terminal according to claim 1, wherein the controller controls display of a web page screen or application screen related to cooking methods of a cooker as the home appliance, extraction of information related to a material from text included in the web page screen or application screen when sound related to the material among the cooking methods is received via the microphone, and output of the extracted information related to the material.

8. The terminal according to claim 2, wherein:

the screen includes images and text, and

the controller analyzes the text included in the screen and extracts information corresponding to the user voice from the text included in the screen.

9. The terminal according to claim 1, wherein the controller controls display of a web page screen or application screen related to cooking methods of a cooker as the home appliance, extraction of information related to a cooking time or cooking pattern from text included in the web page screen or application screen when sound related to the cooking time or cooking pattern of the cooker among the cooking methods is received via the microphone, and output of the extracted information related to the cooking time or cooking pattern.

10. The terminal according to claim 1, wherein the controller controls display of a web page screen or application screen related to purchase of the home appliance, extraction of information related to a price of the home appliance from text included in the web page screen or application screen when sound related to the price of the home appliance is received via the microphone, and output of the extracted information related to the price.

11. The terminal according to claim 1, wherein the controller controls display of a web page screen or application screen related to an operation method of the home appliance, extraction of information related to an operation time or operation pattern from text included in the web page screen or application screen when sound related to the operation time or operation pattern of the home appliance is received via the microphone, and output of the extracted information related to the operation time or operation pattern.

12. A home appliance system comprising:

a home appliance;

a terminal to display a screen including information related to the home appliance and to output information corresponding to user voice based on the information related to the home appliance on the screen via a display or an audio output module or to transmit the information corresponding to the user voice to the home appliance when the user voice is received via a microphone; and

the home appliance to perform operation based on the information received from the terminal.

13. The home appliance system according to claim 12, wherein the terminal extracts the information corresponding to the user voice when the user voice is received via the microphone in a state of displaying the screen including the information related to the home appliance and outputs the extracted information via the display or the audio output module.

14. The home appliance system according to claim 12, wherein the terminal accesses a web page related to the home appliance to display a web page screen and outputs information corresponding to the user voice on the web page screen via the display or the audio output module.

15. The home appliance system according to claim 12, wherein the terminal executes an application related to the home appliance according to input for executing the application related to the home appliance, displays an application screen related to the home appliance, and outputs information corresponding to the user voice on the application screen via the display or the audio output module when the user voice is received via the microphone.

16. The home appliance system according to claim 12, wherein the terminal displays a web page screen or application screen related to cooking methods of a cooker as the home appliance, extracts information related to a material from text included in the web page screen or application screen when sound related to the material among the cooking methods is received via the microphone, and outputs the extracted information related to the material.

17. The home appliance system according to claim 12, wherein the terminal analyzes the text included in the screen and extracts information corresponding to the user voice from the text included in the screen.

18. The home appliance system according to claim 12, wherein the terminal displays a web page screen or application screen related to cooking methods of a cooker as the home appliance, extracts information related to a cooking time or cooking pattern from text included in the web page screen or application screen when sound related to the cooking time or cooking pattern of the cooker among the cooking methods is received via the microphone, and outputs the extracted information related to the cooking time or cooking pattern.

19. The home appliance system according to claim 12, wherein the terminal displays a web page screen or application screen related to purchase of the home appliance, extracts information related to a price of the home appliance from text included in the web page screen or application screen when sound related to the price of the home appliance is received via the microphone, and outputs the extracted information related to the price.

20. The home appliance system according to claim 12, wherein the terminal displays a web page screen or application screen related to an operation method of the home appliance, extracts information related to an operation time or operation pattern from text included in the web page screen or application screen when sound related to the operation time or operation pattern of the home appliance is received via the microphone, and outputs the extracted information related to the operation time or operation pattern.