Display device and operating method thereof

• US 10,630,833 B2
• Filed: 12/21/2016
• Issued: 04/21/2020
• Est. Priority Date: 11/17/2016
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Hwang, Soonhyung, Kim, Sijin
• Primary Examiner(s): Wendell, Andrew
• Application Number:
  US16/344,609
• Publication Number:
  US 20200068059A1
• Time in Patent Office: 1,217 Days
• CPC Class Codes: G06F 16/9532 Query formulation
• CPC Class Codes: G06F 16/9537 Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2015/221 Announcement of recognition results
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: H04M 1/72412 using two-way short-range wireless interfaces
• CPC Class Codes: H04M 1/72466 with selection means, e.g. keys, having functions defined by the mode or the status of the device
• CPC Class Codes: H04M 2250/74 with voice recognition means voice activated dialling H04M1/271; voice recognition algorithms G10L15/00
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/43615 Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805
• CPC Class Codes: H04N 21/43637 involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11] arrangements for wireless networking or broadcasting of information in indoor or near-field type systems H04B10/114
• CPC Class Codes: H04N 21/4436 Power management, e.g. shutting down unused components of the receiver power management in computer systems G06F1/3203; hibernate or awake process in computer systems G06F9/4418
• CPC Class Codes: H04N 21/4828 for searching program descriptors retrieval of video data G06F16/739
• CPC Class Codes: H04W 4/16 Communication-related supplementary services, e.g. call-transfer or call-hold
• CPC Class Codes: H04W 4/80 Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
• CPC Class Codes: H04W 8/005 Discovery of network devices, e.g. terminals
• CPC Class Codes: H04W 84/12 WLAN [Wireless Local Area Networks]

Abstract

A display device according to an embodiment of the present invention may comprise: a short-range communication unit for receiving a search request signal from a mobile terminal making a telephone call; a control unit for obtaining a connection state with the mobile terminal as the search request signal is received, and receiving an audio signal from the mobile terminal if the control unit is connected to the mobile terminal; and a display unit for displaying a result of a search on the basis of the audio signal.

Claims

1. A display device comprising:

a short-range communication unit to receive a search request signal from a mobile terminal in a call;

a control unit to obtain a connection state with the mobile terminal in response to receiving the search request signal, and to receive a voice signal from the mobile terminal if being in connected state with the mobile terminal; and

a display unit to display a result searched based on the voice signal.

2. The display device of claim 1, further comprising:

a storage unit to store the result searched based on the voice signal,

wherein the control unit stores the searched result in the storage unit or transmits the searched result to the mobile terminal.

3. The display device of claim 1, wherein the display unit displays a sharing menu including an item to be transmitted to a calling party and an item to be selected from contacts and to be transmitted, and

wherein the control unit transmits the searched result to a party making the call with the mobile terminal or to any one of contacts stored in the mobile terminal, based on selected item from the sharing menu.

4. The display device of claim 1, wherein the control unit obtains at least one search word by analyzing the voice signal and performs a web-browser search, a map search or a search on the mobile terminal by using the search word.

5. The display device of claim 4, wherein the control unit performs, when a plurality of search words are obtained, a search using each of the plurality of search words and a search using combination of the plurality of search words.

6. The display device of claim 4, wherein the control unit splits a screen displayed on the display unit into a plurality of areas and displays a video which is being viewed, and the searched result on the plurality of areas that are split.

7. The display device of claim 6, wherein the control unit splits the screen displayed on the display unit into four areas and displays the video which is being viewed, a result of the web-browser search, a result of the map search, and a result of the search on the mobile terminal on the split areas.

8. The display device of claim 1, wherein the control unit receives a user voice signal and a voice signal of a calling party and displays the user voice signal and the voice signal of the calling party as captions, and displays the searched result based on a selected caption when receiving a command for selecting any one of the captions.

9. The display device of claim 2, wherein the control unit automatically stores the searched result in the storage unit when the call is terminated.

10. The display device of claim 9, wherein the control unit stores the searched result by matching the searched result with a calling party.

11. The display device of claim 1, wherein the search request signal is a voice signal including a preset keyword.

12. The display device of claim 11, wherein the keyword is set by default or arbitrarily set through a user input.

13. The display device of claim 1, wherein the control unit turns on power of the display device and displays that a search is possible in response to receiving the search request signal, when the power is turned off even through being in the connected state with the mobile terminal.

14. The display device of claim 1, wherein the control unit transmits a request signal for Bluetooth Low Energy (BLE) connection to the mobile terminal if being not in the connected state with the mobile terminal.

15. The display device of claim 14, wherein the control unit transmits the request signal for the BLE connection to the mobile terminal in response to receiving a command for selecting one button provided in a remote control device.