Display Device, Method for Thereof and Voice Recognition System

• US 20120316876A1
• Filed: 09/23/2011
• Published: 12/13/2012
• Est. Priority Date: 06/10/2011
• Status: Abandoned Application

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Jang, Seokbok, Park, Jongse, Lee, Joonyup, Choi, Jungkyu
• Application Number:
  US13/241,426
• Publication Number:
  US 20120316876A1
• Time in Patent Office: Days
• US Class Current: 704/246
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/00 Speech recognition G10L17/00 takes precedence
• CPC Class Codes: G10L 17/00 Speaker identification or verification techniques
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/4415 using biometric characteristics of the user, e.g. by voice recognition or fingerprint scanning cryptography using biological data H04L9/3231; authentication in networks using biometric H04L63/0861
• CPC Class Codes: H04N 21/4751 for defining user accounts, e.g. accounts for children
• CPC Class Codes: H04N 21/482 End-user interface for program selection broadcast systems using EPGs H04H60/72
• CPC Class Codes: H04N 21/4882 for displaying messages, e.g. warnings, reminders arrangements for providing short real-time information to substation in data switching networks H04L12/1895

Abstract

A display system, a display device, a control method for the display device, and a voice recognition system are disclosed. A display device according to one embodiment of the present invention can carry out voice recognition upon a voice received from at least one speaker through at least one voice input device; and display the voice recognition result on the display unit. Accordingly, effective voice recognition is made possible for TV environments where various constraints exist differently from mobile terminal environments.

Claims

1. A display system having a display device, the display device comprising:

a display unit;

a voice information receiving unit; and

a control unit configured to receive voice information from the voice information receiving unit, determine a speaker identity based on the voice information, and display a speaker indicator on the display unit corresponding to the speaker identity.

2. The display system of claim 1, wherein if the voice information receiving unit receives voice information from multiple speakers, the control unit is configured to determine the speaker identity according to a predetermined criterion and display the speaker indicator for identifying the speaker identity on the display unit.

3. The display system of claim 2, further comprising a database storing a reference voice pattern for each of a plurality of speakers, and the control unit is configured to determine the speaker identity by comparing a voice pattern of a speaker input through the voice information receiving unit with each reference voice pattern of the plurality of speakers and display the speaker indicator according to the speaker identity on the display unit.

4. The display system of claim 3, wherein the speaker indicator comprises at least one of text, image, tactile method, and sound signal for identifying the speaker.

5. The display system of claim 3, further comprising at least one voice input device to receive a first voice information from the speaker and transmit second voice information to the voice information receiving unit of the display device.

6. The display system of claim 5, further comprising a plurality of voice input devices, wherein the control unit is configured to display an input device indicator for identifying which of the plurality of voice input devices is receiving the first voice information on the display unit along with the speaker indicator.

7. The display system of claim 3, wherein when the voice pattern of the speaker input through the voice information receiving unit does not match any of the reference voice patterns of the plurality of speakers, the control unit is configured to display an indicator on the display device.

8. The display system of claim 2, wherein the speaker indicator includes a dynamic indicator and the control unit is configured to control motion of the dynamic indicator while the voice information is being received through the voice information receiving unit.

9. The display system of claim 2, wherein the speaker indicator includes a dynamic indicator and the control unit is configured to recognize location of a speaker and change a pointing direction of the speaker indicator according to the location of the speaker.

10. The display system of claim 9, further comprising a camera, wherein the control unit is configured to control the speaker indicator to point toward the location of the speaker in response to a particular gesture motion of the speaker obtained through the camera.

11. The display system of claim 2, further comprising a database storing a user profile including at least one of a voice pattern of a speaker, an image for speaker identification, a user ID, sex, age, and preferred item, wherein the control unit is configured to display the user profile of the speaker based on the voice information.

12. The display system of claim 5, wherein the at least voice input device is a wired or wireless device, including one of a mobile terminal, a smart phone, a game device, a remote control, a microphone installed inside the display device, and a microphone array.

13. The display system of claim 3, further comprising a first voice input device and a second voice input device, wherein the control unit is configured to determine reliability of the speaker identity by taking into account a signal strength of voice information received through the first voice input device and if a strength of voice information received through the second voice input device is below a predetermined threshold value, display an indicator recommending use of the first voice input device on the display unit.

14. The display system of claim 13, wherein the control unit is further configured to display location information of the first voice input device on the display unit.

15. The display system of claim 13, wherein the control unit is further configured to display an indicator representing the signal strength of the voice information received through at least one of the first and second voice input devices on the display unit.

16. The display system of claim 13, wherein the control unit is further configured to display an indicator for identifying noise status according to strength of noise collected through at least one of the first and second voice input devices on the display unit.

17. The display system of claim 16, wherein the control unit, if the strength of noise is above a predetermined threshold value, is configured to display an indicator notifying of unavailability of a voice input device in current use on the display unit.

18. A control method for a display device, comprising:

receiving voice information through a voice information receiving unit;

determining a speaker identity based on the voice information; and

displaying a speaker indicator on a display unit corresponding to the speaker identity.

19. The method of claim 18, if the voice information receiving unit receives voice information from multiple speakers, determining the speaker identity according to a predetermined criterion;

and

displaying the speaker indicator for identifying the speaker identity on the display unit.

20. The method of claim 19, wherein the step of determining the speaker identity comprises comparing a voice pattern of a speaker received through the voice information receiving unit with stored reference voice patterns;

and

displaying the speaker indicator according to the speaker identity on the display unit.

21. The method of claim 19, further comprising receiving voice information through the voice information receiving unit transmitted from at least one a plurality of voice input devices, wherein the step of displaying the speaker indicator comprises displaying an input device indicator for identifying which of the plurality of voice input devices is receiving the speaker'"'"'s voice on the display unit along with the speaker indicator.

22. The method of claim 19, wherein the step of displaying the speaker indicator comprises controlling motion of the speaker indicator while the voice information is received through the voice information receiving unit.

23. The method of claim 20, further comprising, when the voice pattern of the speaker input through the voice information receiving unit does not match any of the stored reference voice patterns, displaying an indicator on the display unit.

24. The method of claim 19, wherein the step of displaying the speaker indicator comprises recognizing location of a speaker;

and

changing a pointing direction of the speaker indicator according to the location of the speaker.

25. The method of claim 19, wherein the step of displaying the speaker indicator comprises:

recognizing a location of a speaker through a camera;

obtaining a particular gesture motion of the speaker through the camera; and

controlling the speaker indicator to point toward the location of the speaker in response to the gesture motion.

26. The method of claim 19, further comprising:

setting, based on the speaker identity, a user profile including at least one of a voice pattern of a speaker, an image for speaker identification, a user ID, sex, age, and preferred item; and

displaying the user profile corresponding to the speaker identity on the display unit.

27. The method of claim 21, wherein at least one of the plurality of voice input devices is a wired or wireless device, including one of a mobile terminal, a smart phone, a game device, a remote control, a microphone installed inside the display device, and a microphone array.

28. The method of claim 21, wherein, if strength of a voice signal received through a first voice input device is below a predetermined threshold value, an indicator recommending use of a second voice input device is displayed on the display unit.

29. The method of claim 28, further comprising displaying location information of the first voice input device on the display unit.

30. The method of claim 28, further comprising displaying an indicator representing receive sensitivity of the voice signal on the display unit.

31. The method of claim 28, further comprising displaying an indicator for identifying noise status according to strength of noise collected through at least one of the first and second voice input devices on the display unit.

32. The method of claim 31, further comprising, if the strength of noise is above a predetermined threshold value, displaying an indicator notifying of unavailability of a voice input device in current use on the display unit.