Digital device and speech to text conversion processing method thereof

• US 10,204,439 B2
• Filed: 02/05/2015
• Issued: 02/12/2019
• Est. Priority Date: 02/27/2014
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Heo, Seunghyun, Kim, Kinam, Kim, Jisoo, Song, Hyung
• Primary Examiner(s): Rahman, Shawnchoy
• Application Number:
  US15/121,482
• Publication Number:
  US 20160357987A1
• Time in Patent Office: 1,468 Days
• CPC Class Codes: G06F 21/6281 at program execution time, where the protection is within the operating system
• CPC Class Codes: G06F 21/83 input devices, e.g. keyboards, mice or controllers thereof
• CPC Class Codes: G06F 2221/031 Protect user input by software means
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 40/174 Form filling; Merging
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 15/28 Constructional details of speech recognition systems
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/440236 by media transcoding, e.g. video is transformed into a slideshow of still pictures, audio is converted into text
• CPC Class Codes: H04N 21/4886 for displaying a ticker, e.g. scrolling banner for news, stock exchange, weather data
• CPC Class Codes: H04N 21/8126 involving additional data, e.g. news, sports, stocks, weather forecasts

Abstract

Disclosed in the present specification are a digital device and a speech to text conversion processing method thereof. The digital device and the speech to text conversion processing method thereof according to the present invention may comprise the steps of: activating a text input field; checking the attribute of the text input field; receiving a request for a speech to text (STT) conversion processing with respect to data to be inputted in the text input field; determining whether or not the attribute type of the text input field is a security attribute (sensitive attribute); and as a determination result, if the attribute type of the text input field is a security attribute, blocking the speech to text conversion processing.

Claims

1. A method of performing a speech-to-text (STT) processing in a digital device, comprising:

activating a text input field;

checking an attribute of the text input field;

receiving a request for the speech-to-text (STT) processing for data to be inputted to the text input field;

determining whether an attribute type of the text input field is a security attribute;

if the attribute type of the text input field is the security attribute as a result of the determination, blocking the STT processing; and

if the attribute type of the text input field is not the security attribute, receiving an external speech signal in response to the STT processing request, wherein the external speech signal is received in a microphone, further the external speech signal is processed and converted into electronic audio data in the microphone;

converting the electronic audio data into a text; and

displaying the converted text on the corresponding text input field.

3. The method of claim 1, further comprising the steps of:

receiving a request for adding a security attribute of the text input field; and

registering the added security attribute.

4. The method of claim 1, further comprising the steps of:

determining whether there is a setting request for an attribute type of the text input field;

if there is the setting request for an attribute type of the text input field, displaying an attribute registration window of the text input field;

determining whether at least one attribute included in the displayed attribute registration window of the text input field is selected;

if the at least one attribute is selected as a result of the determination, determining whether there is a type change request for the selected attribute;

if there is the type change request for the selected attribute, determining whether a type of the selected attribute is the security attribute; and

if it is not the security attribute as a result of the determination, changing the type of the selected attribute into the security attribute.

5. The method of claim 4, the determining whether the type of the selected attribute is the security attribute if there is the type change request for the selected attribute, comprising releasing the security attribute type of the selected attribute if the type is the security attribute as a result of the determination.

6. The method of claim 4, the determining whether at least one attribute included in the displayed attribute registration window of the text input field is selected, comprising:

if the at least one attribute is not selected as a result of the determination, determining whether it is an addition of a new security attribute; and

if it is the addition of the new security attribute, registering the added new security attribute.

7. The method of claim 1, the checking an attribute of the text input field, comprising:

checking all attributes included in the text input field;

determining whether a type of the checked all attributes is the security attribute; and

if the type of the all attributes is the security attribute as a result of the determination, blocking the STT processing.

8. The method of claim 7, comprising receiving the request for the STT processing for the data intended to be inputted to the text input field if the type of the all attributes is not the security attribute as a result of the determination.

9. The method of claim 1, the blocking the STT processing, comprising blocking the STT processing and displaying a block message related to the STT processing.

10. The method of claim 1, blocking the STT processing, comprising:

blocking the STT processing, displaying a block message related to the STT processing, and then displaying a query message related to a presence or non-presence of a release of the security attribute type of the text input field; and

if it is not the release of the security attribute type based on the query message, continuing the blocking of the STT processing.

11. The method of claim 10, the displaying the query message related to the presence or non-presence of the release of the security attribute type of the text input field, comprising if it is the release of the security attribute type based on the query message, displaying a release message of the security attribute type and releasing the blocking of the STT processing.

12. The method of claim 1, wherein the attribute type of the text input field comprises text, search, url, tel, email, password, datapicker, range, and color.

2. A method of performing a speech-to-text (STT) processing in a digital device, comprising:

activating a text input field;

checking an attribute of the text input field;

receiving a request for the speech-to-text (STT) processing for data to be inputted to the text input field;

determining whether an attribute type of the text input field is a security attribute;

if the attribute type of the text input field is the security attribute as a result of the determination, blocking the STT processing;

if the attribute type of the text input field is not the security attribute as a result of the determination, receiving an external speech signal in response to the STT processing request, wherein the external speech signal is received via a microphone, further the external speech signal is processed and converted into electronic audio data in the microphone;

transmitting electronic audio data to an external server;

receiving a conversion text for the electronic audio data from the external server; and

displaying the received conversion text on the corresponding text input field.

13. A digital device, comprising:

a display unit displaying a speech-to-text (STT) processed conversion text in a text input field; and

a controller comprising an IME (input method editor) processing unit and a speech-to-text (STT) processing unit coupled to die IME processing unit,

wherein the IME (input method editor) processing unit configured to check an attribute of the text input field, receive a request for speech-to-text (STT) processing for data to be inputted to the text input field, if an attribute type of the text input field is a security attribute, block the STT processing, and control the display unit to display the STT processed conversion text if the attribute type of the text input field is not the security attribute, and

the speech-to-text (ST) processing unit is configured to receive an external speech signal according to a control signal of the IME processing unit from a microphone, wherein the external speech signal is processed and converted into electronic audio data in the microphone,

further the STT processing unit is configured to forward a conversion text of the electronic audio data to the IME processing unit.

14. The digital device of claim 13, wherein the STT processing unit is further configured to transmit the electronic audio data for the received speech signal to an external server, receive the conversion text for the electronic audio data from the external server, and forward the received conversion text to the IME processing unit.

15. The digital device of claim 13, wherein the ST processing unit is further configured to convert the electronic audio data for the received speech signal into a text and forward the converted text to the IME processing unit.

16. The digital device of claim 13, wherein if receiving a request for a security attribute addition of the text input field, the IME processing unit is configured to register the added security attribute.

17. The digital device of claim 13, wherein when the attribute of the text input field is checked, if a type of the checked attribute is the security attribute, the IME processing unit blocks the STT processing.

18. The digital device of claim 13, wherein the IME processing unit blocks the STT processing and controls the display unit to display a block message related to the STT processing.

19. The digital device of claim 13, wherein the IME processing unit blocks the STT processing and controls the display unit to display a block message related to the STT processing and a query message related to a presence or non-presence of a release of the security attribute type of the text input field in order.