Scripting support for data identifiers, voice recognition and speech in a telnet session

• US 10,148,734 B2
• Filed: 03/27/2017
• Issued: 12/04/2018
• Est. Priority Date: 08/16/2007
• Status: Active Grant

• Current Assignee: Ivanti, Inc. (Ivanti Software, Inc.)
• Original Assignee: Ivanti, Inc. (Ivanti Software, Inc.)
• Inventors: Van Wagenen, Lamar John, Thomsen, Brant David, Caddes, Scott Allen
• Primary Examiner(s): He, Jialong
• Application Number:
  US15/470,123
• Publication Number:
  US 20180048699A1
• Time in Patent Office: 617 Days
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2015/228 of application context
• CPC Class Codes: H04L 67/08 specially adapted for terminal emulation, e.g. Telnet
• CPC Class Codes: H04L 67/14 Session management for real-time applications in data packet communications networks H04L65/1066

Abstract

Methods of adding data identifiers and speech/voice recognition functionality are disclosed. A telnet client runs one or more scripts that add data identifiers to data fields in a telnet session. The input data is inserted in the corresponding fields based on data identifiers. Scripts run only on the telnet client without modifications to the server applications. Further disclosed are methods for providing speech recognition and voice functionality to telnet clients. Portions of input data are converted to voice and played to the user. A user also may provide input to certain fields of the telnet session by using his voice. Scripts running on the telnet client convert the user'"'"'s voice into text and is inserted to corresponding fields.

Claims

1. A non-transitory processor-readable medium storing code representing instructions to be executed by a processor, the code comprising code to cause the processor to:

establish, at a telnet client, a telnet session with a server;

receive, from the server via the telnet session, data associated with a plurality of input fields;

generate speech based on the data;

present the speech to a user;

receive, after the presenting the speech to the user, a voice input from the user;

determine, based on the data, a set of allowed inputs associated with an input field from the plurality of input fields;

convert the voice input to text input based on the set of allowed inputs such that the text input includes an input from the set of allowed inputs; and

send the text input to the server via the telnet session.

2. The non-transitory processor-readable medium of claim 1, wherein the code further comprises code to cause the processor to detect, in the data, information including:

(i) text displayable on a screen associated with the telnet client, (ii) a set of input fields from the plurality of input fields displayable on the screen, (iii) a state of the telnet session, and (iv) a location of a cursor on the screen,

the code to cause the processor to generate the speech includes code to cause the processor to generate the speech based on the information detected in the data.

3. The non-transitory processor-readable medium of claim 1, wherein the code further comprises code to cause the processor to:

associate, for each input field from the plurality of input fields, a data identifier with that input field;

associate the text input with the input field from the plurality of input fields based on the data identifier associated with that input field; and

send information indicating the input field to the server via the telnet session.

4. The non-transitory processor-readable medium of claim 1, wherein the code further comprises code to cause the processor to process the text input by:

(i) parsing the text input, (ii) removing a first character from the text input, or (iii) adding a second character to the text input.

5. The non-transitory processor-readable medium of claim 1, wherein the code to cause the processor to convert the voice input to the text input includes code to cause the processor to convert the voice input to the text input based on voice information associated with the user.

6. The non-transitory processor-readable medium of claim 1, wherein the code to cause the processor to generate speech based on the data includes code to cause the processor to send a first instruction to a text-to-speech component such that the first instruction, when received by the text-to-speech component, causes the text-to-speech component to generate the speech based on the data, and

the code to cause the processor to convert the voice input to the text input includes code to cause the processor to send a second instruction to a voice recognition component such that the second instruction, when received by the voice recognition component, causes the voice recognition component to generate the text input based on the voice input and the data.

7. An apparatus, comprising:

a memory; and

a processor operatively coupled to the memory, the processor configured to;

establish, at a telnet client, a telnet session with a server;

receive, from the server via the telnet session, data associated with a plurality of input fields;

associate, for each input field from the plurality of input fields, a data identifier with that input field;

receive a voice input from a user;

determine, based on the data, a set of allowed inputs associated with an input field from the plurality of input fields;

convert the voice input to text input based on the set of allowed inputs such that the text input includes an input from the set of allowed inputs;

associate the text input with the input field from the plurality of input fields based on the data identifier associated with the input field; and

send the text input to the server via the telnet session.

8. The apparatus of claim 7, wherein the processor is further configured to:

detect, in the data, information including;

(i) text displayable on a screen associated with the telnet client, (ii) a set of input fields from the plurality of input fields displayable on the screen, (iii) a state of the telnet session, and (iv) a location of a cursor on the screen;

generate a voice instruction based on the information detected in the data; and

present the voice instruction to the user,

the processor configured to receive the voice input from the user after presenting the voice instruction to the user,

the processor configured to convert the voice input to the text input based on the information detected in the data.

9. The apparatus of claim 7, wherein the voice input is a first voice input, the processor further configured to:

generate a voice instruction based on the first voice input;

present the voice instruction to the user; and

receive a second voice input from the user after presenting the voice instruction to the user.

10. The apparatus of claim 7, wherein the processor is further configured to:

display, on a screen associated with the telnet client, a page associated with a set of input fields from the plurality of input fields; and

detect, on the screen, text on the page,

the processor configured to convert the voice input to the text input based on the text on the page.

11. The apparatus of claim 7, wherein the processor is further configured to:

display, on a screen associated with the telnet client, a page associated with a set of input fields from the plurality of input fields; and

detect, on the screen, information including;

(i) text on the page, (ii) a location of a cursor on the page, and (iii) a selected field from the set of input fields,

the processor configured to convert the voice input to the text input based on the information detected on the screen.

12. The apparatus of claim 7, wherein the processor is configured to convert the voice input to the text input by sending an instruction to a voice recognition component such that the instruction, when received by the voice recognition component, causes the voice recognition component to generate the text input based on the voice input.