Screen-less remote voice or tone-controlled computer program operations via telephone set

• US 5,950,167 A
• Filed: 01/26/1998
• Issued: 09/07/1999
• Est. Priority Date: 01/26/1998
• Status: Expired due to Term

• Current Assignee: WSOU Investments, LLC (WSOU Holdings, LLC)
• Original Assignee: Lucent Technologies, Inc. (Nokia Corporation)
• Inventors: Yaker, Rhoda
• Primary Examiner(s): Dorvil, Richemond
• Assistant Examiner(s): Smits, Talivaldis Ivars
• Application Number:
  US09/013,665
• Time in Patent Office: 589 Days
• Field of Search: 704/235, 704/270, 704/275
• US Class Current: 704/275
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G10L 2015/228 of application context
• CPC Class Codes: H04M 1/247 Telephone sets including user guidance or feature selection means facilitating their use user interfaces specially adapted for cordless or mobile telephones H04M1/724
• CPC Class Codes: H04M 1/271 controlled by voice recognition

Abstract

Computer programs such as word processing, spreadsheet and electronic mail are run from a remote telecommunications terminal, without benefit of any user interaction with a screen display, by software associated with the computer that translates a combination of remotely-generated tone and voice signals to executable application program commands. The communication protocols use a conversant system'"'"'s query-response sequences to call up an application and to run selected portions of the program. Pre-recorded voiceprints of a particular user'"'"'s voice commands and utterances required to operate the software are stored at the computer; and compared during usage to the actual utterances. Insufficient matches result in suspension or termination of access.

Claims

1. A process for enabling a remote user to operate application programs in a personal computer from a remote telecommunications terminal having a tone keypad through a connecting communications network without benefit of any user interaction with a screen display for controlling said application programs, said personal computer comprising:

a processor;

an internal memory;

a machine-readable medium;

one or more application programs contained in said memory;

a voice command system comprising;

a voice recognition unit;

a voice/text converter comprising;

software for converting voice commands to corresponding application program-specific commands and for converting coded text to voice; and

a controller connecting said personal computer and said voice command system to a network and comprising software for translating tone signals to application program-specific commands, said process comprising the steps of;

transmitting user-entered tone and voiced signals from said terminal to said controller, said tone and voiced signals corresponding to application-specific commands including commands to load a selected application program from said memory to said machine-readable medium;

receiving in said controller said tone and voiced signals and converting said signals in said converter to said corresponding application-specific commands;

said signals including commands to forward a file in said computer to selected destinations including a printer, a copier, a fax machine or an email address;

executing said commands in said processor under control of said controller to perform application program functions;

prompting said user with voiced queries contained in said voice command system to issue sequenced commands, and with voiced announcements of completed command executions; and

interrupting said sequenced commands from said voice command system with one or more unsequenced user-selected voice commands issued from said remote terminal to invoke new application program functions.

2. A process in accordance with claim 1, wherein

said application program is a word processor;

and said process comprises the further steps of;

designating from said remote telecommunications terminal by user-entered voice or tone identifier a first voiced text element, and transmitting said identifier with said text element to said voice command system;

receiving and storing in said voice-text file converter of said voice command system said first text element and the associated said unique identifier;

modifying said first text element by transmitting from said remote telecommunications terminal said identifier followed by a substitute text element; and

using said identifier, replacing in said voice-text file converter said first text element with said substitute text element.

3. A process in accordance with claim 2, wherein said sequence of voiced prompts and user responses further comprises:

transmitting to said voice command system a user-generated voice or tone command for ordering read-back of designated voice text; and

receiving in said voice command system said read-back command, and in response transmitting back to said user said designated voice text.

4. A process in accordance with claim 1, wherein said application program is a spreadsheet;

and wherein said step of generating a sequence of voiced prompts and user responses further comprises;

designating by user-entered voice or tone command a given cell in said spreadsheet; and

transmitting to said voice-text file converter by user-entered voice command an entry or a modification of a numeric, label, or formula value for said designated cell.

5. A process in accordance with claim 4, wherein said generating of a sequence of voiced prompts and user responses comprises the further step of:

commanding by user-entered voice or tone instructions a read-back of numeric, label or formula values entered in a designated said cell.

6. A process in accordance with claim 3 or claim 5, wherein said controller further comprises an access-limiting unit for receiving an access code from said remote user and for connecting said user to said computer upon verifying that said access code is valid;

said access-limiting unit further comprising an access table locally programmable to restrict remote use of specified application program functionalities;

and said process comprises said user taking the further steps of;

issuing said access code from said remote terminal to enable said personal computer; and

setting permitted and prohibited program functionalities into said access table by remotely-generated commands.

7. A process in accordance with claim 6, wherein said voice recognition unit further comprises:

a word store containing a plurality of selected pre-recorded word voiceprints entered by said user, said selected words comprising voiced commands and prompt responses employed by a user in remotely running said selected application program;

and wherein said process comprises the further steps of;

monitoring continuing voiced transmissions of said remote user,

flagging uses of said pre-recorded words; and

comparing each said flagged word with its corresponding word voiceprint to determine the degree of match.

17. A non-volatile storage medium in accordance with claim 1, wherein said application program is a word processor, and said medium further comprises:

a set of computer instructions enabling said remote user to enter in said word processor voiced text elements and an associated voice or tone signal that uniquely identifies each said text element; and

a set of computer instructions for using said unique text element identifier to designate voiced text intended by said user to replace said text element.

18. A non-volatile storage medium in accordance with claim 17, further comprising:

a set of computer instructions responsive to a voiced remote user command for reading back in voice mode text entered by voice.

8. A personal computer comprising a processor, an internal memory, a machine-readable medium, one or more

application programs contained in said internal memory for loading into said machine-readable medium, a modem for connecting said personal computer to an external network, and apparatus for enabling, through a combination of tone signals and voice commands, operation by a user of said one or more application programs from a remote telephone set connected to said network without benefit of any user interaction with a screen display for controlling said application programs, said apparatus comprising:

a voice command system comprising;

a memory containing application program-specific voiced prompts; and

means for translating incoming voice signals to corresponding application program-specific commands;

a voice/text converter comprising means for translating text files to voiced words;

means for generating a first voiced prompt requesting said user to select an application program for opening;

means for generating a sequence of further voiced prompts to said user enabling said user to respond to each said prompt in sequence by voice or by tone signal with selected commands to run said opened application program; and

means for responding to any said application program-specific command made by said user out-of-sequence.

9. A personal computer in accordance with claim 8, further comprising a controller connecting said voice command system and said personal computer to said network, said controller comprising:

means responsive to dial-up of said modem by a remote user for turning said computer on;

an access-limiting unit for receiving an access code from said remote user and for connecting said user to said computer upon verifying that said access code is valid;

means for translating tone signals entered by said user through said telephone set into their corresponding application program-specific commands;

means for transmitting said application program-specific commands to said computer for execution; and

means responsive to tone or voice commands for forwarding a file in said computer to selected destinations including a printer, a copier, a fax machine or an email address.

10. A personal computer in accordance with claim 9, wherein said application program is a word processor;

and wherein said voice command system further comprises;

means for associating a voice or tone signal with individual text elements entered by user voice, to uniquely identify each said element; and

means for receiving further text elements entered by voice accompanied by said unique identifier, and for substituting said further text elements for the previously-transmitted said text elements having the same said unique identifier.

11. A personal computer in accordance with claim 10, wherein said sequence of voiced prompts in said voice command system includes prompts enabling said user to command a voice read-back of text earlier entered in voice by said remote user.

12. A personal computer in accordance with claim 9, wherein said application program is a spreadsheet;

and said voice command system further comprises;

voice prompts and user responses for pointing to any cell in said spreadsheet; and

means responsive to voiced commands from said remote user for entering or modifying the contents of a said pointed cell.

13. A personal computer in accordance with claim 12, wherein said voice command system further comprises:

voiced prompts and user responses for commanding read-back of labels, numeric values or formulae content entered in a said pointed cell.

14. A personal computer in accordance with claim 11 or claim 13, wherein said access-limiting unit further comprises:

means for storing preset permissions for designated users to use said application programs; and

an access table for containing restriction settings which block remote use of specified application program functionalities; and

means for allowing a designated user to re-set said restriction settings by voice command issued from a remote location.

15. A personal computer in accordance with claim 14, wherein said voice command system further comprises:

a word store containing space for storing a plurality of selected pre-recorded word voiceprints to be created by a specific said user,

said selected words comprising voiced commands and prompt responses frequently used in remotely running said selected application program;

means for monitoring continuing voiced transmissions of said remote user and for flagging uses of any said pre-recorded words in said word store;

means for comparing each said flagged word with its corresponding word voiceprint; and

means for suspending or terminating connection to said remote user if said comparing means detects an insufficient match.

16. A non-volatile storage medium containing computer software encoded in a machine-readable format for enabling a user to remotely control from a telephone set over a telecommunications network application programs in a personal computer without benefit of any user interaction with a screen display for controlling said application programs, said personal computer comprising:

a processor;

application programs stored in an internal memory of said personal computer,

a voice command system; and

a controller connecting said personal computer to said network through a modem and having an access-limiting unit, said computer software comprising;

a set of computer instructions executed in said voice command system for generating a first voiced prompt requesting said user to select an application program to be opened, and thereafter for generating a predetermined sequence of voiced prompts guiding said user to issue by voice or by tone signals a pre-set sequence of commands to run application program functions;

a set of computer instructions for receiving said voiced and tone signals and for converting said signals to corresponding application program-specific commands;

a set of computer instructions for transmitting said application program-specific commands to said processor to perform application program functions;

a set of computer instructions for informing said user with voiced announcements of completed command executions;

a set of computer instructions responsive to tone or voice commands to forward a file in said computer to pre-selected destinations; and

a set of computer instructions executed in said voice command system for overriding execution of said pre-set sequence of commands, upon receipt from said user of one or more user-selected voice commands which invoke out-of-sequence application program functions.

19. A non-volatile storage medium in accordance with claim 16, wherein said application program is a spreadsheet comprising a plurality of cells;

and wherein said storage medium further comprises;

a set of computer instructions responsive to voice signals for pointing to any said cell in said spreadsheet; and

a set of computer instructions responsive to voiced commands from said remote user for entering or modifying a numeric value, formulaic statement or label in a said pointed cell.

20. A non-volatile storage medium in accordance with claim 19, further comprising:

a set of computer instructions responsive to voiced commands from said remote user for generating voice read-back of labels, numeric values or formulae entered in a said pointed cell.

21. A non-volatile storage medium in accordance with claim 16, further comprising:

a set of computer instructions responsive to dial-up of said modem by a remote user for activating said access-limiting unit;

a set of computer instructions for receiving an access code from said remote user and for connecting said user to said computer upon verifying that said access code is valid;

a set of computer instructions for creating an access table in said access-limiting unit, said access table governing access to said personal computer on which said non-volatile storage medium is used; and

a set of computer instructions enabling a user to enter restriction settings into said table which block remote use of user-selected application program functions.

22. A non-volatile storage medium in accordance with claim 16 or claim 21, further comprising:

a word store containing space for storing a plurality of selected pre-recorded word voiceprints of said user,

said selected words comprising voiced commands and prompt responses used most frequently in remotely running said selected application program;

a set of computer instructions for monitoring continuing voiced transmissions of said remote user and for flagging uses of any said words for which corresponding voiceprints are pre-recorded in said word store;

a set of computer instructions for making voiceprints of said flagged words and for comparing each said flagged word voiceprint with the corresponding word voiceprint in said word store; and

a set of computer instructions for suspending or terminating said remote usage of a running application program if said comparing step detects an insufficient match.