SYSTEM AND METHOD FOR PREDICTIVE DEVICE CONTROL

• US 20170186426A1
• Filed: 12/28/2015
• Published: 06/29/2017
• Est. Priority Date: 12/28/2015
• Status: Abandoned Application

• Current Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation), Toshiba Tec Corporation (Toshiba Corporation)
• Original Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation), Toshiba Tec Corporation (Toshiba Corporation)
• Inventors: Su, William, Zhang, Jenny
• Application Number:
  US14/981,208
• Publication Number:
  US 20170186426A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 40/35 Discourse or dialogue representation
• CPC Class Codes: G10L 15/1822 Parsing for meaning understanding
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command

Abstract

Document interfaces for control of operation of systems or devices can be cumbersome, and users must issue complete device instructions each time, often using interfaces that are not user friendly. A system and method for man-machine interfacing receives natural language input from one or more users. The natural langue input identified relative to a user, and passed to extract information such as instructions to control a device. Incoming user instructions are compared against prior instructions from the same user, and a determination is made as to whether prior information is usable in connection with the current instructions. The system thus anticipates a user'"'"'s needs based on prior activities of that user. Input from other devices associated with the same user, which can be used to gauge a user'"'"'s habits, can be used to further refine proposed device activity to enhance a user'"'"'s experience.

Claims

1. A device comprising:

a user interface;

a processor configured to process natural language input received via the user interface for each of a plurality of discrete user sessions,

the processor configured to identify users associated with each of the plurality of discrete user sessions, and

the processor configured to associate processed natural language input with identification data corresponding to each user associated therewith;

a language parser configured to extract instruction data from the processed natural language input;

a memory configured to store user input data corresponding to processed natural language input, the memory configured to store instruction data associated with identification data; and

an output configured to communicate an output instruction to control an associated device,

wherein the processor is further configured to compare instruction data stored in the memory from a prior user session with instruction data received from a subsequent user session for a common user, and

wherein the processor is further configured to generate the output instruction based on the comparison.

2. The device of claim 1 further comprising a microphone, and wherein the natural language input is comprised of user speech received by the microphone.

3. The device of claim 1 wherein the instruction data from the subsequent user session is comprised of a sequence of discrete user instructions,

wherein the processor is configured to generate a proposed output instruction prior to completion of the sequence,

wherein the processor is configured to generate a prompt to a user associated with the subsequent user session relative to the proposed output instruction,

wherein an input is configured to receive selection data from the user responsive to the prompt, and

wherein the processor configured to selectively communicate the proposed output instruction via the output in accordance with received selection data.

4. The device of claim 3 wherein the associated device is comprised of a document processing device configured to operate in accordance with a received output instruction.

5. The device of claim 4 wherein the processor is configured to generate statistical data corresponding to a plurality of prior user sessions for the common user, and wherein the proposed output instruction is generated in accordance with the statistical data.

6. The device of claim 5 further comprising:

a network interface configured to receive device usage data associated with an identified user corresponding to that user'"'"'s prior operation of a remote device, and

wherein the processor configured to the proposed output instruction in accordance received device usage data.

7. The device of claim 6 wherein the network interface is configured to communicate the proposed output instruction to the remote device in accordance with the selection data.

8. The device of claim 5 wherein the processor is further configured to communicate a sequence of output instructions to the document processing device, and wherein the sequence of output instructions is derived from the plurality of prior user sessions.

9. A method comprising:

storing, in a memory, historical data corresponding to prior sequences of document processing device instructions, wherein historical data for each prior sequence is stored associatively with an identifier of an corresponding user;

receiving a sequence of document processing instructions from a current user into a document processing device controller during a user session;

identifying the current user;

comparing, in at least one processor associated with the controller, the sequence of instructions as they are received with historical data associated with the current user;

generating at least one proposed instruction as a result of the comparing;

generating a prompt to the current user corresponding to the proposed instruction;

receiving selection data corresponding to the prompt from the current user; and

generating a document processing device control signal in accordance with the selection data.

10. The method of claim 9 further comprising:

receiving voice input from the current user;

analyzing, via the at least one processor, received voice input during the user session;

identifying the current user in accordance with voice analysis during the user session; and

parsing, via the at least one processor, the voice input to determine the sequence of document processing device instructions contained therein as they are received during the user session.

11. The method of claim 9 further comprising:

receiving, via an associated network, device data corresponding to prior operation of at least one remote device by the current user; and

generating the at least one proposed instruction in accordance with received device data.

12. The method of claim 9 further comprising:

calculating statistical data from the historical data; and

generating the at least one proposed instruction in accordance with the statistical data.

13. A system comprising:

an input configured to receive identification data corresponding to an identity of an associated user;

an interface configured to receive a sequence of natural language instructions from an identified user;

a parser configured to sequentially parse received natural language instructions to form a corresponding sequence of device instructions;

a processor and associated memory,

the processor configured to analyze the sequence of device instructions relative to pre-stored sequences of device instructions associated with the identified user, and

the processor configured to generate a sequence of proposed instructions in accordance with an analysis;

a display configured to display data representative of the sequence of proposed instructions; and

an output configured to selectively send a selected sequence of proposed instructions to an associated device in accordance with a received user selection data,

wherein the input is further configured to receive the user selection data corresponding to acceptability of the sequence of proposed instructions.

14. The system of claim 13 wherein the interface is comprised of a microphone and a digitizer configured to digitize voice input to the microphone input to generate the natural language instructions.

15. The system of claim 13 wherein the interface is configured to receive the natural language instructions comprised of a digital text string.

16. The system of claim 13 further comprising:

a network interface configured to receive selection commands corresponding to selections made by the associated user in a previous operation of one or more of a plurality of network devices, and

wherein the processor is further configured to generate the proposed instructions in accordance with received selection commands.

17. The system of claim 16 wherein the selection commands are comprised of selections associated with operation of a home appliance by the associated user.

18. The system of claim 13 further comprising:

an interface configured to receive position information corresponding with a location of the associated user, and

wherein the processor is configured to generate the proposed instructions in accordance with the position information.

19. The system of claim 13 further comprising:

an interface configured to receive purchasing information corresponding with purchases made by the associated user, and

wherein the processor is configured to generate the proposed instructions in accordance with the purchasing information.

20. The system of claim 19 wherein the purchasing information corresponds to costs associated with document processing device operation.