Method and system for robot understanding, knowledge, conversation, volition, planning, and actuation

• US 9,710,763 B2
• Filed: 06/18/2013
• Issued: 07/18/2017
• Est. Priority Date: 06/27/2012
• Status: Active Grant

• Current Assignee: Michael S.P. Miller, Sheldon O. Linker, Toni M. Poper
• Original Assignee: Michael S.P. Miller, Sheldon O. Linker, Toni M. Poper
• Inventors: Linker, Sheldon O., Miller, Michael S. P., Poper, Toni M.
• Primary Examiner(s): ZARROLI, MICHAEL C
• Application Number:
  US13/921,093
• Publication Number:
  US 20140006320A1
• Time in Patent Office: 1,491 Days
• CPC Class Codes: G06F 40/40 Processing or translation of natural language natural language analysis G06F40/20; semantic analysis G06F40/30
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06N 5/02 Knowledge representation; Symbolic representation
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: Y10S 901/03 Teaching system

Abstract

A system for understanding and storing knowledge and plans in a speakable, formal class of languages, allowing querying and retrieving of that knowledge and plan (conversation), and of deciding and acting (volition) upon such plans is provided. The system further allows the users to input data, instructions, questions, queries, imperatives, and plans without structure or rules over and above the actual grammar of the class of languages. The system responds in words, phrases, complete sentences, or actions, as applicable, and its output is bound by the rules of logic, rather than correlation or likely meaning.

Claims

1. A method operational in a processing device, comprising:

inputting data into a physical user interface in a language having a defined set of nonambiguous grammar rules, wherein the language includes at least one of;

an artificial language or a subset of a natural language and wherein the input data is input from one or more of;

a plurality of users or a plurality of sensors;

comparing by a processing device the input data with previously stored data in a data/knowledge/plan base according to logic operations to determine the input data is an imperative, wherein the data/knowledge/plan base stores knowledge and instructions for the plurality of users or for a plurality of actuators;

maintaining and storing by the processing device a plurality of distinct logical units for different ones of the plurality of users or for different ones of the plurality of actuators; and

determining by the processing device to execute the imperative based on at least one of the plurality of distinct logical units;

storing the imperative in an execution queue;

executing the imperative; and

reporting logic of the at least one of the plurality of distinct logical units to the user interface.

2. The method of claim 1, further comprising:

initiating by the processing device execution of a first action in response to the imperative for a first one of the plurality of users associated with a first distinct reality and execution of a second different action in response to the imperative for a second one of the plurality of users associated with a second distinct reality.

3. The method of claim 1, further comprising:

determining by the processing device that the imperative is a simple imperative;

storing the simple imperative into an execution queue of a memory; and

determining by the processing device whether the simple imperative stored in the execution queue is ready for execution.

4. The method of claim 1, wherein the defined set of nonambiguous grammar rules of the language include at least one of the following:

grammar rules to form imperatives or grammar rules to form sentences, instructions or statements which imply imperatives.

5. The method of claim 1, further comprising:

determining whether the imperative provides new information to the data/knowledge/plan base; and

when the imperative provides new information, adding the imperative to the data/knowledge/plan base.

6. The method of claim 1, wherein executable portions of the imperative are executed.

7. The method of claim 1 , wherein a record of completed executions is stored in a memory.

8. The method of claim 6, wherein a record of reasoning behind completed executions is stored in a memory.

9. The method of claim 1, wherein forms of knowledge and planning are stored in the data/knowledge base as one or more of:

predications or grammar trees.

10. The method of claim 1, wherein executing the imperative based on at least one of the plurality of distinct logical units includes:

utilizing or causing real or simulated physical action.

11. The method of claim 1, wherein generating the response in a language, time-sensitive context of knowledge and/or plans in the data/knowledge/plan base is considered in formulating the response or action.

12. The method of claim 1, further comprising:

executing contradictory conclusions, results, and/or actions for different ones of the plurality of users in response to the imperative based on the distinct logical units for different ones of the plurality of users.

13. The method of claim 1, further comprising:

executing contradictory actions for different ones of the plurality of actuators based on the distinct logical units for different ones of the plurality of actuators.

14. The method of claim 1, further comprising:

concurrently storing contradictory imperatives for different ones of the plurality of users and for different ones of the plurality of actuators, based on the plurality of distinct logical units for the different ones of the plurality of users and for the different ones of the plurality of actuators.

15. The method of claim 1, comprising:

storing general instructions for determining execution of the imperative without specific instructions on actions to be executed to perform the imperative.

16. A device for controlling actuators, comprising:

an input interface configured to receive input data in a language characterized by having a defined set of unambiguous grammar rules;

a processing circuit adapted to implement a parsing module adapted to parse the input data from the input module into an internal format;

a prover module adapted to receive the parsed input data from the parse module and compare the parsed input data with stored data and/or plans in a data/knowledge/ plan base to determine if the parsed input data is an imperative; and

a memory device configured to store results of the prover module in the data/knowledge/plan base, wherein the input data is obtained from a plurality of different users and/or sensors and the data/knowledge/plan base stores plans; and

wherein the processing circuit is configured in execution of an instruction and/or plan, to actuate one or more robotic body components or actuators.

17. The device of claim 16, wherein the device recognizes, maintains and stores distinct realities for different users and actuators.

18. The device of claim 17, wherein the device is configured to execute different actions based the distinct realities for one or more different users or actuators.

19. A method for controlling one or more actuators by a processing device, comprising:

inputting data into the processing device in a language having a defined set of nonambiguous grammar rules, wherein the language includes at least one of;

an artificial language or a subset of a natural language;

comparing by the processing device the input data with previously stored data in a data/knowledge/plan database in a memory device;

determining by the processing device that the input data is an imperative and determining whether the imperative includes at least one of;

a simple imperative, a negative imperative or a conditional imperative;

when a simple imperative is determined, storing the simple imperative in an execution queue in the memory device for execution by one or more of a plurality of actuators;

when a negative imperative is determined, storing the negative imperative in the data/knowledge/plan database in the memory; and

when a conditional imperative is determined, storing the conditional imperative in the data/knowledge/plan database in the memory to determine whether to execute the conditional imperative, wherein the conditional imperative includes a command and a precondition.

20. The method of claim 19, wherein the precondition of the conditional imperative includes a logical state that is unknown, wherein the logical state includes at least one of:

true or false.

21. The method of claim 20, further comprising:

selecting by the processing device the conditional imperative stored in the data/knowledge/plan database; and

comparing by the processing device the precondition of the conditional imperative with known items in the data/knowledge/plan database to determine the logical state of the precondition.

22. The method of claim 21, further comprising:

when the logical state of the precondition is determined as true, storing the command of the conditional imperative into the execution queue in the memory device for execution by the one or more of the plurality of actuators.

23. The method of claim 21, further comprising:

when the logical state of the precondition is determined as false, removing by the processing device the conditional imperative from storage in the data/knowledge/plan database in the memory; and

outputting a response to a physical user interface, wherein the response indicates non-execution of the conditional imperative and a reason for the non-execution.

24. The method of claim 21, further comprising:

when the logical state of the precondition remains unknown after comparing with the known items in the data/knowledge/plan database, determining by the processing device whether to perform further processing; and

when further processing is determined, setting a flag associated with the precondition to indicate further processing for the precondition.

25. The method of claim 21, wherein the comparing the precondition with known items in the data/knowledge/plan database comprises:

comparing the precondition with a first known item in the data/knowledge/plan database;

when the first known item fails to affect the precondition, determining whether the precondition affects the known item; and

simplifying the first known item when the precondition affects the first known item.

26. The method of claim 19, wherein the precondition of the conditional imperative comprises a time that has not yet occurred.

27. The method of claim 26, further comprising:

at predetermined periods of time, evaluating by the processing device the conditional imperative stored in the data/knowledge/plan database in the memory;

determining by the processing device whether the time in the precondition of the conditional imperative has occurred; and

when the time has occurred, storing by the processing device the command of the conditional imperative into an execution queue in the memory device for execution by one or more of a plurality of actuators.

28. The method of claim 19, further comprising:

maintaining and storing by the processing device a plurality of distinct realities, wherein different ones of the plurality of distinct pluralities are associated with different ones of a plurality of users; and

initiating by the processing device execution of a first action in response to the imperative for a first one of the plurality of users associated with a first distinct reality and execution of a second different action in response to the imperative for a second one of the plurality of users associated with a second distinct reality.

29. A device for controlling one or more actuators, comprising:

at least one physical interface configured to receive input data in a language having a defined set of nonambiguous grammar rules, wherein the language includes at least one of;

an artificial language or a subset of a natural language;

at least one memory device that stores a data/knowledge/plan database and an execution queue;

at least one processing device operably coupled to the at least one physical interface and the at least one memory device, wherein the processing device is configured to;

compare the input data with previously stored data in the data/knowledge/plan database stored in the memory device;

determine that the input data is an imperative and determine whether the imperative includes at least one of;

a simple imperative, a negative imperative or a conditional imperative;

when a simple imperative is determined, store the simple imperative in the execution queue in the memory device;

when a negative imperative is determined, store the negative imperative in the data/knowledge/plan database in the memory; and

when a conditional imperative is determined, store the conditional imperative in the data/knowledge/plan database in the memory to determine whether to execute the conditional imperative, wherein the conditional imperative includes a command and a precondition; and

at least one of a plurality of actuators configured to execute the simple imperative stored in the execution queue in the memory device.

30. The device of claim 29, wherein the precondition includes a logical state that is unknown, wherein the logical state includes at least one of:

true or false.

31. The device of claim 30, wherein the processing device is further configured to:

select the conditional imperative stored in the data/knowledge/plan database; and

compare the precondition with known items in the data/knowledge/plan database to determine the logical state of the precondition.

32. The device of claim 31, wherein the processing device is further configured to:

when the logical state of the precondition is determined as true, store the command of the conditional imperative into the execution queue in the memory device for execution by the one or more of the plurality of actuators.

33. The device of claim 31, wherein the processing device is further configured to:

when the logical state of the precondition is determined as false, remove the conditional imperative from storage in the data/knowledge/plan database in the memory; and

output a response to the physical interface, wherein the response indicates non-execution of the conditional imperative and a reason for the non-execution.

34. The device of claim 31, wherein the processing device is further configured to:

when a logical state of the precondition remains unknown after comparing with known items in the data/knowledge/plan database, determine whether to perform further processing; and

when further processing is determined, set a flag associated with the precondition to indicate further processing for the precondition.

35. The device of claim 31, wherein the processing device is further configured to compare the precondition with known items in the data/knowledge/plan database by:

comparing the precondition with a first known item in the data/knowledge/plan database;

when the first known item fails to affect the precondition, determining whether the precondition affects the known item; and

simplifying the first known item when the precondition affects the first known item.

36. The device of claim 29, wherein the precondition of the conditional imperative comprises a time that has not yet occurred.

37. The device of claim 36, wherein the processing device is further configured to:

evaluate the conditional imperative stored in the data/knowledge/plan database in the memory at predetermined periods of time;

determine whether the time in the precondition has occurred; and

when the time has occurred, store the command of the conditional imperative into an execution queue in the memory device for execution by one or more of a plurality of actuators.

38. The device of claim 29, wherein the processing device is further configured to:

maintain and store a plurality of distinct realities, wherein different ones of the plurality of distinct pluralities are associated with different ones of a plurality of users.

39. The device of claim 38, wherein the processing device is further configured to:

initiate execution of a first action in response to the imperative for a first one of the plurality of users associated with a first distinct reality; and

initiate execution of a second different action in response to the imperative for a second one of the plurality of users associated with a second distinct reality.