Apparatus and method for dynamically updating landmarks in a space during execution of natural language instructions
First Claim
Patent Images
1. A method, comprising:
- obtaining, by a computing device, an incomplete semantic map of a predefined space, wherein the incomplete semantic map includes static landmarks;
receiving, by the computing device, a set of natural language instructions including a sequence of semantically directive clauses;
processing, by the computing device, the sequence of semantically directive clauses;
decoding, by the computing device, one of an action and a path in the set of natural language instructions using an optimization process and based on the incomplete semantic map;
responsive to the decoding, inserting, by the computing device, a newly identified landmark into the incomplete semantic map;
executing, by the computing device, the set of natural language instructions along a traveling path;
detecting, by the computing device, the newly identified landmark; and
responsive to the detecting of the newly identified landmark, marking, by the computing device, the newly identified landmark as an identified location.
2 Assignments
0 Petitions
Accused Products
Abstract
A computing device obtains an incomplete semantic map of a predefined space. The incomplete semantic map includes static landmarks. The computing device receives a set of natural language instructions including a sequence of semantically directive clauses, processes the sequence of semantically directive clauses, decodes one of an action and a path in the set of natural language instructions using an optimization process and based on the incomplete semantic map. In response to the decoding, the computing device inserts a newly identified landmark into the incomplete semantic map.
5 Citations
18 Claims
-
1. A method, comprising:
-
obtaining, by a computing device, an incomplete semantic map of a predefined space, wherein the incomplete semantic map includes static landmarks; receiving, by the computing device, a set of natural language instructions including a sequence of semantically directive clauses; processing, by the computing device, the sequence of semantically directive clauses; decoding, by the computing device, one of an action and a path in the set of natural language instructions using an optimization process and based on the incomplete semantic map; responsive to the decoding, inserting, by the computing device, a newly identified landmark into the incomplete semantic map; executing, by the computing device, the set of natural language instructions along a traveling path; detecting, by the computing device, the newly identified landmark; and responsive to the detecting of the newly identified landmark, marking, by the computing device, the newly identified landmark as an identified location. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A computing device, comprising:
-
memory configured to store non-transitory computer-executable instructions; and a processor configured to perform a set of functions including; obtaining an incomplete semantic map of a predefined space, wherein the incomplete semantic map includes static landmarks; receiving a set of natural language instructions including a sequence of semantically directive clauses; processing the sequence of semantically directive clauses; decoding one of an action and a path in the set of natural language instructions using an optimization process and based on the incomplete semantic map; responsive to the decoding, inserting a newly identified landmark into the incomplete semantic map; executing the set of natural language instructions along a traveling path; detecting the newly identified landmark; and responsive to the detecting of the newly identified landmark, marking the newly identified landmark as an identified location. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16)
-
-
17. A method comprising
obtaining, by a computing device, an incomplete semantic map of a predefined space, wherein the incomplete semantic map includes static landmarks; -
receiving, by the computing device, a set of natural language instructions including a sequence of semantically directive clauses; processing, by the computing device, the sequence of semantically directive clauses; decoding, by the computing device, one of an action and a path in the set of natural language instructions using an optimization process and based on the incomplete semantic map; identifying, by the computing device, one of a known landmark and a known task in the set of natural language instructions; creating, by the computing device, a direction with a known clause in the set of natural language instructions; eliminating, by the computing device, an unknown clause in the set of natural language instructions from the direction; creating, by the computing device, at least one path to execute the known clause; choosing, by the computing device, a best and previously unselected path from the at least one path and selecting a landmark on the best and previously unselected path, wherein the selected landmark is known from the incomplete semantic map; generating, by the computing device, a hypothesis for determining an unknown landmark in an eliminated clause in the set of natural language instructions; interacting with an operator to identify the unknown landmark in the eliminated clause; responsive to the operator affirming the hypothesis, inserting a newly identified landmark into the incomplete semantic map; and responsive to the operator rejecting the hypothesis, repeating choosing, generating and interacting.
-
-
18. A computing device comprising:
-
memory configured to store non-transitory computer-executable instructions; and a processor configured to perform a set of functions including; obtaining an incomplete semantic map of a predefined space, wherein the incomplete semantic map includes static landmarks; receiving a set of natural language instructions including a sequence of semantically directive clauses; processing the sequence of semantically directive clauses; decoding one of an action and a path in the set of natural language instructions using an optimization process and based on the incomplete semantic map; identifying one of a known landmark and a known task in the set of natural language instructions; creating a direction with a known clause in the set of natural language instructions; eliminating an unknown clause in the set of natural language instructions from the direction; creating at least one path to execute the known clause; choosing a best and previously unselected path from the at least one path and selecting a landmark on the best and previously unselected path, wherein the selected landmark is known from the incomplete semantic map; generating a hypothesis for determining an unknown landmark in an eliminated clause in the set of natural language instructions; interacting with an operator to identify the unknown landmark in the eliminated clause; responsive to the operator affirming the hypothesis, inserting a newly identified landmark into the incomplete semantic map; and responsive to the operator rejecting the hypothesis, repeating choosing, generating and interacting.
-
Specification