Tele-autonomous system and method employing time/position synchrony/desynchrony
First Claim
1. In a system for enabling a cognitive agent to operate in real time a controlled agent to perform automatically movements corresponding to a sequence of command data stored in the system representing a planned path in space and time of at least a selected portion of the controlled agent, a method of generating the sequence of command data used to control the controlled agent, comprising the steps of:
- (a) providing first input means operable by the cognitive agent for producing in real time successive command signals that specify the planned path in space and time of at least the selected portion of the controlled agent;
(b) providing second input means operable by the cognitive agent for selectively enabling and disabling time synchrony;
(c) generating command data to be added to the sequence of command data representing the planned path by deriving from the successive command signals at predetermined intervals of time information related to desired position, and sequentially storing such derived positional information as command data in a manner indicating relative order of acquisition, thereby providing time synchronized path planning;
(d) when the time synchrony is enabled, also storing the derived positional information in a manner which indicates relative time of acquisition, as well as relative order of acquisition; and
(e) when the time synchrony is disabled, deriving from the command signals at predetermined intervals of time information related to desired position by also storing the derived positional information in a manner which indicates its independence from its relative time of acquisition.
1 Assignment
0 Petitions
Accused Products
Abstract
Systems and methods for performing tele-operations with the active assistance and supervision of a cognitive agent, such as a human being, who generates a future path plan in real time for immediate use by an automated on-line controlled agent, such as a work robot or other manipulator, are disclosed. The systems and methods may employ a visual display to present images of the controlled agent, of a foward simulation of the controlled agent, and of the future path plan being generated to enable a human operator to assess and control the on-going activity. The system simultaneously operates the controlled agent and produces the forward simulation and path plan, all under real time conditions. The cognitive agent, display and forward simulation equipment may be at one location and the controlled agent and its controller at another remote location. The forward simulation may be selectively operated in one of three modes: a time-and-position synchronized mode, a position-synchronized, time-desynchronized mode, and a mode where neither time nor position are synchronized with the controlled agent. The desynchronization of time and of position of the forward simulation with respect to the controlled agent is accomplished by use of a time clutch and a position clutch. The forward simulation can also be reversed through the use of a time brake, and the time ratio between the forward simulation time and real time can be adjusted. Finally, a method for transferring active control of functioning autonomously-operated equipment from one cognitive agent to another cognitive agent under real time conditions is disclosed.
-
Citations
29 Claims
-
1. In a system for enabling a cognitive agent to operate in real time a controlled agent to perform automatically movements corresponding to a sequence of command data stored in the system representing a planned path in space and time of at least a selected portion of the controlled agent, a method of generating the sequence of command data used to control the controlled agent, comprising the steps of:
-
(a) providing first input means operable by the cognitive agent for producing in real time successive command signals that specify the planned path in space and time of at least the selected portion of the controlled agent; (b) providing second input means operable by the cognitive agent for selectively enabling and disabling time synchrony; (c) generating command data to be added to the sequence of command data representing the planned path by deriving from the successive command signals at predetermined intervals of time information related to desired position, and sequentially storing such derived positional information as command data in a manner indicating relative order of acquisition, thereby providing time synchronized path planning; (d) when the time synchrony is enabled, also storing the derived positional information in a manner which indicates relative time of acquisition, as well as relative order of acquisition; and (e) when the time synchrony is disabled, deriving from the command signals at predetermined intervals of time information related to desired position by also storing the derived positional information in a manner which indicates its independence from its relative time of acquisition. - View Dependent Claims (2, 3)
-
-
4. A system for concurrently driving, in real time by a cognitive agent, a controlled agent movable in at least two dimensions to perform automatically movements corresponding to a sequence of command data stored in the system representing a planned path of at least a selected portion of the controlled agent, said system comprising:
-
first input means operable by the cognitive agent for producing in real time successive command signals that specify the planned path of at least the selected portion of the controlled agent; means for generating command data to be added to the sequence of command data representing the planned path by deriving from successive command signal information related to desired position of at least the selected portion of the controlled agent; memory means for successively storing derived command data in sets in a manner which indicates order of receipt thereof; second input means operable by the cognitive agent for selectively enabling and disabling the time synchrony; and control means for enabling and disabling time synchrony of path planning by selectively altering, in response to the second input means, the timing of the derived command data relative to the time of acquisition of the command signals from the first input means. - View Dependent Claims (5, 6, 7)
-
-
8. In a system for enabling cognitive agent to operate in real time a controlled agent to perform automatically movements corresponding to a first sequence of command data stored in the system representing a planned path in space and time of at least a selected portion of the controlled agent, a method of processing command signals to generate the first sequence of command data used to control the controlled agent, comprising the steps of:
-
(a) providing first input means operable by the cognitive agent for producing in real time a stream of command signals that specify the planned path in space and time of at least the selected portion of the controlled agent; (b) providing second input means operable by the cognitive agent for selectively enabling and disabling the continuity of position in path planning; (c) when continuity of position is enabled, generating command data to be added to the first sequence of command data representing the planned path by deriving from successive command signals at predetermined intervals of time information related to desired position, and sequentially storing such position information as command data associated with the planned path, thereby providing continuity of position in path planning; (d) when the continuity of position is disabled, interrupting the generation of the position command data representing the planned path; and (e) when the continuity of position is disabled, generating from the stream of command signals a second sequence of position command data specifying a possible future path plan of at least the selected portion of the controlled agent. - View Dependent Claims (9, 10)
-
-
11. A system for concurrently driving, under closed-loop servo control alterable in real time by a cognitive agent, an articulated work robot or other manipulator having a plurality of power-driven links interconnected to permit relative motion therebetween in plural degrees of freedom, the links being controlled automatically to perform movements corresponding to a sequence of command data stored in the system representing a planned path of at least a selected portion of the manipulator, said system comprising:
-
first input means operable by the cognitive agent for producing in real time successive command signals that specify the planned path of at least a selected portion of the manipulator; means for generating command data to be added to the sequence of command data representing the planned path by deriving from successive command signals, information related to desired positions of at least selected portion of the manipulator; second input means operable by the cognitive agent for selectively enabling and disabling the position synchrony of path planning; first memory means for successively storing derived command data in a manner which indicates intended order of processing under closed-loop servo control; control means for interrupting the storing of derived command data in the first memory means; second memory means for storing command data during the interval of interruption and in a manner indicating the order of receipt thereof; and forward simulation means for providing a visual presentation of the desired postions represented by the derived command data stored in the second memory. - View Dependent Claims (12, 13)
-
-
14. In a system for interactively allowing a cognitive agent to operate in real time, a controlled agent to perform automatically movements corresponding to a first sequence of command data stored in the controller representing a planned path in space and time of at least a selected portion of the controlled agent, a method of processing command signals to generate the first sequence of command data used to control the controlled agent, comprising the steps of:
-
(a) producing a stream of command signals in real time that specify the planned path in space and time of the selected portion of the controlled agent; and (b) selectively reversing the path planning by successively deleting only a portion of the command data from the sequence of command data not yet performed by the controlled agent, the command data in the sequence being deleted on a last-in, first-out basis. - View Dependent Claims (15, 16, 17)
-
-
18. A system for enabling a cognitive agent to operate in real time a controlled agent to perform automatically movements corresponding to a first sequence of command data stored in the system representing a planned path in space and time of at least a selected portion of the controlled agent, the system comprising:
-
first means operable by the cognitive agent for producing a stream of command signals in real time that specify a future planned path in space and time of the selected portion of the controlled agents; and second means operable by the cognitive agent for selectively reversing the path already planned by successively deleting command data from the sequence of command data representing that portion of the future path plan not yet performed by the controlled agent, the command data in the sequence being deleted on a last-in, first-out basis. - View Dependent Claims (19, 20)
-
-
21. In a system for interactively allowing a cognitive agent to operate in real time a controlled agent to perform automatically movements corresponding to a sequence of command data stored in the system representing a planned path in space and time of at least a selected portion of the controlled agent, a method of generating the sequence of command data used to control the controlled agent, comprising the steps of:
-
(a) providing first means operable by the cognitive agent for producing a stream of command signals in real time that specify the planned path in space and time of the selected portion of the controlled agent; and (b) selectively generating command data to be added to the sequence of command data representing the planned path by acquiring from the stream of command signals at predetermined intervals of time position command information and successively storing with such position command data indicating that such stored command data is to be performed in time by the controlled agent at a non-unity scaled function of time of acquisition, thereby providing a planned path having positional information synchronized to a time scale different from but proportional to the actual time of acquisition of such positional information. - View Dependent Claims (22, 23, 24)
-
-
25. A system for enabling a cognitive agent to operate in real time a controlled agent to perform automatically movements corresponding to a first sequence of command data stored in the system representing a planned path in space and time of at least a selected portion of the controlled agent, the system comprising:
-
first means operable by the cognitive agent while the controlled agent is automatically performing movements for producing a stream of command signals in real time that specify the future planned path in space and time of the selected portion of the controlled agent; second means for selectively generating command data to be added to the sequence of command data representing the planned path by acquiring from the stream of command signals at predetermined intervals of time position command information; and third means for successively storing such position command information and for storing with such position command information, other information indicating that such stored command information is to be performed in time by the controlled agent at a non-unity scaled function of time of acquisition, thereby providing a planned path having positional information synchronized in a time scale different from but proportional to the actual time of acquisition of such position command information. - View Dependent Claims (26, 27)
-
-
28. In a real time control application involving subjecting autonomously-operated equipment to external control by one of a plurality of cognitive agents, a method of providing control transitions wherein external control is passed from a first one of the cognitive agents to a second one of the cognitive agents, the method comprising the steps of:
-
(a) providing first means operable by the first cognitive agent for producing a stream of first command signals in real time to specify a first portion of the planned path in space and time of at least the selected segment of the equipment; (b) generating, from the stream of first command signals, a first forward simulation representing the planned path in space and time of at least the selected segment of the equipment in relation to the existing position of the selected segment, said first forward simulation being produced in response to commands received from the first cognitive agent; (c) providing second means operable by the second cognitive agent for producing a stream of second command signals in real time to specify a second portion of the planned path in space and time of the at least selected portion of the equipment; (d) generating, from the stream of second command signals, a second forward simulation representing a possible location in the scene for at least the selected segment of the equipment; and (e) transferring external control from the first agent to the second agent when the second simulation is within a predetermined distance from a portion of the planned path of the first simulation. - View Dependent Claims (29)
-
Specification