Method and system for dynamic task selection suitable for mapping external inputs and internal goals toward actions that solve problems or elicit rewards
First Claim
1. A system for dynamic task selection (executive control) suitable for mapping external inputs and internal goals toward actions that solve problems or elicit external rewards, the system comprising a processor, an input coupled with the processor for receiving a plurality of inputs to be processed into a motor-schema, and a memory coupled with the processor, wherein the memory includes instruction means that are executable by the processor for causing the processor to perform operations of:
- receiving sensory inputs;
transforming the sensory inputs into clusters of spatial patterns;
transforming the clusters of spatial patterns into a spatial schema;
encoding transitions between the spatial schema;
clustering the spatial schema and encoded spatial schema transitions into a spatio-temporal schema;
combining the spatial schema with the spatio-temporal schema to create a bimodal spatio-temporal schema;
receiving a reward input and a punishment input, wherein the reward input and the punishment input reflect a current state of an external environment;
computing an emotional state and a motivational state from the sensory inputs, the reward input, and the punishment input;
combining the bimodal spatio-temporal schema with the reward input, the punishment input, the emotional state, and the motivational state to create an external/internal schema (EXIN schema), wherein the EXIN schema provides a compressed representation assessing emotions, motivations, and rewards;
combining the EXIN schema with the bimodal spatio-temporal schema to create a multimodal spatio-temporal schema, wherein the multimodal spatio-temporal schema serves as an episodic memory that can be replayed by the system;
receiving structures representing a plurality of elements of a motor system; and
combining the multimodal spatio-temporal schema with the motor system structures and the EXIN schema to create a motor schema.
1 Assignment
0 Petitions
Accused Products
Abstract
The present invention relates to a system for mapping external inputs and internal goals toward actions that solve problems or elicit external rewards. The present invention allows an instructor to test and train an agent to perform dynamic task selection (executive control) by using a schema that computes the agent'"'"'s emotional and motivational states from reward/punishment inputs and sensory inputs (visual, auditory, kinematic, tactile, olfactory, somatosensory, and motor inputs). Specifically, the invention transforms the sensory inputs into unimodal and bimodal spatio-temporal schemas that are combined with the reward/punishment inputs and with the emotional and motivation states to create an external/internal schema (EXIN schema), that provides a compressed representation assessing the agent'"'"'s emotions, motivations, and rewards. The invention uses the EXIN schema to create a motor schema to be executed by the agent to dynamically perform the task selected by the instructor.
22 Citations
36 Claims
-
1. A system for dynamic task selection (executive control) suitable for mapping external inputs and internal goals toward actions that solve problems or elicit external rewards, the system comprising a processor, an input coupled with the processor for receiving a plurality of inputs to be processed into a motor-schema, and a memory coupled with the processor, wherein the memory includes instruction means that are executable by the processor for causing the processor to perform operations of:
-
receiving sensory inputs; transforming the sensory inputs into clusters of spatial patterns; transforming the clusters of spatial patterns into a spatial schema; encoding transitions between the spatial schema; clustering the spatial schema and encoded spatial schema transitions into a spatio-temporal schema; combining the spatial schema with the spatio-temporal schema to create a bimodal spatio-temporal schema; receiving a reward input and a punishment input, wherein the reward input and the punishment input reflect a current state of an external environment; computing an emotional state and a motivational state from the sensory inputs, the reward input, and the punishment input; combining the bimodal spatio-temporal schema with the reward input, the punishment input, the emotional state, and the motivational state to create an external/internal schema (EXIN schema), wherein the EXIN schema provides a compressed representation assessing emotions, motivations, and rewards; combining the EXIN schema with the bimodal spatio-temporal schema to create a multimodal spatio-temporal schema, wherein the multimodal spatio-temporal schema serves as an episodic memory that can be replayed by the system; receiving structures representing a plurality of elements of a motor system; and combining the multimodal spatio-temporal schema with the motor system structures and the EXIN schema to create a motor schema. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18)
-
-
19. A computer implemented method for dynamic task selection (executive control) suitable for mapping external inputs and internal goals toward actions that solve problems or elicit external rewards, the method comprising an act of causing a processor to execute instructions encoded on a memory, such that upon execution, the processor perform operations of:
-
receiving sensory inputs; transforming the sensory inputs into clusters of spatial patterns; transforming the clusters of spatial patterns into a spatial schema; encoding transitions between the spatial schema; clustering the spatial schema and encoded spatial schema transitions into a spatio-temporal schema; combining the spatial schema with the spatio-temporal schema to create a bimodal spatio-temporal schema; receiving a reward input and a punishment input, wherein the reward input and the punishment input reflect a current state of an external environment; computing an emotional state and a motivational state from the sensory inputs, the reward input, and the punishment input; combining the bimodal spatio-temporal schema with the reward input, the punishment input, the emotional state, and the motivational state to create an external/internal schema (EXIN schema), wherein the EXIN schema provides a compressed representation assessing emotions, motivations, and rewards; combining the EXIN schema with the bimodal spatio-temporal schema to create a multimodal spatio-temporal schema, wherein the multimodal spatio-temporal schema serves as an episodic memory that can be replayed by the computer implemented method; receiving structures representing a plurality of elements of a motor system; and combining the multimodal spatio-temporal schema with the motor system structures and the EXIN schema to create a motor schema. - View Dependent Claims (20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36)
-
Specification