Hierarchical based system for identifying object using spatial and temporal patterns
First Claim
1. A computer-implemented system for determining an identity of a sensed object or a state of sensed object associated with spatial patterns and temporal sequences in input data provided by a sensor, the input data representing at least one of image, video, audio, text, weather conditions, tactile data or data associated with operation of a machine, comprising:
- a hierarchy of computing modules configured to receive first input data to learn spatial patterns and temporal sequences in the first input data associated with a sensed object or a state of a sensed object in a learning stage, the hierarchy in an inference stage subsequent to the learning stage further configured to receive second input data and generate identity information about spatial patterns and temporal sequences in the second input data corresponding to the spatial patterns and temporal sequences learned by the hierarchy in the learning stage, the hierarchy of computing modules comprising;
a plurality of first computing modules, each first computing module configured to receive a portion of the second input data and generate first information about sequences in the received portion of the second input data corresponding to learned spatial patterns and temporal sequences;
a relay module configured to receive and select the first information generated by the plurality of the first computing modules; and
a second computing module configured to generate the identity information based on the first information selected by the relay module, wherein the identity information is one of displayed, output for controlling a physical object or stored in a storage medium, for identification of a sensed object or a state of a sensed object.
1 Assignment
0 Petitions
Accused Products
Abstract
A hierarchy of computing modules is configured to learn a cause of input data sensed over space and time, and is further configured to determine a cause of novel sensed input data dependent on the learned cause. Further, the hierarchy has a first level of computing modules and a second level of at least one computing module, where at least one of the computing modules in the first level is configured to receive a portion of the novel sensed input data, and where the computing module in the first level is further capable of determining a possible cause of the novel sensed input data dependent on analyzing only a subset of the portion of the novel sensed input data.
-
Citations
29 Claims
-
1. A computer-implemented system for determining an identity of a sensed object or a state of sensed object associated with spatial patterns and temporal sequences in input data provided by a sensor, the input data representing at least one of image, video, audio, text, weather conditions, tactile data or data associated with operation of a machine, comprising:
a hierarchy of computing modules configured to receive first input data to learn spatial patterns and temporal sequences in the first input data associated with a sensed object or a state of a sensed object in a learning stage, the hierarchy in an inference stage subsequent to the learning stage further configured to receive second input data and generate identity information about spatial patterns and temporal sequences in the second input data corresponding to the spatial patterns and temporal sequences learned by the hierarchy in the learning stage, the hierarchy of computing modules comprising; a plurality of first computing modules, each first computing module configured to receive a portion of the second input data and generate first information about sequences in the received portion of the second input data corresponding to learned spatial patterns and temporal sequences; a relay module configured to receive and select the first information generated by the plurality of the first computing modules; and a second computing module configured to generate the identity information based on the first information selected by the relay module, wherein the identity information is one of displayed, output for controlling a physical object or stored in a storage medium, for identification of a sensed object or a state of a sensed object. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
11. A computer-implemented system for determining an identity of a sensed object or a state of sensed object associated with spatial patterns and temporal sequences in input data provided by a sensor, the input data representing at least one of image, video, audio, text, weather conditions, tactile data or data associated with operation of a machine, comprising:
a hierarchy of computing modules configured to receive first input data to learn spatial patterns and temporal sequences in the first input data associated with a sensed object or a state of a sensed object in a learning stage, the hierarchy in an inference stage subsequent to the learning stage further configured to receive second input data and generate identity information about spatial patterns and temporal sequences in the second input data corresponding to the spatial patterns and temporal sequences learned by the hierarchy in the learning stage, the hierarchy of computing modules comprising; a plurality of first computing modules, each first computing module configured to receive a portion of the second input data and generate first information about sequences in the received portion of the second input data corresponding to learned spatial patterns and temporal sequences; a relay module configured to receive and modify the first information generated by the plurality of the first computing modules; and a second computing module configured to generate the identity information based on the first information selected by the relay module, wherein the identity information is one of displayed, output for controlling a physical object or stored in a storage medium, for identification of a sensed object or a state of a sensed object. - View Dependent Claims (12, 13, 14)
-
15. A computer-implemented method in a hierarchy of computing modules for determining an identity of a sensed object or a state of a sensed object associated with spatial patterns and temporal sequences in input data provided by a sensor, the hierarchy of computing modules structured to include a plurality of first computing modules and at least one second computing module, the input data representing at least one of image, video, audio, text, weather conditions, tactile data or data associated with operation of a machine, comprising:
-
the hierarchy of computing modules, in a learning stage, learning spatial patterns and temporal sequences in a first input data associated with a sensed object or a state of a sensed object responsive to receiving the first input data; each of the first computing module, in an inference stage subsequent to the learning stage, generating first information responsive to receiving a portion of a second input data, the first information indicative of temporal sequences in the second input data corresponding to learned spatial patterns and temporal sequences; a relay module, in the inference stage, receiving and selecting the first information generated by the plurality of the first computing modules; and the at least one second computing module, in the inference stage, generating identity information responsive to receiving the selected first information, the identity information is one of displayed, output for controlling a physical object or stored in a storage medium, for identification of a sensed object or a state of a sensed object. - View Dependent Claims (16, 17, 18, 19, 20)
-
-
21. A computer readable storage medium structured to store instructions executable by a processor in a computing device, the instructions adapted to implement a hierarchy of computing modules including a plurality of first computing modules and at least one second computing module, the hierarchy of computing modules determining an identity of a sensed object or a state of sensed object associated with spatial patterns and temporal sequences in input data provided by a sensor, the input data representing at least one of image, video, audio, text, weather conditions, tactile data or data associated with operation of a machine, the instructions when executed cause the processor to:
-
the hierarchy of computing modules, in a learning stage, learn spatial patterns and temporal sequences in a first input data associated with a sensed object or a state of a sensed object responsive to receiving the first input data; at each of the first computing module, in an inference stage subsequent to the learning stage, generate first information responsive to receiving a portion of a second input data, the first information indicative of temporal sequences in the second input data corresponding to learned spatial patterns and temporal sequences; at a relay module, in the inference stage, receive and select the first information generated by the plurality of the first computing modules; and at the second computing module, in the inference stage, generate identity information responsive to receiving the selected first information, the identity information is one of displayed, output for controlling a physical object or stored in a storage medium, for identification of a sensed object or a state of a sensed object. - View Dependent Claims (22, 23, 24, 25, 26)
-
-
27. A computer-implemented system for determining an identity of a sensed object or a state of a sensed object associated with spatial patterns and temporal sequences in input data provided by a sensor, the input data representing at least one of image, video, audio, text, weather conditions, tactile data or data associated with operation of a machine, comprising:
-
a hierarchy of computing modules configured to receive first input data to learn spatial patterns and temporal sequences in the first input data associated with a sensed object or a state of a sensed object in a learning stage, the hierarchy in an inference stage subsequent to the learning stage further configured to receive second input data and generate identity information about spatial patterns and temporal sequences in the second input data corresponding to the spatial patterns and temporal sequences learned by the hierarchy in the learning stage, the hierarchy of computing modules comprising; a plurality of first computing modules, at least one of the first computing modules configured to receive a portion of the input data and generate first information indicative of sequences in the input data corresponding to learned spatial patterns and temporal sequences; and at least one second computing module configured to generate the identity information based on the first information received from the plurality of first computing modules, wherein the identity information is one of displayed, output for controlling a physical object or stored in a storage medium, for identification of a sensed object or a state of a sensed object; and a category attention module for switching on or off a subset of the learned spatial patterns and temporal sequences associated with the identity of one or more sensed objects or states of sensed object.
-
-
28. A computer-implemented method for determining an identity of a sensed object or a state of a sensed object associated with spatial patterns and temporal sequences in input data provided by a sensor, the input data representing at least one of image, video, audio, text, weather conditions, tactile data or data associated with operation of a machine, the method performed by a hierarchy of computing modules structured to include a plurality of first computing modules and at least one second computing module, comprising:
-
switching on or off a subset of spatial patterns and temporal sequences associated with the identity of one or more sensed objects or states of a sensed object; each of the first computing module, generating first information indicative of temporal sequences in the input data corresponding to the spatial patterns and temporal sequences that are switched on, responsive to receiving a portion of the input data; and the at least one second computing module, generating identity information based on the first information received from the plurality of first computing modules, wherein the identity information is one of displayed, output for controlling a physical object or stored in a storage medium, for identification of a sensed object or a state of a sensed object.
-
-
29. A computer readable storage medium structured to store instructions executable by a processor in a computing device to determine an identity of a sensed object or a state of a sensed object associated with spatial patterns and temporal sequences in input data provided by a sensor, the input data representing at least one of image, video, audio, text, weather conditions, tactile data or data associated with operation of a machine, the instructions adapted to implement a hierarchy of computing modules including a plurality of first computing modules and at least one second computing module, the instructions when executed cause the processor to:
-
switch on or off a subset of spatial patterns and temporal sequences associated with the identity of one or more sensed objects or states of sensed objects; each of the second computing module, generate first information indicative of temporal sequences in the input data corresponding to the spatial patterns and temporal sequences that are switched on, responsive to receiving a portion of the input data; and the second computing module, generate identity information based on the first information received from the plurality of first computing modules, wherein the identity information is one of displayed, output for controlling a physical object or stored in a storage medium, for identification of a sensed object or a state of a sensed object.
-
Specification