Neural network and system

• US 4,945,494 A
• Filed: 06/16/1989
• Issued: 07/31/1990
• Est. Priority Date: 03/02/1989
• Status: Expired due to Term

• Current Assignee: Texas Instruments, Inc.
• Original Assignee: Texas Instruments, Inc.
• Inventors: Gately, Michael T., Katz, Alan J., Penz, Perry A.
• Primary Examiner(s): MacDonald, Allen
• Application Number:
  US07/367,272
• Time in Patent Office: 410 Days
• Field of Search: 364/513, 364/200, 364/900, 364/274.9, 364/276.6, 364/917.95, 382/14, 382/15
• US Class Current: 706/25
• CPC Class Codes: G01S 7/292 Extracting wanted echo-signals
• CPC Class Codes: G01S 7/417 involving the use of neural networks
• CPC Class Codes: G06F 18/2135 based on approximation criteria, e.g. principal component analysis
• CPC Class Codes: G06N 3/044 Recurrent networks, e.g. Hopfield networks

Abstract

Neural network systems (100) with learning and recall are applied to clustered multiple-featured data (122, 124, 126) and analog data.

Claims

1. An information processor, comprising:

(a) an encoder, said encoder encoding input information at least partially into a position type code format; and

(b) a clustering neural network providing an output therefrom, said clustering network having an input receiving said output of said encoder and said output of said clustering network, said clustering neural network clustering said input thereto with thresholded analog neurons in conjunction with a learning rule and a recall rule to preserve analog aspects.

2. The processor of claim 1, further comprising:

(a) a classifying neural network having stored information in a format of vectors recalled from said clustering network using said recall rule, said classifying network comparing said stored information recalled from said clustering network with other information stored therein with a second recall rule.

3. The processor of claim 1, further comprising:

(a) a tracker receiving the output of said encoder and recalled vectors from said neural network and forming cluster vectors in response thereto with correspondence information from said recalled vectors to prohibit recall of the portion of said output of said encoder corresponding to a previously formed one of said cluster vectors; and

(b) a classifier having stored information therein providing an output indicative of the correspondence between said stored information and said cluster vectors.

4. The processor of claim 1, wherein:

(a) said learning rule is a Widrow-Hoff learning; and

(b) said recall rule is a BSB-type recall rule.

5. A method of information processing, comprising the steps of:

(a) encoding said information into thermometer code format;

(b) learning said encoded information with a thresholded analog neural network;

(c) recalling at least some of said information from said neural network;

(d) recoding said recalled information;

(e) comparing said encoded information with said recoded recalled information with noncomparable encoded leading to further recall; and

(f) comparing said recoded recalled information with stored information.

6. The method of claim 5, wherein;

(a) said stored information is stored in a second thresholded analog neural network.

7. The method of claim 5, comprising the further steps of:

(a) deleting a portion of each of said recalled versions; and

(b) adding further information to each of said recalled versions.

8. A method of processing multiple-feature information, comprising the steps of:

(a) encoding information by concatenated thermometer codes of features of said information;

(b) learning without saturation said encoded information in a thresholded analog neural network; and

(c) inputting said encoded information into said network and recalling processed versions of said encoded information.