Computer implemented machine learning method and system

• US 5,841,947 A
• Filed: 07/12/1996
• Issued: 11/24/1998
• Est. Priority Date: 07/12/1996
• Status: Expired due to Fees

• Current Assignee: Peter Nordin
• Original Assignee: Peter Nordin
• Inventors: Nordin, Peter
• Primary Examiner(s): Downs, Robert W.
• Application Number:
  US08/674,337
• Time in Patent Office: 865 Days
• Field of Search: 395/13
• US Class Current: 706/13
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06N 3/004 Artificial life, i.e. computing arrangements simulating life
• CPC Class Codes: G06N 3/126 Evolutionary algorithms, e.g. genetic algorithms or genetic programming

Abstract

One or more machine code entities such as functions are created which represent solutions to a problem and are directly executable by a computer. The programs are created and altered by a program in a higher level language such as "C" which is not directly executable, but requires translation into executable machine code through compilation, interpretation, translation, etc. The entities are initially created as an integer array that can be altered by the program as data, and are executed by the program by recasting a pointer to the array as a function type. The entities are evaluated by executing them with training data as inputs, and calculating fitnesses based on a predetermined criterion. The entities are then altered based on their fitnesses using a machine learning algorithm by recasting the pointer to the array as a data (e.g. integer) type. This process is iteratively repeated until an end criterion is reached. The entities evolve in such a manner as to improve their fitness, and one entity is ultimately produced which represents an optimal solution to the problem. Each entity includes a plurality of directly executable machine code instructions, a header, a footer, and a return instruction. The alteration process is controlled such that only valid instructions are produced. The headers, footers and return instructions are protected from alteration. The system can be implemented on an integrated circuit chip, with the entities stored in high speed memory in a central processing unit.

Claims

1. A computer implemented learning method comprising the steps of:

(a) providing a computer with an indirectly executable program including;

a first instruction that points to and designates machine code stored in a memory as data;

a second instruction that points to and designates machine code stored in a memory as directly executable code;

a third instruction that alters machine code pointed to by the first instruction; and

a fourth instruction that executes machine code pointed to by the second instruction; and

(b) controlling the computer to execute the program which performs the steps of;

(b1) creating and storing a machine code entity including a directly executable instruction which includes run time data in a memory;

(b2) executing the second instruction to point to the entity;

(b3) executing the fourth instruction using input data to produce a result;

(b4) evaluating the result;

(b5) executing the first instruction to point to the entity;

(b6) executing the third instruction to alter the entity to include a different directly executable instruction; and

(b7) repeating steps (b3) to (b6) until an end criterion is reached.

2. A method as in claim 1, in which:

the first instruction points to and designates machine code stored in a memory as data by casting a pointer thereto as a data pointer; and

the second instruction points to and designates machine code stored in a memory as directly executable code by casting a pointer thereto as a function pointer.

3. A method as in claim 1, in which:

the first instruction points to and designates machine code stored in a memory as data by creating a data pointer thereto; and

the second instruction points to and designates machine code stored in a memory as directly executable code by creating a function pointer thereto.

4. A method as in claim 1, in which:

step (b1) comprises creating the entity as comprising a header and a footer; and

step (b6) comprises preventing the header and footer from being altered.

5. A method as in claim 1, in which:

step (b1) comprises creating the entity as comprising a return instruction; and

step (b6) comprises preventing the return instruction from being altered.

6. A method as in claim 1, in which the learning algorithm in step (b4) and the alteration algorithm in step (b6) in combination comprise a genetic algorithm.

7. A method as in claim 1, in which step (b1) comprises creating the entity as comprising a plurality of directly executable instructions.

8. A method as in claim 7, in which step (b1) comprises randomly selecting the directly executable instructions from a set of directly executable instructions.

9. A method as in claim 7, in which step (b6) comprises genetically altering the directly executable instructions.

10. A method as in claim 7, in which:

one of the directly executable instructions comprises an operator and an operand; and

step (b6) comprises genetically mutating the operand.

11. A method as in claim 7, in which two of the directly executable instructions comprise operators respectively;

and

step (b6) comprises genetically crossing the operators.

12. A method as in claim 1, in which:

an array of directly executable functions;

step (b1) comprises randomly selecting the directly executable instruction from a set of directly executable instructions.

13. A method as in claim 1, in which step (b6) comprises genetically altering the directly executable instruction.

14. A method as in claim 1, in which:

the directly executable instruction comprises an operator and an operand; and

step (b6) comprises genetically mutating the operand.

15. A computer implemented learning method comprising the steps of:

(a) providing a computer with an indirectly executable program; and

(b) controlling the computer to execute the program which performs the steps of;

(b1) creating a directly executable machine code entity including a directly executable program instruction which includes run time data and a directly executable return instruction;

(b2) executing the entity using input data to produce a result;

(b3) evaluating the result;

(b4) altering only the program instruction to include a different directly executable program instruction; and

(b6) repeating steps (b2) to (b4) until an end criterion is reached.

16. A method as in claim 15, in which step (b4) comprises preventing the return instruction from being altered.

17. A method as in claim 15, in which step (b4) comprises allowing the return instruction to be altered, and then restoring the return instruction to its original state.

18. A method as in claim 15, in which step (b4) comprises separating the program instruction from the entity, altering the program instruction to include the different program instruction, and returning the different program instruction to the entity.

19. A method of manipulating and executing computer machine code, comprising the steps of:

(a) providing a computer with an indirectly executable program including;

a first instruction that points to and designates machine code stored in a memory as data;

a second instruction that points to and designates machine code stored in a memory as directly executable code;

a third instruction that alters machine code pointed to by the first instruction; and

a fourth instruction that executes machine code pointed to by the second instruction; and

(b) controlling the computer to execute the program which performs the steps of;

(b1) creating and storing a machine code entity including a directly executable instruction which includes run time data in a memory;

(b2) executing the second instruction to point to the entity;

(b3) executing the fourth instruction to execute the entity;

(b4) executing the first instruction to point to the entity; and

(b5) executing the third instruction to alter the entity to include a different directly executable instruction.

20. A method as in claim 19, in which:

step (b1) comprises creating the entity as including a directly executable program instruction and a directly executable return instruction; and

step (b5) comprises preventing the return instruction from being altered.

21. A computer learning system comprising:

a memory for storing an indirectly executable computer program including;

a first instruction that points to and designates machine code stored in the memory as data;

a second instruction that points to and designates machine code stored in the memory as directly executable machine code;

a third instruction that alters machine code pointed to by the first instruction; and

a fourth instruction that executes machine code pointed to by the second instruction; and

a processor for executing the program;

the processor, memory and program operating in combination for performing the steps of;

(a) creating and storing a machine code entity including a directly executable instruction which includes run time data in the memory;

(b) executing the second instruction to point to the entity;

(c) executing the instruction using input data to produce a result;

(d) evaluating the result;

(e) executing the first instruction to point to the entity;

(f) executing the third instruction to alter the entity using an alteration algorithm to include a different directly executable instruction; and

(g) repeating steps (b) to (f) until an end criterion is reached.

22. A system as in claim 21, in which:

the first instruction points to and designates machine code stored in the memory as data by casting a pointer thereto as a data pointer; and

the second instruction points to and designates machine code stored in the memory as directly executable code by casting a pointer thereto as a function pointer.

23. A system as in claim 21, in which:

the first instruction points to and designates machine code stored in the memory as data by creating a data pointer thereto; and

the second instruction points to and designates machine code stored in the memory as directly executable code by creating a function pointer thereto.

24. A system as in claim 21, in which:

step (a) comprises creating the entity as comprising a header and a footer; and

step (f) comprises preventing the header and footer from being altered.

25. A system as in claim 21, in which:

step (a) comprises creating the entity as comprising a return instruction; and

step (f) comprises preventing the return instruction from being altered.

26. A system as in claim 21, in which the learning algorithm in step (d) and the alteration algorithm in step (f) in combination comprise a genetic algorithm.

27. A system as in claim 21, in which step (a) comprises creating the entity as comprising a plurality of directly executable instructions.

28. A system as in claim 27, in which step (a) comprises randomly selecting the directly executable instructions from a set of directly executable instructions.

29. A system as in claim 27, in which step (f) comprises genetically altering the directly executable instructions.

30. A system as in claim 27, in which:

one of the directly executable instructions comprises an operator and an operand; and

step (f) comprises genetically mutating the operand.

31. A system as in claim 27, in which two of the directly executable instructions comprise operators respectively;

and

step (f) comprises genetically crossing the operators.

32. A system as in claim 21, in which:

step (a) comprises randomly selecting the directly executable instruction from a set of directly executable instructions.

33. A system as in claim 21, in which step (f) comprises genetically altering the directly executable instruction.

34. A system as in claim 21, in which:

the directly executable instruction comprises an operator and an operand; and

step (f) comprises genetically mutating the operand.

35. A system as in claim 21, in which:

the memory comprises a main memory and a processor memory that is part of the processor; and

step (a) comprises storing the entity in the processor memory.

36. A system as in claim 35, comprising an integrated circuit chip, in which the processor and the processor memory are formed on the chip.

37. A system as in claim 36, in which at least a portion of the program is stored processor memory.

38. A system as in claim 37, in which:

the processor memory comprises a non-volatile memory section; and

said at least a portion of the program is stored in the non-volatile memory section.

39. A method of creating and executing machine code for learning using a digital computer which includes a processor and a memory, comprising the steps of:

(a) selecting a directly executable machine code program instruction which includes run time data;

(b) determining a binary number which represents the program instruction to the processor;

(c) selecting a location in the memory;

(d) creating a directly executable machine code entity which includes the binary number;

(e) storing the entity as data in said location;

(f) providing an indirectly executable instruction which causes the processor to directly execute machine code stored in said location; and

(g) controlling the processor to process the indirectly executable instruction, resulting in the processor directly executing the entity as including the program instruction.

40. A method as in claim 39, in which step (f) comprises providing the indirectly executable instruction such that said processing thereof in step (g) includes compiling.

41. A method as in claim 39, in which step (f) comprises providing the indirectly executable instruction such that said processing thereof in step (g) includes interpreting.

42. A method as in claim 39, in which step (f) comprises creating the indirectly executable instruction such that said processing thereof in step (g) includes assembling.

43. A method as in claim 39, further comprising the step of:

(h) repeating step (g) at least one time.

44. A method as in claim 39, further comprising the step of:

(h) evaluating a result produced by executing the program instruction in step (g).

45. A method as in claim 39, further comprising the step, performed after step (g), of:

(h) altering the entity as data such that the binary number is changed to represent a different directly executable machine code program instruction to the processor.

46. A method as in claim 45, further comprising the step, performed after step (h), of:

(i) controlling the processor to process the indirectly executable instruction, resulting in the processor directly executing the entity as including the program instruction.

47. A method as in claim 46, further comprising the step of:

(j) evaluating a result produced by executing the program instruction in step (i).

48. A method as in claim 39, further comprising the steps, performed after step (g), of:

(h) copying the entity to produce a copied entity; and

(i) altering the copied entity as data such that the binary number is changed to represent a different directly executable machine code program instruction to the processor.

49. A method as in claim 39, further comprising the steps of:

(h) evaluating a result produced by executing the program instruction in step (g);

(i) altering the entity as data such that the binary number is changed to represent a different directly executable machine code program instruction to the processor;

(j) controlling the processor to process the indirectly executable instruction, resulting in the processor directly executing the entity as including the program instruction; and

(k) evaluating a result produced by executing the program instruction in step (j).

50. A method as in claim 49, further comprising the step of:

(l) comparing the evaluation of step (k) with the evaluation of step (h).

51. A method as in claim 50, further comprising the step of:

(m) selecting a subsequent action in accordance with said comparison of step (l).

52. A method as in claim 39, in which step (d) comprises creating the entity to further include a return instruction.

53. A method as in claim 52, further comprising the steps, performed after step (g), of:

(h) altering the entity as data such that the binary number is changed to represent a different directly executable machine code program instruction to the processor; and

(i) preventing the return instruction from being altered while performing step (h).

54. A method as in claim 52, further comprising the steps, performed after step (g), of:

(h) altering the entity as data such that the binary number is changed to represent a different directly executable machine code program instruction to the processor, and the return instruction is allowed to be altered; and

(i) restoring the return instruction to original state after alteration in step (h).

55. A method as in claim 39, in which step (d) comprises creating the entity to further include at least one of a header and a footer.

56. A method as in claim 55, further comprising the steps, performed after step (g), of:

(h) altering the entity as data such that the binary number is changed to represent a different directly executable machine code program instruction to the processor; and

(i) preventing said at least one of a header and a footer from being altered while performing step (h).

57. A method as in claim 55, further comprising the steps, performed after step (g), of:

(h) altering the entity as data such that the binary number is changed to represent a different directly executable machine code program instruction to the processor, and said at least one of a header and a footer is allowed to be altered; and

(i) restoring said at least one of a header and a footer to original state after alteration in step (h).

58. A method as in claim 55, further comprising the steps, performed after step (g), of:

(h) separating the binary number from the entity;

(i) altering the binary number to produce a different binary number which represents a different directly executable machine code program instruction to the processor; and

(j) replacing the binary number with the different binary number in the entity.

59. A method as in claim 39, further comprising the step, performed after step (g), of:

(h) altering the entity as data such that the run time data is changed.

60. A method as in claim 59, further comprising the step, performed after step (h), of:

(i) controlling the processor to process the indirectly executable instruction, resulting in the processor directly executing the entity as including the program instruction.

61. A method as in claim 60, in which step (h) further comprises altering the entity as data such that the binary number is changed to represent a different directly executable machine code program instruction to the processor.

62. A method as in claim 60, further comprising the step of:

(j) evaluating a result produced by executing the program instruction in step (i).

63. A method as in claim 39, further comprising the steps, performed after step (g), of:

(h) copying the entity to produce a copied entity; and

(i) altering the copied entity as data such that the run time data is changed.

64. A method as in claim 39, further comprising the steps of:

(h) evaluating a result produced by executing the program instruction in step (g);

(i) altering the entity as data such that the run time data is changed;

(j) controlling the processor to process the indirectly executable instruction, resulting in the processor directly executing the entity as including the program instruction; and

(k) evaluating a result produced by executing the program instruction in step (j).

65. A method as in claim 64, further comprising the step of:

(l) comparing the evaluation of step (k) with the evaluation of step (h).

66. A method as in claim 65, further comprising the step of:

(m) selecting a subsequent action in accordance with said comparison of step (l).

67. A method as in claim 39, in which step (a) comprises selecting the program instruction from a set of directly executable program instructions.

68. A method as in claim 39, further comprising the step, performed before step (a), of:

selecting a subset of program instructions from a set of directly executable program instructions; and

step (a) comprises selecting the program instruction from said subset.

69. A method as in claim 39, in which:

step (d) comprises creating the program instruction to include run time data; and

the method further comprises the step of;

(h) repeating step (g) for different input values of the run time data.

70. A method as in claim 69, further comprising the step of:

(i) determining a value of the run time data which produces a predetermined result.

71. A method as in claim 69, in which step (h) further comprises repeating step (g) for different program instructions.

72. A method as in claim 39, in which the method further comprises the step, performed after step (g), of:

(h) creating a representation of the entity in a selected computer programming language.

73. A method as in claim 72, in which step (h) comprises decompiling the entity.

74. A method as in claim 39, in which

the method further comprises the steps of:

(h) determining if execution of step (g) produced a predetermined result; and

(i) if step (g) produced said predetermined result, creating a representation of the entity including said input value of the run time data in a selected computer programming language.

75. A method as in claim 74, further comprising the step of:

(j) repeating step (g) for different input values of the run time data;

(k) determining a value of the run time data which produced a predetermined result; and

(1) creating a representation of the entity including said value of the run time data which produced the predetermined result in a selected computer programming language.

76. A method as in claim 39, in which

the method further comprises the step of:

(h) repeating step (g) on the run time data a plurality of times.

77. A method as in claim 76, further comprising the steps of:

(i) altering the run time data; and

(j) repeating step (g) on the run time data which was altered in step (i) a plurality of times.

78. A method as in claim 39, in which step (d) comprises creating the entity to further include additional run time data.

79. A method as in claim 39, in which step (d) comprises creating the program instruction to further include related code which operates on the run time data.

80. A method as in claim 39, in which

step (d) comprises creating the entity such that the program instruction includes a learned element.

81. A method as in claim 80, in which step (d) comprises creating the entity to further include an additional learned element.

82. A method as in claim 80, in which the method performs more than one calculation on the learned element.

83. A method as in claim 39, in which

step (d) comprises creating the entity to further include a learned element, and creating the program instruction to include a conversion element which operates on the learned element.

84. A method as in claim 83, in which the method performs more than one calculation on the learned element.

85. A method as in claim 39, in which:

the computer comprises a plurality of registers;

the method further comprises the step, performed prior to step (d), of;

(h) designating one of the registers as an input register for execution of the entity by the processor; and

step (d) comprises creating the entity to further include a section of directly executable code which, upon execution thereof during step (g), causes the processor to store input data in the input register prior to execution of the program instruction.

86. A method as in claim 85, further comprising the step, performed prior to step (d), of:

(i) storing the input data in the memory;

in which the directly executable code in said section causes the processor to transfer the input data from the memory to the input register.

87. A method as in claim 85, in which said section comprises a header of the entity.

88. A method as in claim 85, further comprising the step of:

(i) preventing said section from being altered while performing step (g).

89. A method as in claim 39, in which:

the computer comprises a plurality of registers;

the method further comprises the step, performed prior to step (d), of;

(h) designating one of the registers as a calculation register for execution of the entity by the processor; and

step (d) comprises creating the entity to further include a section of directly executable code which causes the processor to store a predetermined value in the calculation register prior to execution of the program instruction.

90. A method as in claim 39, in which:

the computer comprises a plurality of registers;

the method further comprises the step, performed prior to step (d), of;

(h) designating one of the registers as a state register for execution of the entity by the processor; and

step (d) comprises creating the entity to further include a section of directly executable code which causes the processor to store a state value which was produced by a previous execution of the program instruction in the state register prior to execution of the program instruction.

91. A method as in claim 90, in which:

the state value is stored in the memory prior to executing step (g); and

the directly executable code in said section causes the processor to transfer the state value from the memory to the state register.

92. A method as in claim 39, in which:

the computer comprises a plurality of registers;

the method further comprises the step, performed prior to step (d), of;

(h) designating one of the registers as an output register for execution of the entity by the processor; and

step (d) comprises creating the entity to further include a section of directly executable code which, upon execution thereof during step (g), causes the processor to store output run time data which is produced by execution of the program instruction in the output register.

93. A method as in claim 92, in which the directly executable code in said section further causes the processor to transfer the output run time data from the output register to the memory.

94. A method as in claim 92, in which said section comprises a footer of the entity.

95. A method as in claim 92, further comprising the step of:

(i) preventing said section footer from being altered while performing step (g).

96. A method as in claim 39, in which:

the computer comprises a plurality of registers;

the method further comprises the step, performed prior to step (d), of;

(h) designating one of the registers as a calculation register for execution of the entity by the processor; and

step (d) comprises creating the entity to further include a first instruction which causes the processor to read a calculation value which was produced by a previous execution of the program instruction from the calculation register; and

a second instruction which causes the processor to store a calculation value produced by a current execution of the program instruction in the calculation register.

97. A method as in claim 96, in which the first instruction causes the processor to transfer the calculation value from the calculation register to the memory.

98. A method as in claim 39, in which:

the computer comprises a plurality of registers;

the method further comprises the step, performed prior to step (d), of;

(h) designating one of the registers as a state register for execution of the entity by the processor; and

step (d) comprises creating the entity to further include a section of directly executable code which causes the processor to store a state value which is produced by execution of the program instruction in the state register.

99. A method as in claim 98, in which in which the directly executable code in said section further causes the processor to transfer the state value from the state register to the memory.

100. A method as in claim 39, in which:

the computer comprises a plurality of registers; and

the method further comprises the step, performed prior to step (b), of;

(h) designating one of the registers as an input register for execution of the entity by the processor.

101. A method as in claim 100, in which step (f) comprises providing the indirectly executable instruction such that the processor will store input data in the input register prior to execution of the program instruction.

102. A method as in claim 39, in which:

the computer comprises a plurality of registers; and

the method further comprises the step, performed prior to step (b);

of;

(h) designating one of the registers as a calculation register for execution of the entity by the processor.

103. A method as in claim 102, in which step (f) comprises providing the indirectly executable instruction such that the processor will store a predetermined value in the calculation register prior to execution of the program instruction.

104. A method as in claim 39, in which:

the computer comprises a plurality of registers; and

the method further comprises the step, performed prior to step (b);

of;

(h) designating one of the registers as a state register for execution of the entity by the processor.

105. A method as in claim 104, in which step (f) comprises providing the indirectly executable instruction such that the processor will store a state value which was produced by execution of a previous program instruction in the state register prior to execution of the program instruction.

106. A method as in claim 39, in which:

the computer comprises a plurality of registers; and

the method further comprises the step, performed prior to step (b);

of;

(h) designating one of the registers as an output register for execution of the entity by the processor.

107. A method as in claim 106, in which step (f) comprises providing the indirectly executable instruction such that the processor will store output data which is produced by execution of the program instruction in the output register.

108. A method as in claim 107, in which step (f) comprises providing the indirectly executable instruction such that the output data is stored in the output register as a return value of the indirectly executable instruction.

109. A method as in claim 39, in which step (d) comprises the substeps of:

(d1) creating the entity to further include a header and a footer; and

(d2) creating a leaf function which includes the program instruction, is pointed to by the header, and returns to the footer upon execution of the entity.

110. A method as in claim 109, in which step (d2) comprises creating the leaf function to further include a return instruction.

111. A method as in claim 109, further comprising the step of:

(h) altering the leaf function as data without altering the header and the footer such that the binary number is changed to represent a different directly executable machine code program instruction to the processor.