Image analysis system and method

• US 4,653,109 A
• Filed: 07/30/1984
• Issued: 03/24/1987
• Est. Priority Date: 07/30/1984
• Status: Expired due to Term

• Current Assignee: Grund, Christian, Jerome H. Lemelson
• Original Assignee: Grund, Christian, Jerome H. Lemelson
• Inventors: Grund, Christian, Lemelson, Jerome H.
• Primary Examiner(s): Ciarlante, Anthony V.
• Application Number:
  US06/635,758
• Time in Patent Office: 967 Days
• Field of Search: 382/34, 382/30, 358/105, 343/5 MM
• US Class Current: 382/107
• CPC Class Codes: G06T 7/00 Image analysis

Abstract

A scanning and monitoring system employing automatic image analysis of an image field, object or group of objects over a period of time together with the detection and analysis of one or more other variables, such as generated by sensors sensing changes in or degrees of magnetism, magnetic spin, self radiation, induced radiation, color, temperature, internal structure such as grain or crystalline structure, flow and/or other variables relating to selected objects in an image field under analysis and/or selected portions of such image field. Image information derived from the analysis of reflected light, X-ray, sonic, magnetic spin or nuclear magnetic resonance or other variable or a combination of such variables, is sensed, converted to signals such as analog video signals which are digitized and automatically computer analyzed with time wherein the time variable is recorded by means of codes and used in the automatic analysis. Information is computed defining such variables as changes in position attitude, size, shape, number, distribution, velocity, direction of travel, spin or rotation, color, surface structure, etc. of a selected object or objects in an image field or fields under study or surveillance and such information is recorded and/or used to drive or operate a display, alarm or speech generator, printer or other device such as a control for a motor or operating device which is operable to control or change one or more variables associated with the field being scanned and analyzed.

Claims

1. A method of analyzing changing events comprising:

scanning a first image field during a first interval of time with a sensing means and generating a first video signal on the output of said first sensing means,

computer processing and analyzing said first video signal and generating first code signals indicative of characteristics of the image content of at least a portion of said image field scanned,

recording said first code signals in a first memory,

scanning said first image field a second time with said sensing means and during an interval which occurs after the completion of said first scanning operation and after a change has taken place in the contents of the image field scanned, and generating a second video signal on an output of said sensing means,

computer processing and analyzing said second video signal and generating a second code signal,

recording said second code signal in a second memory,

reproducing said first and second recordings of said first and second code signals from said first and second memories,

computer analyzing said first and second code signals and automatically detecting differences therein, and

generating a third code signal defining information about said change in said image field,

recording said third code signal,

thereafter repeatedly scanning said image field a number of times and repeating the procedure of computer analyzing each video signal generated, and

generating further code signals defining further changes in the content of the image field occurring between each of said scannings, recording said latter code signals as they are generated and further computer analyzing same in a manner to detect changes in the content of the image field over an extended period of time and determining a trend in the change in image content of said image field.

2. A method in accordance with claim 1 wherein the trend which is automatically detected is a change in the velocity of flow of a fluid, such as a body of water, in the image field scanned.

3. A method in accordance with claim 2 wherein the trend which is automatically detected is the direction of flow of a fluid in the image field scanned, further including generating signals indicating such trend and updating the image information generated and the analysis of the image field scanned.

4. A method in accordance with claim 1 wherein the trend which is automatically detected is a change in color of a portion of the image field scanned.

5. A method in accordance with claim 1 wherein the change in the image field scanned which is automatically detected as the result of such computer analysis, is the content of a select portion of the field scanned by said first field scanning means.

6. A method in accordance with claim 1 wherein the detected change in content which is detected, is an increase in the area of a specific portion of the image field.

7. A method in accordance with claim 1 wherein the change, which is detected, in content of the image field scanned is an increase in area of a specific portion of the image field scanned by said sensing means.

8. A method in accordance with claim 1 wherein the image field scanned contains a plurality of particles moving through such field and the information generated by computer analysis of said video signals is operable to define a number of particles moving into and out of the image field scanned during a select period of time.

9. A method in accordance with claim 1 wherein the change in the image field scanned comprises a shift in the location of a specific portion of the image field scanned.

10. A method in accordance with claim 1 wherein the change in the image field scanned comprises a change in dimension of a specific portion of the image field scanned.

11. A method in accordance with claim 1 wherein the detected change in the image field scanned comprises a change in the direction of movement of a specific portion of the field scanned.

12. A method in accordance with claim 1 wherein the detected change in the image field scanned is a change in direction and velocity of a portion of the image field scanned.

13. A method in accordance with claim 1 including programming a computer means to detect a predetermined change in the content of the image field scanned.

14. A method in accordance with claim 13 including programming a computer means to detect one or more of a plurality of predetermined changes in said image field scanned.

15. A method in accordance with claim 1 which includes computer analyzing signals generated in scanning the image field over a period of time and detecting changes in a plurality of variables occuring in the image field over the interval of time during which scanning is effected.

16. A method in accordance with claim 1 wherein said trend in said change in said image content of said image field is determined by generating code signals indicative of said trend and applying said code signals to intelligibly indicate said trend.

17. A method of analyzing a changing condition comprising generating electrical analog signals which are indicative of a changing condition,

processing said electrical analog signals by digitizing same and generating digital signals thereof,

computer analyzing the digital signals so generated and generating, as a result of such computer analysis, code signals which are indicative of at least one rate of change of said changing condition, and

applying said latter code signals to an indicating means so as to indicate the rate of change of said changing condition.

18. A method in accordance with claim 17 which includes employing said latter code signals to control a means for affecting and further changing said changing condition.

19. A method in accordance with claim 18 which includes employing said latter code signals to vary the operation of a servo motor for changing said changing condition.

20. A method in accordance with claim 18 wherein said changing condition is affected by a variation in temperature, said method including employing said latter code signals to affect a change in the temperature of said changing condition to variably change said changing condition.

21. A method in accordance with claim 18 wherein said changing condition is affected by the rate of flow of a fluid, said method including employing said latter generated code signals to vary said fluid rate of flow to affect a change in said changing condition.

22. A method in accordance with claim 21 including recording the digital code signals generated at respective locations of a memory having respective time codes recorded therein, which time codes may be reproduced therefrom with selected information from said memory so as to indicate the times selected variations occured in the image field scanned.

23. A method in accordance with claim 22 wherein the image field scanned contains at least one portion thereof which varies in location in such image field, said method including generating digital code signals which vary in accordance with variations in the location of said selected portions, computer analyzing said digital code signals and generating information signals indicative of the degree of such variation and the location of said selected portion.

24. A method in accordance with claim 23 wherein the image field scanned contains at least one portion thereof which is in rotational motion and generating information signals indicative of the degree of such rotational movement.

25. A method in accordance with claim 23 wherein the portion thereof of the image field scanned is in translation, said method including generating information signals indicative of the degree of said such translation.

26. A method in accordance with claim 23 wherein the image field scanned contains at least one portion which is in rotational and translational motion, said method including generating information signals which are indicative of the degree of rotational and translational movements.

27. A method in accordance with claim 26 wherein the image field scanned contains at least one portion which is contracting in size, said method including generating code signals which are indicative of the rate of contraction thereof.

28. A method in accordance with claim 23 wherein the image field scanned contains at least one portion thereof which is expanding in size, said method including generating code signals which are indicative of the degree of expansion of said portion which is expanding.

29. A method in accordance with claim 23 wherein the image field scanned contains at least one portion which is changing in shape, said method including generating code signals which are indicative of the change in shape of said portion.

30. A method in accordance with claim 23 wherein the image field scanned contains a plurality of portions which are changing in shape, said method including generating a plurality of code signals which are indicative of the change in shape of said plurality of portions and are indicative of the locations of such plurality of portions.

31. A method in accordance with claim 23 wherein the image field scanned contains a plurality of portions thereof which change in shape and position with time, said method including generating code signals which are indicative of the changes in shape and the positions of said plurality of portions of the image field scanned.

32. A method in accordance with claim 23 wherein the image field scanned contains a plurality of portions thereof which change in color, said method including generating a plurality of code signals which are indicative of the changes in color of said plurality of portions.

33. A method in accordance with claim 22 including automatically calculating variations in velocity of the selected portion of the image field scanned with time.

34. A method in accordance with claim 22 including automatically calculating variations in the acceleration of the selected portion of the image field scanned.

35. A method in accordance with claim 22 including automatically calculating the degree of a variation in the selected portion of the image field scanned and generating digital code signals indicative of the variations in said degree.

36. A method of analyzing image information comprising scanning an image field, which changes with time, with an electro-optical scanning means which is operated continuously over the span of time it takes for a detectable change to take place in said image field, and generating on an output of said scanning means an analog signal which varies in amplitude over such time-span and wherein the variations of said analog signal define the varying characteristics of the image field scanned, processing and analyzing the signals generated on the output of said scanning means over said period of time and generating computed information signals which are indicative of quantitative variations in at least certain of the variables which occur in said image field over said period of time.

37. A method in accordance with claim 36 wherein the analysis of the signals generated on the output of the scanning means is operable to generate information signals which are indicative of both quantitative variations in the image field content of the field scanned and time from a starting time.

38. A method in accordance with claim 36 wherein the analysis of the signals generated on the output of the scanning means is operable to generate information signals which are indicative of quantitative variations in the image content of the field scanned and such information signals are in digital code form.

39. A method in accordance with claim 38 wherein digital code signals are generated which are indicative of both variations in the content and increments in time from a start-scanning time.

40. A system for analyzing changing events comprising:

first means for scanning an image field which changes in content with time, wherein said scanning is caused to occur a plurality of times and wherein each scanning results in generating scanning signals which vary in accordance with variations in physical characteristics of the image field scanned,

second means for receiving, processing and analyzing said scanning signals and generating first code signals which are indicative of respective instant values of said physical characteristics of said image field, each time said image field is scanned by said first means,

thrid means for generating second code signals at fixed times with respect to each scanning, each of which second code signals is indicative of the time a scanning takes place by said first means,

fourth means including a computer for receiving said first and second signals, analyzing same and generating information signals which define select changes which occurred in the image field between the plurality of scannings effected by said first means.

41. A system in accordance with claim 40 including memory means for recording at least a portion of the information signals so generated and means for selectively reproducing signals from said memory means.

42. A system in accordance with claim 40 including means responsive to said information signals for effecting a controlled change in the content of the image field scanned.

43. A system in accordance with claim 40 including means for controlling a process relating to the image field scanned and responsive to control signals and means responsive to said information signals generated by said fourth means for generating control signals and applying same to said latter means for effecting control of said process.