Apparatus and methods for automated observation of objects

• US 5,351,078 A
• Filed: 09/16/1993
• Issued: 09/27/1994
• Est. Priority Date: 12/24/1954
• Status: Expired due to Fees

• Current Assignee: Lemelson Medical, Education & Research Foundation LP
• Original Assignee: Lemelson Medical, Education & Research Foundation LP
• Inventors: Lemelson, Jerome H.
• Primary Examiner(s): Groody, James J.
• Assistant Examiner(s): Metjahic, Safet
• Application Number:
  US08/122,888
• Time in Patent Office: 376 Days
• Field of Search: 348/135, 348/143, 348/130, 348/129, 348/128, 348/125, 348/91, 348/92, 348/94, 348/95, 348/86, 348/161, 348/162, 348/61, 348/87, 348/126, 356/237
• US Class Current: 348/135
• CPC Class Codes: H04N 5/765 Interface circuits between an apparatus for recording and another apparatus
• CPC Class Codes: H04N 5/77 between a recording apparatus and a television camera
• CPC Class Codes: H04N 5/7822 with stationary magnetic heads
• CPC Class Codes: H04N 5/9201 involving the multiplexing of an additional signal and the video signal
• CPC Class Codes: H04N 5/9205 the additional signal being at least another television signal

Abstract

Apparatus and methods are disclosed for automatically inspecting two- or three-dimensional objects or subjects. A detector and the object are moved relative to each other. In one form, a detector, such as a camera or radiation receiver, moves around an object, which is supported to be rotatable such that the detector may receive electromagnetic energy signals from the object from a variety of angles. The energy may be directed as a beam at and reflected from the object, as for visible light, or passed through the object, as for x-ray radiation. Alternatively, the detector passively receives energy from the object, as in an infrared detector. The detector generates analog image signals resulting from the detected radiation, and an electronic computer process and analyzes the analog signals and generates digital codes, which may be stored or employed to control a display.

Claims

1. A method for automatically observing objects comprising:

(a) supporting an object at an observation station, and employing an imaging device to control the positioning of said object relative to the observation station;

(b) causing the object to modulate electromagnetic energy signals;

(c) detecting electromagnetic energy signals modulated by a first portion of said object;

(d) detecting electromagnetic energy signals modulated by a second portion of said object;

(e) computer-processing the detected energy signals and generating and storing electronic image signals representing a physical characteristic of the object;

(f) computer-analyzing the stored image signals and generating code signals representing further physical characteristics of the object; and

(g) storing a plurality of command control signals at selectable locations of a signal storage device, and reproducing and using selected of said stored command control signals to control at least one of the positioning, detecting, computer-processing, and computer-analyzing acts.

2. A method in accordance with claim 1 further including storing the generated image signals in said signal storage device.

3. A method in accordance with claim 2 further comprising selectively reproducing image signals from the signal storage device.

4. A method in accordance with claim 3 further comprising comparing the reproduced image signals with previously stored image signals.

5. A method in accordance with claim 1 further comprising computer-processing and analyzing detected electromagnetic energy signals modulated by a select two dimensional area of the object.

6. A method in accordance with claim 1 further comprising generating a plurality of image signals representing variations in electromagnetic energy detected from different portions of the observed object.

7. A method in accordance with claim 1 further comprising processing the image signals and employing them to control the display of information about at least a portion of the object.

8. A method in accordance with claim 1 wherein causing the object to modulate electromagnetic energy includes generating and directing radiation at the object.

9. A method in accordance with claim 8 wherein the act of detecting modulated energy signals includes detecting radiation reflected from the object.

10. A method in accordance with claim 8 wherein the act of detecting modulated energy signals includes detecting radiation passed through the object.

11. A method in accordance with claim 1 further comprising:

(a) storing the image signals in the signal storage device along with codes that identify storage locations of associated image signals; and

(b) employing said codes to locate in and reproduce from the storage device selected of the image signals.

12. A method in accordance with claim 1 further comprising detecting electromagnetic energy signals modulated by select portions of the object by controlling relative three-dimensional movement between the object and a radiation sensing unit.

13. A method in accordance with claim 12 further comprising detecting electromagnetic energy signals modulated by selected outer surfaces of an object by controlling a moveable arm member upon which the radiation sensing unit is mounted to move in three dimensions relative to the object.

14. A method in accordance with claim 13 further comprising controlling the path traveled by the sensing unit by applying select command control signals.

15. An apparatus for the automatic image analysis of objects comprising:

(a) a support;

(b) a detector of electromagnetic radiation emanating from a portion of an object supported by the support and including an output on which signals representing the detected radiation are placed;

(c) an electronic storage device having an addressing and reproduction unit that can selectively address and reproduce a plurality of stored command control signals;

(d) a controller coupled to said storage device and including an input for command control signals reproduced from said storage device and a circuit that applies said reproduced command control signals to cause said detector to detect radiation emanating from a plurality of different portions of an object supported by said support;

(e) a signal analyzer coupled to the detector and including circuitry capable of processing said radiation signals produced by said detector and an output for resulting image signals representing select portions of an object supported by said support;

(f) an electronic image-signal storage device coupled the output of the signal analyzer; and

(g) a computer coupled to the storage device and configured to analyze stored image signals and to generate electrical code signals representing physical characteristics of an object supported by said support.

16. An apparatus in accordance with claim 15 wherein the storage device includes an addressable recording unit, and wherein the signal analyzer is coupled to said recording unit so as to permit storage of generated image signals with the storage device.

17. An apparatus in accordance with claim 16 wherein the addressable recording unit can be controlled to selectively reproduce image signals from the storage device.

18. An apparatus in accordance with claim 17 further comprising an electronic comparator coupled to the addressable recording unit that compares reproduced image signals passed over the output of the signal analyzer with previously stored signals.

19. An apparatus in accordance with claim 15 wherein said signal analyzer processes output signals defining detected radiation emanating from a select portion of an object supported by the support, which portion extends in at least two dimensions.

20. An apparatus in accordance with claim 15 wherein said controller is coupled to said detector and is configured to automatically control the operation of said detector to generate a plurality of output signals representing the radiation detected from different portions of an object supported by said support.

21. An apparatus in accordance with claim 15 further comprising an indicating device that indicates information relating to a select portion of an object supported by said support, said indicating device being coupled to said computer to permit said computer to to control said indicating device.

22. An apparatus in accordance with claim 21 further including an electronic modifying device controllable to modify the electrical code signals to alter the indicated information.

23. An apparatus in accordance with claim 15 further comprising an electromagnetic radiation generator controllable to direct a radiation beam at an object supported by said support.

24. An apparatus in accordance with claim 15 wherein said detector detects radiation reflected from an object supported by said support.

25. An apparatus in accordance with claim 15 wherein said detector detects radiation passed through a three-dimensional object.

26. An apparatus in accordance with claim 15 wherein said detector detects x-ray radiation.

27. An apparatus in accordance with claim 15 wherein said controller comprises a positioning controller coupled to said support and operable to cause the support to rotate relative to the detector so as to present various portions of an object supported by said support to the detector.

28. An apparatus in accordance with claim 27 wherein said positioning controller includes an movable mount that moves the support along three mutually perpendicular axes to present selected portions of the object'"'"'s outer surfaces to the detector.

29. An apparatus in accordance with claim 15 wherein said controller comprises a positioning controller coupled to said detector and operable to cause the detector to move relative to an object supported by said support.

30. An apparatus in accordance with claim 15 wherein said detector comprises a plurality of detection devices, each of which is positioned to detect radiation from a respective portion of an object supported by said support.

31. An apparatus in accordance with claim 15 wherein said computer analyzes selected recorded image signals to determine if a quantitative value of a characteristic of the analyzed object is within a specified tolerance.

32. An apparatus in accordance with claim 15 wherein said computer generates feedback signals controlling operation of the generator.

33. An apparatus in accordance with claim 32 wherein said computer also generates feedback signals controlling operation of the detector.

34. An apparatus in accordance with claim 15 wherein said computer includes a comparison device that compares selectively reproduced, previously stored data to said image signals.

35. An apparatus in accordance with claim 15 wherein said electrical code signals include an error signal.

36. An apparatus in accordance with claim 15 wherein said computer stores said code signals in an electronic storage device.

37. An apparatus in accordance with claim 36 further comprising:

(a) a storage controller coupled to said electronic storage device to control the storage device to store reference data and to reproduce said code signals and selected of the stored reference data from said electronic storage device; and

(b) a comparator that compares said electrical code signals with said reference data to generate further code signals.

38. An apparatus in accordance with claim 37 further comprising:

(a) a further inspection device controllable to inspect an object supported by said support; and

(b) an inspection-device controller coupled to the further inspection device and responsive to said further code signals.

39. An apparatus in accordance with claim 15 further comprising:

(a) an imaging device that scans and identifies a plurality of reflecting marks on the surface of an object supported by said support;

(b) an identification system coupled to the imaging device that generates electrical signals indicative of the identity of said object; and

(c) a second controller coupled to the identification system and the first controller that applies the generated electrical signals to select particular command control signals for reproduction from the storage device.

40. An apparatus for automated observation comprising:

(a) a support defining an observation station;

(b) a detector including a sensor of electromagnetic energy signals emanating from at least a portion of an object supported by said support and electronic circuitry configured to detect variations in the signals defining at least one image characteristic of an object supported by said support;

(c) an electro-mechanical assembly controllable to cause said support and said detector to move relative to each other;

(d) a generator of image signals representing a characteristic defined by the detected energy signals, which is coupled to the detector;

(e) a storage device coupled to the generator capable of storing the image signals along with (i) associated codes that identify the storage locations of the storage device, and (ii) a plurality of command control signals;

(f) a computer coupled to the storage device to cause the storage device to selectively reproduce and use selected command control signals to automatically control the electro-mechanical assembly to effect controlled relative movement of the support and the detector; and

(g) an electronic processor coupled to the storage device to control the location therein and reproduction therefrom of selected image signals, and including circuitry for analyzing the selected image signals to generate electrical code signals defining an image characteristic of said object.

41. An apparatus in accordance with claim 40 wherein the electronic processor is coupled to the image-signal generator and uses the reproduced command control signals to control the image-signal generator.

42. A method for automatically generating, interpreting, and using image information related to an object comprising:

(a) aligning an object at a predetermined position by conducting a preliminary imaging operation;

(b) examining the aligned object by detecting radiant energy illuminating the object, which energy is modulated by physical characteristics of the object;

(c) generating characteristic electrical signals by varying a signal in accordance with the modulated radiant energy that is detected;

(d) storing the generated characteristic electrical signals by locating said signals in an addressable electronic storage;

(e) storing command control and reference data signals applicable to effect computer analysis and interpretation of stored characteristic electrical signals by locating said signals in an addressable electronic storage;

(f) deriving image information about the object by retrieving stored characteristic electical signals and command control and data signals from the addressable electronic storage and computer-analyzing the retrieved characteristic electrical signals;

(g) saving the derived image information by producing and storing in an addressable electronic storage coded electrical signals defining the derived image information; and

(h) outputting further control signals applicable to control electrical equipment by reproducing and using the coded electrical signals.

43. A method in accordance with claim 42 further comprising applying radiant energy to illuminate the object by directing a collimated beam of radiant energy at the object.

44. A method in accordance with claim 43 wherein directing a collimated beam of radiant energy comprises using a light beam.

45. A method in accordance with claim 44 wherein using a light beam comprises scanning the object in a lineal path.

46. A method in accordance with claim 44 wherein using a light beam comprises scanning the object in multiple lineal paths.

47. A method in accordance with claim 44 wherein using a light beam comprises scanning the object in multiple angulated paths.

48. A method in accordance with claim 42 further comprising applying radiant energy to illuminate the object by using flood illumination.

49. A method in accordance with claim 42 further comprising applying radiant energy to illuminate the object by using x-ray radiation.

50. A method in accordance with claim 42 wherein generating characteristic electrical signals includes varying a signal in response to select portions of the object.

51. A method in accordance with claim 42 wherein outputting further control signals includes producing feedback control signals and using said signals to further control the operation of the imaging system.

52. A method in accordance with claim 51 wherein using said signals to further control the operation of the imaging system includes using said feedback control signals cause the imaging system to scan select image areas.

53. A method in accordance with claim 42 wherein outputting further control signals includes producing feedback control signals and using said signals to control relative movement between the object and the imaging system.

54. A method in accordance with claim 53 wherein using said signals to control relative movement includes using the feedback control signals to cause the imaging system to move in a prescribed path relative to the object.

55. A method in accordance with claim 42 wherein storing reference data signals includes storing signals defining select image phenomena to be detected by the imaging system.

56. A method in accordance with claim 55 wherein at least one of said select image phenomena is a mark.

57. A method in accordance with claim 55 wherein at least one of said select image phenomena consists of alternate areas of contrasting dark and light reflectivity.

58. A method in accordance with claim 55 wherein at least one of said select image phenomena is a flaw.

59. A method in accordance with claim 55 wherein at least one of said select image phenomena is a hole.

60. A method in accordance with claim 55 wherein at least one of said select image phenomena is a particular shape.

61. A method in accordance with claim 42 wherein storing reference data signals includes storing signals defining desired dimensions of the object.

62. A method in accordance with claim 42 wherein storing reference data signals includes storing signals defining desired locations of select image phenomena.

63. A method in accordance with claim 42 wherein storing reference data signals includes storing signals defining dimensional tolerances.

64. A method in accordance with claim 42 wherein outputting further control signals includes producing and applying a signal to cause a tool to operate on the object.

65. A method in accordance with claim 42 wherein outputting further control signals includes producing and applying a signal to intelligibly indicated information about the object.

66. A method in accordance with claim 42 further comprising repeating acts (b) through (g) for different successive imaging operations as defined by the command control and reference data signals.

67. A method in accordance with claim 42 wherein detecting radiant energy comprises using a camera to measure the intensity of said radiation.

68. A method in accordance with claim 42 wherein detecting radiant energy comprises using a photoelectric cell to detect said radiation.