Video image processing system

• US 4,916,640 A
• Filed: 06/03/1987
• Issued: 04/10/1990
• Est. Priority Date: 06/03/1987
• Status: Expired due to Term

• Current Assignee: Allen-Bradley Company (Rockwell Automation, Inc.)
• Original Assignee: Allen-Bradley Company (Rockwell Automation, Inc.)
• Inventors: Deklotz, Joseph E., Christian, Donald J., Roszkowski, Richard M., Gasperi, Michael L.
• Primary Examiner(s): Harkcom, Gary V.
• Assistant Examiner(s): Zimmerman, Mark K.
• Application Number:
  US07/057,797
• Time in Patent Office: 1,042 Days
• Field of Search: 364/516, 364/517, 364/560, 364/521, 364/513, 364/474.22-474.27, 382/8, 382/28, 382/38, 382/45, 382/48, 382/50, 382/51
• US Class Current: 382/291
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30108 Industrial image inspection
• CPC Class Codes: G06T 2207/30242 Counting objects in image
• CPC Class Codes: G06T 7/0006 using a design-rule based approach
• CPC Class Codes: G06T 7/0008 checking presence/absence
• CPC Class Codes: G06T 7/73 using feature-based methods

Abstract

A module for a programmable controller is adapted to process a video image to evaluate characteristics of an object within the image. A processor converts an analog video signal into four binary images. A memory stores data defining a separate sensor region for each binary image. A set of four counters is provided to tabulate the pixels of one color in each binary image that lie within the associated sensor region. A video signal sensor measures variation of the luminance of the video signal. The processor uses the luminance variation measurement to adjust the binarization of the video signal to produce normalized binary images under varying lighting conditions.

Claims

1. In a programmable controller having a rack with a backplane for electrically interconnecting a plurality of modules received in the rack, and a program processor for executing a program which operates a machine coupled to the programmable controller;

the improvement comprising a video image processor including;

a microprocessor which executes a program that controls the operation of the video image processor;

means responsive to a trigger signal for acquiring a video image, said video image formed by a plurality of pixels each having a luminance;

means for determining the position of an object within the video image;

means for counting pixels in said video image which have predetermined characteristics, and having an output indicating the result of the counting, said means for counting including;

(a) means for comparing the luminance of pixels in the video image to a threshold value,

(b) a memory for storing data defining a region within the video image,

(c) a counter,

(d) means for shifting the region with respect to the video image in response to said means for determining, and

(e) means responsive to said means for comparing and responsive to the shifted region for controlling the counter; and

means, responsive to the microprocessor, for signaling the program processor that the video image processor has completed processing the image and for transmitting the output of the means for counting to the program processor via the rack backplane.

2. The programmable controller as recited in claim 1 wherein said means for acquiring a video image is responsive to a trigger signal from said program processor.

3. The programmable controller as recited in claim 1 wherein said means for counting tabulates the pixels which have a given luminance relationship to a predetermined threshold value.

4. The programmable controller as recited in claim 3 wherein said means for counting tabulates only the pixels which have the given luminance relationship and which lie within the region of the image.

5. The programmable controller as recited in claim 3 further comprising means for measuring changes in the luminance of a section of the image and varying the threshold value to correspond to changes in the luminance of the section.

6. The programmable controller as recited in claim 1 wherein said means for determining calculates a displacement of the object from a datum position in the image.

7. The programmable controller as recited in claim 6 wherein said memory stores an image of the region.

8. The programmable controller as recited in claim 1 further including means for indicating whether the output of said counting means is within a range of values.

9. An apparatus for processing a video image comprising:

means for simultaneously converting a video signal into a plurality of binary images;

means for defining a region in each of said binary images; and

means for separately counting pixels within the defined regions which have a given binary value.

10. The apparatus as recited in claim 9 further comprising a memory for storing each of the binary images.

11. The apparatus as recited in claim 9 wherein said means for converting includes:

means for storing a separate threshold level for each binary image;

means for comparing the video signal to each of the threshold levels to produce each binary image.

12. The apparatus as recited in claim 9 wherein said means for defining a region in each binary image includes a memory for storing an image representing the region.

13. The apparatus as recited in claim 12 wherein said means for separately counting includes:

separate means for comparing each binary image to the image representing the region defined in that binary image; and

a plurality of separate counters each responsive to a different one of said means for comparing

14. The apparatus as recited in claim 13 wherein said memory has an address input;

and said means for shifting includes means for addressing said memory having a circuit for adding an offset value to the addresses for said memory.

15. The apparatus as recited in claim 12 further comprising:

means for determining the position of an object in the video image;

means, responsive to said means for determining the position, for shifting at least one of the images of a region.

16. A vision input module for a programmable controller comprising:

means for receiving a video image;

means for defining at last one sensing region within said video image and its sensing parameters, said means for defining including a memory for storing a definition of the sensing area and its parameters;

means for determining the position of an object in said video image; and

means for changing the definition of said sensing area in response to the position of the object.

17. The module of claim 16 further comprising means for storing and retrieving the sensing area definitions to and from the programmable controller.

18. The module as in claim 17 wherein the programmable controller includes means for storing multiple sets of sensing area definitions and parameters which sets may be sequentially downloaded to the module for performing different sensing operations.

19. In a programmable controller having a rack with a backplane for electrically interconnecting a plurality of modules received in the rack, and a program processor executing a program which operates a machine coupled to the programmable controller;

the improvement comprising a video image processor including;

a microprocessor which executes a program that controls the operation of the video image processor;

means responsive to a trigger signal for acquiring a video image to process, said video image formed by a plurality of pixels each having a luminance;

means for counting pixels in said video image which have predetermined characteristics, and having an output indicating the result of the counting;

means, responsive to the microprocessor, for signaling the program processor that the video image processor has completed processing the image and for transmitting the output of the means for counting to the program processor via the rack backplane; and

means for defining the predetermined characteristics including a video monitor, means for displaying on said monitor a menu consisting of a series of icons depicting characteristics defining functions, and means for an operator to select an icon.

20. The programmable controller as recited in claim 19 wherein said means to select an icon comprises a light pen.