Human-machine-interface and method for manipulating data in a machine vision system

• US 8,782,553 B2
• Filed: 08/24/2010
• Issued: 07/15/2014
• Est. Priority Date: 06/09/2004
• Status: Active Grant

• Current Assignee: Cognex Corporation
• Original Assignee: Cognex Corporation
• Inventors: Tremblay, Robert, Phillips, Brian, Keating, John, Eames, Andrew, Whitman, Steven M., Mirtich, Brian, Arbogast, Carroll McNeill Jr.
• Primary Examiner(s): LEGGETT, ANDREA C.
• Application Number:
  US12/862,135
• Publication Number:
  US 20100318936A1
• Time in Patent Office: 1,421 Days
• Field of Search: 715/970, 715/788
• US Class Current: 715/788
• CPC Class Codes: G06F 18/40 Software arrangements specially adapted for pattern recognition, e.g. user interfaces or toolboxes therefor
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 7/0004 Industrial image inspection
• CPC Class Codes: G06V 10/945 User interactive design; Environments; Toolboxes
• CPC Class Codes: H04N 23/00 Cameras or camera modules comprising electronic image sensors; Control thereof
• CPC Class Codes: Y10S 715/972 Inserted real-time video in operator interface

Abstract

This invention provides a Graphical User Interface (GUI) that operates in connection with a machine vision detector or other machine vision system, which provides a highly intuitive and industrial machine-like appearance and layout. The GUI includes a centralized image frame window surrounded by panes having buttons and specific interface components that the user employs in each step of a machine vision system set up and run procedure. One pane allows the user to view and manipulate a recorded filmstrip of image thumbnails taken in a sequence, and provides the filmstrip with specialized highlighting (colors or patterns) that indicate useful information about the underlying images. The programming of logic is performed using a programming window that includes a ladder logic arrangement.

Claims

1. A non-transitory graphical user interface (GUI) display for setup and testing of machine vision systems comprising:

an image frame pane in which recorded and real time images of an object acquired by an interconnected vision system are displayed as discrete frames;

at least one box in which the user performs interface functions in connection with each of a plurality of different and discrete procedures to set up and run a machine vision job using the interconnected vision system; and

a plurality of buttons, arranged in a sequential order across a portion of the GUI, the buttons defining each of the plurality of different and discrete procedures, the sequential order corresponding to a predetermined order in which the procedures occur to set up and run a machine vision job, wherein at least one of the plurality of buttons provide interface functions so that the user can configure rungs of ladder logic that uses results provided by the vision system.

2. The non-transitory GUI display as set forth in claim 1 wherein the buttons include a first set of buttons that provide interface functions in the box so that the user can identify the machine vision job, connect to the vision system, and set up imaging functions in the vision system.

3. The non-transitory GUI display as set forth in claim 2 wherein the buttons include a second set of buttons that provide interface functions in the box so that the user can train the vision system to locate an object and identify predetermined features on the object.

4. The non-transitory GUI display as set forth in claim 3 wherein the second set of buttons provides controls that allow the user to select locators that allow the object to be located in the image field of view and sensors that allow predetermined parameters of the features of the object to be identified by the vision system and a resulting high or low value to be assigned to the results.

5. The non-transitory GUI display as set forth in claim 3 wherein the buttons include a third set of buttons that provide interface functions so that the user can configure rungs of ladder logic that uses results provided by the vision system on the features as contacts on the rungs to provide discrete high or low output coils for each of the rungs.

6. The non-transitory GUI display as set forth in claim 5 wherein the output coils are constructed and arranged to be provided as contacts on predetermined of the rungs.

7. The non-transitory GUI display as set forth in claim 6 wherein the rungs of ladder logic are displayed on a screen having an image window that presents a thumbnail of a subject image of the object including graphical representations of sensors associated with selected of the contacts, wherein highlighting each of the contacts causes the window to display the associated graphical representation of the sensor associated with the contact.

8. The non-transitory GUI display as set forth in claim 6 wherein each of the contacts is constructed and arranged so as to be highlighted and thereby display a menu of properties, the menu of properties being selectable so as to change the properties of the highlighted contact.

9. The non-transitory GUI display as set forth in claim 8 wherein the menu of properties includes inversion of a contact, association of a contact with sensors or another input source and deletion of a contact from a selected of the rungs.

10. The non-transitory GUI display as set forth in claim 6 further comprising an OR button that applies an OR branch to a selected of the rungs.

11. The non-transitory GUI display as set forth in claim 5 wherein the third set of buttons provide interface functions in the box so that the user can configure outputs that interconnect with alarms, actuators and physical devices based upon the coils.

12. The non-transitory GUI display as set forth in claim 11 wherein the buttons include a fourth set of buttons having interface functions so that the user can define parameters of image frame recordings associated with a runtime operation of the job and run the job.

13. The non-transitory GUI display as set forth in claim 11 wherein the buttons include a fourth set of buttons having interface functions so that the user can define visual signals that appear on the interface to indicate a predetermined status based upon selected of the coils.

14. The non-transitory GUI display as set forth in claim 13 wherein the visual signals comprise simulated LEDs and a title of the predetermined status adjacent to each of the simulated LEDs.

15. The non-transitory GUI display as set forth in claim 14 wherein the simulated LEDs are located on a strip overlying the image frame window.

16. The non-transitory GUI display as set forth in claim 1 wherein the plurality of buttons are arranged in a sequential order across a portion of the GUI display, the buttons defining each of the plurality of different and discrete procedures, the sequential order corresponding to a predetermined order in which the procedures occur to set up and run a machine vision job.

17. A method for setting up and testing a machine vision system using graphical user interface (GUI) display comprising the steps of:

displaying, in an image frame pane, recorded and real time images of an object acquired by an interconnected vision system as discrete frames;

performing interface functions in connection with each of a plurality of different and discrete procedures to set up and run a machine vision job using the interconnected vision system; and

activating a plurality of buttons, arranged in a sequential order across a portion of the GUI, the buttons defining each of the plurality of different and discrete procedures, the sequential order corresponding to a predetermined order in which the procedures occur to set up and run a machine vision job, wherein at least one of the plurality of buttons provide interface functions so that the user can configure rungs of ladder logic that uses results provided by the vision system.

18. A non-transitory graphical user interface (GUI) display for setup and testing of machine vision systems comprising:

an image frame pane in which recorded and real time images of an object acquired by an interconnected vision system are displayed as discrete frames;

a filmstrip window that displays individual thumbnail images of a series of time-based sequential image frames of the recorded images acquired by the interconnected vision system;

wherein a first group of the thumbnail images are highlighted in a first discrete color or pattern so as to identify a first predetermined detected feature on the object in connection with the recorded images associated with the thumbnail images; and

a plurality of buttons, arranged in a sequential order across a portion of the GUI, the buttons defining each of the plurality of different and discrete procedures, the sequential order corresponding to a predetermined order in which the procedures occur to set up and run a machine vision job, wherein at least one of the plurality of buttons provide interface functions so that the user can configure rungs of ladder logic that uses results provided by the vision system.

19. The non-transitory GUI display as set forth in claim 18 wherein a second group of the thumbnail images are highlighted in a second discrete color or pattern dissimilar from the first discrete color or pattern so as to identify a second predetermined detected feature on the object in connection with the recorded images associated with the thumbnail images.

20. The non-transitory GUI display as set forth in claim 19 wherein at least one of the first group and the second group represent all images associated with the object.

21. The non-transitory GUI display as set forth in claim 19 wherein at least one of the first group and the second group comprise only images determined to have the first predetermined detected feature and second predetermined detected feature, respectively.

22. The non-transitory GUI display as set forth in claim 19 wherein the first predetermined feature and second predetermined feature each respectively indicate a first type of object and a second type of object.

23. The non-transitory GUI display as set forth in claim 19 wherein the first predetermined feature and the second predetermined feature each respectively indicate a failed object and a passing object.