Human/machine interface for a machine vision sensor and method for installing and operating the same

• US 7,305,114 B2
• Filed: 12/26/2001
• Issued: 12/04/2007
• Est. Priority Date: 12/26/2001
• Status: Expired due to Term

• Current Assignee: Cognex Technology & Investment Corporation (Cognex Corporation)
• Original Assignee: Cognex Technology & Investment Corporation (Cognex Corporation)
• Inventors: Silver, William, Wolff, Robert
• Primary Examiner(s): Mehta; Bhavesh M
• Assistant Examiner(s): Seth; Manav
• Application Number:
  US10/036,310
• Publication Number:
  US 20030120714A1
• Time in Patent Office: 2,169 Days
• Field of Search: 382/141, 382143-144, 382/157, 382254-255, 382/153, 382155-159, 700 95- 96, 348/86, 348/125, 348 1402- 1403, 348/64, 348113-114, 348175-176, 348/211.99, 3482111-2116
• US Class Current: 382/141
• CPC Class Codes: G05B 2219/37494 Intelligent sensor, data handling incorporated in sensor
• CPC Class Codes: G05B 2219/37563 Ccd, tv camera
• CPC Class Codes: G06F 18/40 Software arrangements specially adapted for pattern recognition, e.g. user interfaces or toolboxes therefor

Abstract

This invention overcomes the disadvantages of the prior art by providing a human/machine interface (HMI) for use with machine vision systems (MVSs) that provides the machine vision system processing functionality at the sensor end of the system, and uses a communication interface to exchange control, image and analysis information with a standardized, preferably portable device that can be removed from the MVS during runtime. In an illustrative embodiment, this portable device can be a web-browser equipped computer (handheld, laptop or fixed PC) or a Personal Digital Assistant (PDA). The communication interface on the sensor-end of the system is adapted to communicate over a cable or wireless communication link (for example infrared (IR) or radio frequency (RF)), with a corresponding communication interface in the portable device. The data communicated over the interconnect or link is formatted so that it is read at a data speed and level of resolution (pixel count) that is appropriate to the portable device by use of an image processor at the sensor end.

Claims

1. A human/machine interface for a machine vision system having an image element that generates image data based upon a viewed object comprising:

a processing element and a memory operatively connected to the image element and including (a) a machine vision tool for performing a machine vision process on the image data and (b) a software process for transmitting, in a web-browser compatible form, the image data and information from the machine vision tool over a communications interface, interconnected to the processing element, to a human/machine interface device having a display, the web-browser-compatible image data and information being adapted for display on the human/machine interface device, and wherein the human/machine interface device is adapted to display the web-browser-compatible image data and information on a plurality of user-selected screens associated with the machine vision tool, the screens being constructed and arranged for selecting functions for training the machine vision system to define measured parameters of the viewed object and at least one of installing, configuring, monitoring, and controlling the machine vision system, and wherein the processing element is adapted to perform a machine vision tool task while the human/machine interface device is disconnected from the communications interface; and

wherein the processing element includes a web server to allow the human/machine interface to setup and control the processor, and wherein the human/machine interface device comprises a computer having a generic web browser and the screens comprise web pages.

2. The human/machine interface as set forth in claim 1 wherein the software process includes a data compression and reformatting process for the image data that causes the image data to be transmitted in compressed form over the communications interface.

27. The machine vision system of claim 1, wherein training further includes defining a predetermined threshold for detecting when the measured parameters are outside a defined range.

3. A human/machine interface for a machine vision system having an image element that generates image data based upon a viewed object comprising:

a processing element and a memory operatively connected to the image element and including (a) a machine vision tool for performing a machine vision process on the image data and (b) a software process for transmitting the image data and information from the machine vision tool over a communications interface, interconnected to the processing element, to a human/machine interface device having a display, and the image data and information being adapted for display on the human/machine interface device, and wherein the human/machine interface device is adapted to display the image data and the information on a plurality of user-selected screens associated with the machine vision tool, the screens being constructed and arranged for selecting functions for training the machine vision system to define measured parameters of the viewed object and at least one of installing, configuring, monitoring, and controlling the machine vision system and wherein the processing element is adapted to perform a machine vision tool task while the human/machine interface device is disconnected from the communications interface; and

wherein the processing element includes an interface element in the camera to allow the human/machine interface to setup and control the processor from a remote location, and the human/machine interface device comprises a personal digital assistant (PDA).

4. The human/machine interface as set forth in claim 3 wherein the communication interface includes support for data transmission to a PDA over one of a wireless link and a cable link.

5. The human/machine interface as set forth in claim 3 wherein the human/machine interface device includes a generic machine vision application residing thereon and the processing element is adapted to install a specialized machine vision application over the communications interface to the human/machine interface device.

6. The human/machine interface as set forth in claim 3 wherein the machine vision tool includes a process that determines an intensity distribution of the image data and that transmits information with respect to the determined intensity distribution, and wherein the human/machine interface device includes a process for displaying, based upon the information, a visual representation of the intensity distribution so as to assist in adjusting at least one of lighting intensity, shutter exposure time, lens aperture, and parameters affecting the intensity distribution in the image data.

7. The human/machine interface as set forth in claim 3 wherein the machine vision tool includes a process that determines a relative degree of focus of the image data and that transmits encoded information with respect to the determined relative degree of focus, and wherein the human/machine interface device includes a process for displaying, based upon the encoded information, a current focus value so as to assist in adjusting focus.

8. The human/machine interface as set forth in claim 7 wherein the current focus value is displayed as a function of time.

9. The human/machine interface as set forth in claim 7 wherein the human/machine interface device includes a display that is insufficient in resolution and refresh rate to provide a real time display for adjusting either of focus or aperture of lens of the image element.

10. The human/machine interface as set forth in claim 3 wherein the software process includes a data compression and reformatting process for the image data that causes the image data to be transmitted in compressed form over the communications interface.

28. The machine vision system of claim 3, wherein training further includes defining a predetermined threshold for detecting when the measured parameters are outside a defined range.

11. A method for interfacing with a machine vision system having an image element that generates image data based upon a viewed object, the method comprising the steps of:

providing a processing element and a memory operatively connected to the image element and including (a) a machine vision tool for performing a machine vision process on the image data and (b) a software process for providing the image data in a web-browser-compatible form and for creating information for constructing interface web pages associated with operation of the machine vision tool;

transmitting the image data and information over a communications interface, interconnected to the processing element, to a human/machine interface device having a display and a generic web browser application;

receiving the image data and information and displaying, on the human machine interface device, the image data and information on a plurality of user-selected screens, the screens comprising web pages constructed and arranged for selecting functions for training the machine vision system to define measured parameters of the viewed object and at least one of installing, configuring, or monitoring the machine vision system where the human/machine interface connects remotely to setup and control the processor through a web server residing within the camera; and

performing, with the processing element, a machine vision tool task while the human/machine interface device is disconnected from the communications interface.

12. The method as set forth in claims 11 wherein further comprising transferring configuration information from the human/machine interface device to the memory over the communications interface.

13. The method as set forth in claim 12 wherein the step of transferring configuration information includes providing training information to the memory.

14. The method as set forth in claim 13 wherein the step of displaying includes monitoring a live image acquired by the image element based upon the image data and information.

15. The method as set forth in claim 11 wherein the step of establishing the link comprises opening web pages on the human/machine interface based upon a web server in the machine vision system that interacts with the communications interface to convert the image data and information into web-based data packets.

16. The method as set forth in claim 11 further comprising communicating control information to a remote device through the communication interface so as to direct a device function in accordance with the predetermined instruction of the machine vision tool.

17. The human/machine interface as set forth in claim 11 wherein the software process includes a data compression and reformatting process for the image data that causes the image data to be transmitted in compressed form over the communications interface.

29. The method for interfacing with a machine vision system of claim 11, wherein training further includes defining a predetermined threshold for detecting when the measured parameters are outside a defined range.

18. A method for interfacing with a machine vision system having an image element that generates image data based upon a viewed object, the method comprising the steps of:

providing a processing element and a memory operatively connected to the image element and including (a) a machine vision tool for performing a machine vision process on the image data and (b) a software process for providing the image data in a transmittable form and for creating information for constructing interface screens associated with operation of the machine vision tool;

transmitting the compressed and reformatted image data and information over a communications interface, interconnected to the processing element, to a human/machine ii interface device, the human/machine interface comprising a personal digital assistant (FDA) having a display and a graphical user interface (GUI);

receiving the compressed and reformatted image data and information and displaying, on the human machine interface device, the compressed and reformatted image data and information on a plurality of user-selected screens associated with the machine vision tool, the screens being constructed and arranged for selecting functions for training the machine vision system to define measured parameters of the viewed object and at least one of installing, configuring, monitoring, and controlling the machine vision system, where the human/machine interface connects remotely to setup and control the processor through an interface element within the camera; and

performing, with the processing element, a machine vision tool task while the human/machine interface device is disconnected from the communications link.

19. The method as set forth in claim 18 wherein the step of transmitting includes providing the image data and information over one of a wireless link and a cable link.

20. The method as set forth in claim 18 further comprising transferring a machine vision application from the memory over the link to the human machine interface device and installing the loadable machine vision application on the human/machine interface so as to interface with the machine vision system using the loadable machine vision application.

21. The method as set forth in claim 18 further comprising communicating control information to a remote device through the communication interface so as to direct a device function in accordance with a predetermined instruction of the machine vision tool.

22. The human/machine interface as set forth in claim 18 further comprising determining, with the machine vision tool, an intensity distribution of the image data and transmitting information with respect to the determined intensity distribution, and displaying, based upon the information, a visual representation of the intensity distribution with the human/machine interface device so as to assist in adjusting at least one of lighting intensity, shutter exposure time, lens aperture, and parameters affecting the intensity distribution in the image data.

23. The human/machine interface as set forth in claim 18 further comprising determining, with the machine vision tool, a relative degree of focus of the image data and transmitting encoded information with respect to the determined relative degree of focus, and displaying, based upon the encoded information, a current focus value with the human/machine interface device so as to assist in adjusting focus.

24. The human/machine interface as set forth in claim 23 wherein the step of displaying the current focus value includes displaying the current focus value as a function of time.

25. The human/machine interface as set forth in claim 18 wherein the software process includes a data compression and reformatting process for the image data that causes the image data to be transmitted in compressed form over the communications interface.

30. The method for interfacing with a machine vision system of claim 18, wherein training further includes defining a predetermined threshold for detecting when the measured parameters are outside a defined range.

26. A machine vision tool with a human/machine interface device, comprising:

the machine vision tool including a camera for collecting image data of an object, wherein the image data includes evaluation of the object;

a processor coupled into the machine vision tool, wherein the processor includes a web server, and a software process adapted to transmit the image data as a web-browser-compatible form to the unconnected human/machine interface device, and wherein the processor and the machine vision tool are adapted to perform a machine vision tool task while the human/machine interface device is unconnected from the processor and machine vision tool; and

the human/machine interface device using a web-browser set of screens, the set of screens constructed and arranged to for selecting functions for training the machine vision system to define measured parameters of the viewed object and at least one of installing, configuring, monitoring, and controlling the machine vision system, and where the human/machine interface is adapted to setup and control the processor through the web server using a wireless connection.

31. The machine vision tool of claim 26, wherein training further includes defining a predetermined accept/reject threshold with respect to the defined shape of the viewed object.