Method and system to retrieve and display technical data for an industrial device

• US 8,050,782 B2
• Filed: 05/20/2005
• Issued: 11/01/2011
• Est. Priority Date: 05/20/2004
• Status: Expired due to Fees

• Current Assignee: ABB Research Ltd. (ABB Ltd.)
• Original Assignee: ABB Research Ltd. (ABB Ltd.)
• Inventors: Andersson, Mattias, Kruzeniski, Mike, Rudgård, Ingemar, Fällman, Daniel
• Primary Examiner(s): Decady; Albert
• Assistant Examiner(s): STEVENS, THOMAS H
• Application Number:
  US11/596,926
• Publication Number:
  US 20080065243A1
• Time in Patent Office: 2,356 Days
• Field of Search: 700/83, 700/245, 700/248, 700/264, 700/276
• US Class Current: 700/83
• CPC Class Codes: G05B 19/409 characterised by using manual data input [MDI] or by using control panel, e.g. controlling functions with the panel; characterised by control panel details or by setting parameters G05B19/408, G05B19/4093 take precedence
• CPC Class Codes: G05B 2219/31448 Display at central computer, slave displays for each machine unit
• CPC Class Codes: G05B 2219/36159 Detachable or portable programming unit, display, pc, pda
• CPC Class Codes: G05B 23/0267 Fault communication, e.g. human machine interface [HMI]
• CPC Class Codes: Y02P 90/02 Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Abstract

A method to retrieve and display technical data for an industrial device supervised by a computer program for control, configuration or condition monitoring in an industrial or commercial plant. The method can use a substantially static and easily visible large sized display member to provide a graphical user interface for retrieving data about, and/or controlling, one or more industrial devices. A computing device or mobile computing device send a copy of its graphical user interface to the large display for ease of information retrieval and access.

Claims

1. A method to retrieve, display and manipulate technical data for an industrial device and control the industrial device, the method comprising:

selecting utilizing a graphical user interface on a first computing device operated by a user a representation of the industrial device, wherein the first computing device is operatively connected via a data network to the industrial device to carry out at least one of retrieving, displaying or manipulating the technical data for the industrial device or controlling the industrial device,

recognizing the first computing device in a vicinity of a separate display member separate from the first computing device and making a connection via the data network between the first computing device and the separate display member,

transmitting a reference corresponding to the representation of the industrial device from the first computing device via the data network to the separate display member,

displaying on the separate display member a graphical user interface related to the industrial device,

operatively linking the separate display member to the industrial device via the data network, such that the graphical user interface displayed on the separate display member is manipulateable to carry out at least one of retrieving, displaying or manipulating the technical data for the industrial device or controlling the industrial device,

manipulating the graphical user interface displayed by the separate display member to carry out at least one of retrieving, displaying or manipulating the technical data for the industrial device or controlling the industrial device, and

carrying out a data retrieval action via a graphic display on the separate display member by sending a signal from a portable said first computing device to the data network,

wherein a portable computing device is arranged for a data retrieval action or control signal for control or supervision of an industrial robot, wherein the portable computing device comprises a teach pendant member for data retrieval, program editing or control of an industrial robot, and wherein the portable computing device is connected to or otherwise activated for data retrieval or control of an industrial robot in way that is hot-pluggable and without pausing or shutting down the industrial robot.

2. The method according to claim 1, further comprising:

transmitting a reference for a representation of said industrial device displayed by said graphical user interface to the separate display member via a data network running an instance of said graphical user interface.

3. The method according to claim 2, further comprising:

retrieving data associated with information represented by said graphical user interface and providing the retrieved data to a computer or processor for display and manipulation of said graphical user interface on the separate display member.

4. The method according to claim 3, further comprising:

generating on the separate display member an instruction to manipulate said technical data utilizing said graphical user interface.

5. The method according to claim 4, further comprising:

generating a data retrieval action or a control action from said graphical user interface by an instruction generated by graphic display members of the separate display member.

6. The method according to claim 5, further comprising:

generating a data retrieval action or a control action from said graphical user interface and displaying an image comprising virtual reality information as computer generated graphic material superimposed on other information, real pictures or diagrams.

7. The method according to claim 1, further comprising:

wirelessly sending the reference corresponding to the representation of the industrial device to the data network.

8. The method according to claim 2, further comprising:

sending the reference displayed by the said graphical user interface wirelessly utilizing a wireless LAN.

9. The method according to claim 1, further comprising:

wirelessly sending a data retrieval action or control signal relative the said graphical user interface from the data network to the separate display member.

10. The method according to claim 9, further comprising:

sending a data retrieval action or a control signal relative the said graphical user interface from the data network to the separate display member by a radio signal.

11. The method according to claim 1, further comprising:

sending a data retrieval action or a control signal relative the said graphical user interface from the data network to the separate display member by a wire connection to a data network.

12. The method according to claim 1, wherein the industrial device is arranged relative an industrial robot.

13. The method according to claim 1, further comprising:

selecting utilizing said first computing device the representation of an industrial device and marking the industrial device,

manipulating said graphical user interface causing the graphical user interface to send a reference to the representation of the marked industrial device to the separate display member.

14. The method according to claim 1, further comprising:

selecting utilizing said first computing device one or more representations of a plurality of industrial devices and marking them.

43. The method according to claim 1, further comprising:

carrying out any from a list of;

checking a status of the industrial device, engineering the industrial device, making a calculated change to a set point or control parameter for the industrial device, configuring an automation device, controlling an automation device, tuning a process, checking a process variable, teaching a robot, or editing a robot program.

15. A method to retrieve, display and manipulate technical data for an industrial device and control the industrial device, the method comprising:

selecting utilizing a graphical user interface on a first computing device operated by a user a representation of the industrial device, wherein the first computing device is operatively connected via a data network to the industrial device to carry out at least one of retrieving, displaying or manipulating the technical data for the industrial device or controlling the industrial device,

recognizing the first computing device in a vicinity of a separate display member separate from the first computing device and making a connection via the data network between the first computing device and the separate display member,

transmitting a reference corresponding to the representation of the industrial device from the first computing device via the data network to the separate display member,

displaying on the separate display member a graphical user interface related to the industrial device,

operatively linking the separate display member to the industrial device via the data network, such that the graphical user interface displayed on the separate display member is manipulateable to carry out at least one of retrieving, displaying or manipulating the technical data for the industrial device or controlling the industrial device,

manipulating the graphical user interface displayed by the separate display member to carry out at least one of retrieving, displaying or manipulating the technical data for the industrial device or controlling the industrial device,

selecting utilizing said first computing device one or more representations of a plurality of industrial devices and marking them, and

marking one or more representations of a plurality of industrial devices by moving them to a selected part of the graphic user display represented as a container.

16. A method to retrieve, display and manipulate technical data for an industrial device and control the industrial device, the method comprising:

selecting utilizing a graphical user interface on a first computing device operated by a user a representation of the industrial device, wherein the first computing device is operatively connected via a data network to the industrial device to carry out at least one of retrieving, displaying or manipulating the technical data for the industrial device or controlling the industrial device,

recognizing the first computing device in a vicinity of a separate display member separate from the first computing device and making a connection via the data network between the first computing device and the separate display member,

transmitting a reference corresponding to the representation of the industrial device from the first computing device via the data network to the separate display member,

displaying on the separate display member a graphical user interface related to the industrial device,

operatively linking the separate display member to the industrial device via the data network, such that the graphical user interface displayed on the separate display member is manipulateable to carry out at least one of retrieving, displaying or manipulating the technical data for the industrial device or controlling the industrial device,

manipulating the graphical user interface displayed by the separate display member to carry out at least one of retrieving, displaying or manipulating the technical data for the industrial device or controlling the industrial device, and

receiving in a wireless local area network a wireless signal from a computing device of a user, comparing information in the wireless signal with information with log-in information of a control system of the industrial device and matching the computing device of the user, so recognizing the user in close proximity to the separate display member.

17. A computer program product, comprising:

a non-transitory computer readable medium; and

computer program instructions recorded on the computer readable medium and executable by a computer or processor will cause the computer or processor to carry out a method to retrieve and display technical data for an industrial device comprising

selecting utilizing a graphical user interface on a first computing device operated by a user a representation of the industrial device, wherein the first computing device is operatively connected via a data network to the industrial device to carry out at least one of retrieving, displaying or manipulating the technical data for the industrial device or controlling the industrial device,

recognizing the first computing device in a vicinity of a separate display member separate from the first computing device and making a connection via the data network between the first computing device and the separate display member,

transmitting a reference corresponding to the representation of the industrial device from the first computing device via the data network to the separate display member,

displaying on the separate display member a graphical user interface related to the industrial device,

operatively linking the separate display member to the industrial device via the data network, such that the graphical user interface displayed on the separate display member is manipulateable to carry out at least one of retrieving, displaying or manipulating the technical data for the industrial device or controlling the industrial device,

manipulating the graphical user interface displayed by the separate display member to carry out at least one of retrieving, displaying or manipulating the technical data for the industrial device or controlling the industrial device, and

retrieving technical data for devices used in conjunction with from any a list of;

industrial production;

metal production;

pulp and paper manufacture;

automated industrial processes;

oil and gas production, upstream or downstream processes;

chemical industry equipment and processes, vehicle manufacturing, vehicle assembly.

18. A computing device for retrieval and display of technical data for an industrial device using a computer control program for control of the industrial device, comprising:

a graphical user interface displayed on a display of the computing device and comprising at least one graphical representation member representing a selected said industrial device, wherein the computing device is configured to interact with said computer control program via a network for carrying out at least one of retrieving, displaying, selecting or manipulating the technical data for the industrial device or controlling the industrial device,

a selector configured to select utilizing a first computing device the representation of the industrial device and marking the industrial device,

a transmitter configured to transmit a reference concerning the representation from the first computing device via a data network to a separate display member separate from the first computing device, and

a graphical user interface displayed on the separate display member operatively connected to via the network to the computer control program for carrying out at least one of retrieving, selecting or manipulating data regarding the industrial device or controlling the industrial device,

wherein the graphical user interface displays together a graphical representation of any of a list of;

an industrial device, an industrial device in a process schematic, an industrial device in a tree diagram, an industrial device recorded for subsequent information access or retrieval any of which may be arranged in transparent or semi transparent layers.

19. The device according to claim 18, wherein said graphical user interface comprises a graphical representation member for recording a selected industrial device for subsequent retrieval of technical information associated with the industrial device.

20. The device according to claim 18, further comprising:

a transmitter configured to send a reference for the representation of a said industrial device via a data network to the separate display member.

21. The device according to claim 19, further comprising:

a member for transmitting and/or receiving wireless communication to and/or from the data network.

22. The device according to claim 21, wherein the member for wireless communication is compatible with a wireless local area network.

23. The device according to claim 18, wherein the graphical user interface displays together a graphical representation of an industrial device and a display comprising virtual reality information or computer generated graphic material superimposed.

24. The device according to claim 23, wherein the graphical user interface displays a graphical representation of an industrial device and a display comprising virtual reality information for teaching a robot and editing a robot program.

25. The device according to claim 18, further comprising:

a recorder configured to record graphical, freehand or text annotations on a graphical representation of an industrial device and associate the text annotations with a link to the industrial device.

26. A system for retrieval and display of technical data for an industrial device, the system comprising:

a computer program for control comprising a graphical user interface configured to generate a signal and send the signal through a network to at least one industrial device to carry out at least one of retrieve, display, or manipulate said technical data related to the at least one industrial device or control the at least one industrial device, the graphical user interface comprising at least one graphical representation member for representing a selected said at least one industrial device,

at least one computing device running a process compatible with said control program at least in part, wherein the graphical user interface is configured to permit a user to select utilizing said at least one computing device a representation of the industrial device and marking the at least one industrial device, wherein a first computing device is operatively connected via a data network to the industrial device,

a data network to which said at least one industrial device and the at least one computing device are connected,

a separate display device also operatively connected to the data network and separate from the at least one computing device, the separate display device being operatively linked to the at least one industrial device via the data network such that a graphical user interface displayed on the separate display device is manipulateable to carry out at least one of retrieving, displaying or manipulating the technical data for the industrial device or controlling the at least one industrial device,

a unit configured to recognize the at least one computing device when the at least one computing device is in a vicinity of the separate display device,

a unit configured to detect a movement of a user relative to a position on said graphical user interface of the separate display device,

a control configured to provide an instruction or a control signal dependent on the detected movement and/or a relative position of the user,

a transmitter configured to transmit a reference concerning the representation of the industrial device from the at least one computing device via the data network to the separate display device, wherein the graphical user interface is manipulated dependent on the reference, and

a control configured to generate an instruction through said separate display to manipulate to carry out at least one of retrieving, displaying or manipulating the technical data for the industrial device or controlling the industrial device.

27. The system according to claim 26, wherein the at least one computing device is a portable computing device.

28. The system according to claim 27, wherein the portable computing device comprises a member for transmitting and/or receiving wireless communication to and/or from the data network.

29. The system according to claim 28, wherein the wireless communication member is compatible with a wireless local area network.

30. The system according to claim 26, wherein the separate display device is connected to the data network by a wireless communication member.

31. The system according to claim 30, wherein the separate display device is connected to the data network by a wireless local area network.

32. The system according to claim 26, wherein the separate display device is hard wired to a data network or device connected to the data network.

33. The system according to claim 26, wherein the separate display device comprises a wireless member for detecting movement and position of a user relative a graphical user interface displayed on the separate display device.

34. The system according to claim 33, wherein the separate display device comprises a wireless member for detecting movement and position using any of:

ultrasonic sound, infra red light, visible light.

35. The system according to claim 27, wherein the portable computing device is arranged with a portable display member.

36. The system according to claim 27, wherein the portable computing device is arranged with an operating system.

37. The system according to claim 35, wherein the portable computing device is arranged with a directional input member comprising any from a list of:

button, joystick, ball, mouse, stylus, touch surface, elastic directional input member.

38. The system according to claim 26, wherein the portable computing device is arranged such that the portable computer device may be connected to the system or otherwise or activated in a way that is hot-pluggable, and without pausing or shutting down a control system.

39. The system according to claim 26, further comprising:

one or more computer program products comprising a non-transitory computer readable medium; and

computer program instructions recorded on the computer readable medium and executable by a computer or processor will cause the computer or processor to carry out a method to retrieve and display technical data for an industrial device comprising

selecting utilizing a graphical user interface on a first computing device operated by a user a representation of the industrial device, wherein the first computing device is operatively connected via a data network to the industrial device to control the industrial device,

recognizing the first computing device in a vicinity of a separate display member separate from the first computing device and making a connection via the data network between the first computing device and the separate display member,

transmitting a reference corresponding to the representation of the industrial device from the first computing device via the data network to the separate display member,

displaying on the separate display member a graphical user interface related to the industrial device,

operatively linking the separate display member to the industrial device via the data network, such that the graphical user interface displayed on the separate display member is manipulateable to carry out at least one of retrieving, displaying or manipulating the technical data for the industrial device or controlling the industrial device, and

manipulating the graphical user interface displayed by the separate display member to carry out at least one of retrieving, displaying or manipulating the technical data for the industrial device or controlling the industrial device.

40. The system according to claim 26, wherein the separate display device comprises any device from a list of:

display screen, back display screen, back projection system, back-of-screen image display member, optical projector, whiteboard, television, computer monitor, computer terminal, workstation, touch-sensitive screen, LCD display, plasma panel.

41. The system according to claim 40, wherein the separate display device comprises a notebook computer or other portable device.

42. A method to retrieve and display technical data for a selected industrial device in an industrial facility using a computer program for control and at least one first computing device running a control program at least in part, wherein said control program comprises a graphical user interface arranged capable of generating a signal to retrieve said technical data related to one or more industrial devices, the method comprising:

recognizing the at least one first computing device operated by a user in a vicinity of a separate display member separate from the at least one first computing device, wherein the separate display device is operatively connected to a network,

selecting utilizing a graphical user interface on said at least one first computing device a representation of the selected industrial device and marking the selected industrial device in a computer program for control running on said at least one first computing device,

operatively connecting the at least one first computing device to the selected industrial device to carry out at least one of retrieving, displaying or manipulating the technical data for the industrial device or controlling the industrial device,

retrieving technical data about the selected industrial device,

going to a place in the industrial facility where the separate display member,

approaching the separate display member, the at least one first computing device being recognized by a location detector combined with an identity associated with a logged-on user or a computing device of a user,

the user transmitting a reference for at least one of the one or more industrial devices to the separate display member for retrieval of technical information associated with the industrial device so referenced and display and/or manipulation on a graphical user interface of the separate display member,

linking the separate display member with the selected industrial device through the network,

detecting a movement of a user relative to a position on said graphical user interface of the separate display member, and

providing an instruction or a control signal to the industrial device with the separate display device dependent on the detected movement and/or a position of the user relative to the separate display device.

44. A method to retrieve, display and manipulate technical data for an industrial device and control the industrial device, the method comprising:

selecting utilizing a graphical user interface on a first computing device operated by a user a representation of the industrial device, wherein the first computing device is operatively connected via a data network to the industrial device to carry out at least one of retrieving, displaying or manipulating the technical data for the industrial device or controlling the industrial device,

recognizing the first computing device in a vicinity of a separate display member separate from the first computing device and making a connection via the data network between the first computing device and the separate display member,

transmitting a reference corresponding to the representation of the industrial device from the first computing device via the data network to the separate display member,

displaying on the separate display member a graphical user interface related to the industrial device,

operatively linking the separate display member to the industrial device via the data network, such that the graphical user interface displayed on the separate display member is manipulateable to carry out at least one of retrieving, displaying or manipulating the technical data for the industrial device or controlling the industrial device,

manipulating the graphical user interface displayed by the separate display member to carry out at least one of retrieving, displaying or manipulating the technical data for the industrial device or controlling the industrial device, and

retrieving technical data for devices used in conjunction with from a list of;

electricity generation, transmission, transformation and/or distribution.

45. A method to retrieve, display and manipulate technical data for an industrial device and control the industrial device, the method comprising:

selecting utilizing a graphical user interface on a first computing device operated by a user a representation of the industrial device, wherein the first computing device is operatively connected via a data network to the industrial device to carry out at least one of retrieving, displaying or manipulating the technical data for the industrial device or controlling the industrial device,

recognizing the first computing device in a vicinity of a separate display member separate from the first computing device and making a connection via the data network between the first computing device and the separate display member,

transmitting a reference corresponding to the representation of the industrial device from the first computing device via the data network to the separate display member,

displaying on the separate display member a graphical user interface related to the industrial device,

operatively linking the separate display member to the industrial device via the data network, such that the graphical user interface displayed on the separate display member is manipulateable to carry out at least one of retrieving, displaying or manipulating the technical data for the industrial device or controlling the industrial device,

manipulating the graphical user interface displayed by the separate display member to carry out at least one of retrieving, displaying or manipulating the technical data for the industrial device or controlling the industrial device, and

retrieving technical data for devices used in conjunction with from any a list of;

industrial production;

metal production;

pulp and paper manufacture;

automated industrial processes;

oil and gas production, upstream or downstream processes;

chemical industry equipment and processes, vehicle manufacturing, vehicle assembly.