Method and System to Retrieve and Display Technical Data for an Industrial Device

• US 20080065243A1
• Filed: 05/20/2005
• Published: 03/13/2008
• Est. Priority Date: 05/20/2004
• Status: Active Grant

• Current Assignee: ABB Research Ltd. (ABB Limited)
• Original Assignee: ABB Research Ltd. (ABB Limited)
• Inventors: Fallman, Daniel, Andersson, Mattias, Rudgard, Ingemar, Kruzeniski, Mike
• Granted Patent: US 8,050,782 B2
• Time in Patent Office: Days
• US Class Current: 700/83
• CPC Class Codes: G05B 19/409 characterised by using manual data input [MDI] or by using control panel, e.g. controlling functions with the panel; characterised by control panel details or by setting parameters G05B19/408, G05B19/4093 take precedence
• CPC Class Codes: G05B 2219/31448 Display at central computer, slave displays for each machine unit
• CPC Class Codes: G05B 2219/36159 Detachable or portable programming unit, display, pc, pda
• CPC Class Codes: G05B 23/0267 Fault communication, e.g. human machine interface [HMI]
• CPC Class Codes: Y02P 90/02 Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Abstract

A method to retrieve and display technical data for an industrial device supervised by a computer program for control, configuration or condition monitoring in an industrial or commercial plant. The method can use a substantially static and easily visible large sized display member to provide a graphical user interface for retrieving data about, and/or controlling, one or more industrial devices. A computing device or mobile computing device send a copy of its graphical user interface to the large display for ease of information retrieval and access.

Claims

1. A method to retrieve and display technical data for an industrial device using a computer program for control and at least one computing device running a process compatible with said control program at least in part, wherein said control program comprises a graphical user interface arranged capable of generating an instruction to retrieve said technical data related to one or more industrial devices, the method comprising:

selecting by means of said computing device a representation of an industrial device and marking it,

transmitting a reference from the first computing device via a data network to a display member separate from the first computing device,

manipulating a graphical user interface displayed by the separate display member dependent on the reference, and

generating an instruction to manipulate said technical data.

2. The method according to claim 1, further comprising:

transmitting a reference for a representation of a said industrial device displayed by a said graphical user interface of said control program running in part on said computing device to a display member separate from said computing device via a data network running an instance of said graphical user interface.

3. The method according to claim 2, further comprising:

retrieving data associated with information represented by said graphical user interface and providing the data to a computer or processor for display and manipulation of the instance of said graphical user interface on the separate display member.

4. The method according to claim 3, further comprising:

generating on the separate display member an instruction to manipulate said technical data by means of the displayed instance of said graphical user interface.

5. The method according to claim 4, further comprising:

generating a data retrieval action or a control action from said graphical user interface by an instruction generated by graphic display members of the separate display member.

6. The method according to claim 5, further comprising:

generating a data retrieval action or a control action from said graphical user interface and displaying a display comprising virtual reality information as computer generated graphic material superimposed on other information, real pictures or diagrams.

7. The method according to claim 6, further comprising:

detecting a movement of a user relative a position on the said graphical user interface of the separate display member, and

providing an instruction or a control signal dependent on the detected movement and/or a relative position of the user.

8. The method according to claim 1, further comprising:

sending the reference of the said graphical user interface displayed on said computing device to the data network wirelessly.

9. The method according to claim 2, further comprising:

sending the reference displayed by the said graphical user interface by means of a wireless LAN.

10. The method according to claim 1, further comprising:

sending a data retrieval action or control signal relative the said graphical user interface from the data network to the separate display member by a wireless means.

11. The method according to claim 10, further comprising:

sending a data retrieval action or a control signal relative the said graphical user interface from the data network to the separate display member by a radio signal.

12. The method according to claim 1, further comprising:

sending a data retrieval action or a control signal relative the said graphical user interface from the data network to the separate display member by a wire connection to a data network.

13. The method according to according to claim 1 further comprising:

carrying out a data retrieval action via graphic display means of the separate display member by sending a signal from a portable said computing device to the data network.

14. The method according to claim 1, wherein the industrial device is arranged relative an industrial robot.

15. The method according to claim 14, wherein the portable computing device is arranged for a data retrieval action or control signal for control or supervision of an industrial robot.

16. The method according to claim 15, wherein the portable computing device is arranged in the form of a Teach Pendant member for data retrieval, program editing or control of an industrial robot.

17. The method according to claim 16, wherein the portable computing device is connected to or otherwise activated for data retrieval or control of an industrial robot in way that is hot-pluggable and without pausing or shutting down the industrial robot.

18. The method according to claim 1, further comprising:

selecting by means of said computing device the representation of an industrial device and marking it,

manipulating said graphical user interface causing it to send a reference to the representation of the marked industrial device to the separate display member.

19. The method according to claim 1, further comprising:

selecting by means of said computing device one or more representations of a plurality of industrial devices and marking them.

20. The method according to claim 19, further comprising:

marking one or more representations of a plurality of industrial devices by moving them to a selected part of the graphic user display represented as a container.

21. The method according to claim 3, further comprising:

recognition of a computing device operated by a user near or in close proximity to the separate display member.

22. The method according to claim 21, further comprising:

receiving in a wireless local area network a wireless signal from a computing device of a user, comparing information in the signal with information with log-in information of the control system and matching the computing device of a user, so recognising an individual user in close proximity to the separate display member.

47. The system according to claim 34, further comprising:

one or more computer products according to claim 22.

23. A computer program product, comprising:

a computer readable medium; and

computer program instructions recorded on the computer readable medium and executable by a computer or processor will cause the computer or processor to carry out a method to retrieve and display technical data for an industrial device comprising

selecting by means of said computing device a representation of an industrial device and marking it,

transmitting a reference from a first computing device via a data network to a display member separate from the first computing device,

manipulating a graphical user interface displayed by a separate display member dependent on the reference, and

generating an instruction to manipulate said technical data.

24. (canceled)

25. A computing device for retrieval and display of technical data for an industrial device using a computer program for control, and comprising:

a graphical user interface comprising at least one graphical representation member for representing a selected said industrial device, wherein the computer device runs a process compatible with said control program at least in part.

26. The device according to claim 25, wherein said graphical user interface comprises a graphical representation member for recording a selected industrial device for subsequent retrieval of technical information associated with the industrial device.

27. The device according to claim 25, further comprising:

means for sending a reference for the representation of a said industrial device via a data network to a display member separate from the first computing device.

28. The device according to claim 26, further comprising:

a member for transmitting and/or receiving wireless communication to and/or from the data network.

29. The device according to claim 28, wherein the member for wireless communication means is compatible with a wireless local area network.

30. The device according to claim 25, wherein the graphical user interface displays together a graphical representation of any of the list of:

an industrial device, an industrial device in a process schematic, an industrial device in a tree diagram, an industrial device recorded for subsequent information access or retrieval any of which may be arranged in transparent or semi transparent layers.

31. The device according to claim 30, wherein the graphical user interface displays together a graphical representation of an industrial device and a display comprising virtual reality information or computer generated graphic material superimposed.

32. The device according to claim 31, wherein the graphical user interface displays a graphical representation of an industrial device and a display comprising virtual reality information for teaching a robot and editing a robot program.

33. The device according to claim 25, further comprising:

means to record graphical, freehand or text annotations on a graphical representation of an industrial device and associate the annotations with a link to the industrial device.

34. A system for retrieval and display of technical data for an industrial device, the device comprising:

a computer program for control comprising a graphical user interface arranged capable of generating a signal to retrieve said technical data related to one or more industrial devices, the graphical user interface comprising at least one graphical representation member (24) for representing a selected said industrial device,

at least one computing device running a process compatible with said control program at least in part,

a data network to which said one or more industrial devices are connected, and

a second display device also connected to the data network.

35. The system according to claim 34, wherein the computing device is a portable computing device.

36. The system according to claim 35, wherein the portable computing device comprises a member for transmitting and/or receiving wireless communication to and/or from the data network.

37. The system according to claim 36, wherein the wireless communication means is compatible with a wireless local area network.

38. The system according to claim 34, wherein the second display device is connected to the data network by a wireless communication member.

39. The system according to claim 38, wherein the second display device is connected to the data network by a wireless local area network.

40. The system according to claim 34, wherein the second display device may be hard wired to a data network or device connected to the data network.

41. The system according to claim 34, wherein the second display device comprises a wireless member for detecting movement and position of a user relative a graphical user interface displayed on the second display device.

42. The system according to claim 41, wherein the second display device comprises a wireless member for detecting movement and position using any means from the list of:

ultrasonic sound, infra red light, visible light.

43. The system according to claim 35, wherein the portable computing device is arranged with a display member.

44. The system according to claim 35, wherein the portable computing device is arranged with an operating system.

45. The system according to claim 43, wherein the portable computing device is arranged with a directional input member comprising any from the list of:

button, joystick, ball, mouse, stylus, touch surface, elastic directional input member.

46. The system according to claim 34, wherein the portable computing device is arranged such that it may be connected to the system or otherwise or activated in a way that is hot-pluggable, and without pausing or shutting down the control system.

48. The system according to claim 34, wherein the second display device comprises any device from the list of:

display screen, back display screen, back projection system, back-of-screen image display member, optical projector, whiteboard, television, computer monitor, computer terminal, workstation, touch-sensitive screen, LCD display, plasma panel.

49. The system according to claim 48, wherein the second display device comprises a notebook computer or other portable device.

51. Use of a system according to claim 34 for any from the list of:

checking a status of an industrial device, engineering an industrial device, making a calculated change to a set point or control parameter for an industrial device, configuring an automation device, controlling an automation device, tuning a process, checking a process variable, teaching a robot, or editing a robot program.

52. Use of a system according to claim 34 for retrieving technical data for devices used in conjunction with from any the list of:

electricity generation, transmission, transformation and/or distribution.

53. Use of a system according to claim 34 for retrieving technical data for devices used in conjunction with from any the list of:

industrial production;

metal production;

pulp and paper manufacture;

automated industrial processes;

oil and gas production, upstream or downstream processes;

chemical industry equipment and processes, vehicle manufacturing, vehicle assembly.

50. A method to retrieve and display technical data for an industrial device using a computer program for control and at least one computing device running said control program at least in part, wherein said control program comprises a graphical user interface arranged capable of generating a signal to retrieve said technical data related to one or more industrial devices, the method comprising:

a user selecting one or more given industrial devices in an industrial facility,

selecting by means of said computing device a representation of the industrial device and marking it in a computer program for control running on said at least one computing device, and

retrieving technical data about the selected industrial device,

going to a place in the industrial facility where a display member separate from the at least one computing device is located,

approaching the separate display member, the at least one computing device being recognised by location detecting means combined with an identity associated with the logged-on user or his computing device, and

the user transmitting a reference for at least one of the one or more industrial devices to the separate display member for retrieval of technical information associated with the industrial device so referenced and display and/or manipulation on a graphical user interface of the separate display member.