System for, and method of, situation-relevant asistance to interaction with the aid of augmented-reality technologies

• US 20020046368A1
• Filed: 09/04/2001
• Published: 04/18/2002
• Est. Priority Date: 03/02/1999
• Status: Abandoned Application

• Current Assignee: Siemens AG
• Original Assignee: Siemens AG
• Inventors: Friedrich, Wolfgang, Wohlgemuth, Wolfgang
• Application Number:
  US09/945,776
• Publication Number:
  US 20020046368A1
• Time in Patent Office: Days
• US Class Current: 714/45
• CPC Class Codes: G05B 19/409 characterised by using manual data input [MDI] or by using control panel, e.g. controlling functions with the panel; characterised by control panel details or by setting parameters G05B19/408, G05B19/4093 take precedence
• CPC Class Codes: G05B 19/4183 characterised by data acquisition, e.g. workpiece identification
• CPC Class Codes: G05B 19/41875 characterised by quality surveillance of production
• CPC Class Codes: G05B 2219/31027 Computer assisted manual assembly CAA, display operation, tool, result
• CPC Class Codes: G05B 2219/32014 Augmented reality assists operator in maintenance, repair, programming, assembly, use of head mounted display with 2-D 3-D display and voice feedback, voice and gesture command
• CPC Class Codes: G05B 2219/35482 Eyephone, head-mounted 2-D or 3-D display, also voice and other control
• CPC Class Codes: G05B 2219/35494 Online documentation, manual, procedures, operator, user guidance, assistance
• CPC Class Codes: G05B 2219/35495 Messages to operator in multimedia, voice and image and text
• CPC Class Codes: Y02P 90/02 Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Abstract

The invention relates to a system for, and method of, situation-relevant assistance to interaction with the aid of augmented-reality technologies. To achieve optimized assistance, especially when setting up a system, commissioning and right up to the maintenance of systems and processes controlled by means of automation technology it is proposed that a specific operating situation be detected automatically, that the operating situation be analyzed and that information data relevant for the specific analyzed operating situation be automatically selected from static information and be displayed.

Claims

1. A system for documentation processing for situation-relevant assistance to interaction between a user and an engineering apparatus particularly for engineering and industrial applications, comprising storage means for storing documentation data and comprising acquisition means designed as an image recording device for acquiring real information comprising access means for accessing the documentation data and comprising analysis means for evaluating the real information and for selecting the stored documentation data as a function of the real information.

2. The system according to claim 1, wherein the documentation data are static and dynamic information data.

3. The system according to claim 1, wherein the analysis means for evaluating the real information are provided in such a way that a deployment context, in particular an object of the documentation data is determined from the real information, and in that the system includes visualization means for visualizing the documentation data.

4. The system according to claim 1, wherein the acquisition means are user-controlled.

5. The system according to claim 3, wherein the visualization means are designed as display devices disposed in the vicinity of eyepieces of data goggles, in that the acquisition means provided is an image acquisition device disposed on the data goggles, and in that a microphone disposed on the data goggles is provided to detect speech commands.

6. A method of documentation processing for situation-relevant assistance to interaction between a user and an engineering apparatus particularly for engineering and industrial applications, wherein documentation data are stored and real information is acquired by means of acquisition means designed as an image recording device, wherein the documentation data are accessed in such a way that the real information is analyzed and the stored documentation data are selected as a function of the real information.

7. The system according to claim 6, wherein the documentation data are static and dynamic information data.

8. The system according to claim 6, wherein a deployment context, in particular an object of the documentation data is determined from the real information, and in that the documentation data determined are visualized via visualization means.

9. The system according to claim 6, wherein the acquisition means are user-controlled.

10. The system according to claim 8, wherein the visualization means are designed as display devices disposed in the vicinity of eyepieces of data goggles, in that the acquisition means provided is an image acquisition device disposed on the data goggles, and in that a microphone disposed on the data goggles is provided to detect speech commands.