Augmented-reality system for situation-related support of the interaction between a user and an engineering apparatus

• US 20020044104A1
• Filed: 09/04/2001
• Published: 04/18/2002
• Est. Priority Date: 03/02/1999
• Status: Active Grant

• Current Assignee: Siemens AG
• Original Assignee: Siemens AG
• Inventors: Friedrich, Wolfgang, Wohlgemuth, Wolfgang
• Granted Patent: US 7,324,081 B2
• Time in Patent Office: Days
• US Class Current: 345/8
• CPC Class Codes: G05B 19/409 characterised by using manual data input [MDI] or by using control panel, e.g. controlling functions with the panel; characterised by control panel details or by setting parameters G05B19/408, G05B19/4093 take precedence
• CPC Class Codes: G05B 2219/32014 Augmented reality assists operator in maintenance, repair, programming, assembly, use of head mounted display with 2-D 3-D display and voice feedback, voice and gesture command
• CPC Class Codes: G05B 2219/37567 3-D vision, stereo vision, with two cameras

Abstract

The invention relates to an augmented-reality system having a mobile apparatus for the context-dependent insertion of assembly instructions. The context-dependent insertion of assembly instructions with process-optimized allocation of the necessary work steps provides situation-related support by for work sequences.

Claims

1. System for situation-related support of the interaction between a user and an engineering apparatus having recording means for recording real information and having at least one camera for recording an operating situation, and having means for the context-dependent determination of work sequences for the user and having a mobile apparatus for the context-dependent insertion of the work sequences.

2. The system according to claim 1, wherein the system has means for the process-optimized allocation of the work steps.

3. The system according to claim 1, wherein the recording means has an image-sensing apparatus for recording the real information and also visualization means for visualizing information data.

4. The system according to claim 1, wherein the recording means are user-controlled.

5. The system according to claim 1, wherein the visualization means are in the form of display apparatuses arranged in the area of goggle lenses of data goggles, in that the recording means provided is an image-sensing apparatus arranged on the data goggles, and in that a microphone arranged on the data goggles is provided for recording voice commands.

6. A method for situation-related support of the interaction between a user and an engineering apparatus in a system, in which real information and, using at least one camera, an operating situation are recorded and are used to determine context-dependent work sequences for the user and context-dependent work sequences are inserted on the mobile apparatus for the user.

7. The method according to claim 6, wherein that process-optimized allocation of the work steps is provided.

8. The method according to claim 6, wherein the real information is recorded using recording means with an image-sensing apparatus, and in that the information data are visualized for the user using visualization means.

9. The method according to claim 6, wherein the recording means are user-controlled.

10. The method according to claim 8, wherein that the visualization means are in the form of display apparatuses arranged in the area of goggle lenses of data goggles, in that the recording means provided are an image-sensing apparatus arranged on the data goggles, and in that a microphone arranged on the data goggles is provided for recording voice commands.