METHOD AND DEVICE FOR DETERMINING AND REPRODUCING VIRTUAL, LOCATION-BASED INFORMATION FOR A REGION OF SPACE

• US 20140292642A1
• Filed: 06/13/2012
• Published: 10/02/2014
• Est. Priority Date: 06/15/2011
• Status: Abandoned Application

• Current Assignee: IFAKT GmbH
• Original Assignee: IFAKT GmbH
• Inventors: Schubert, Lars, Grube, Mathias, Heim, Armand, Tuerck, Stefan
• Application Number:
  US14/125,684
• Publication Number:
  US 20140292642A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: A61B 5/1113 Local tracking of patients, e.g. in a hospital or private home
• CPC Class Codes: A61B 6/46 Arrangements for interfacing with the operator or the patient
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 7/251 involving models
• CPC Class Codes: G06T 7/75 involving models

Abstract

The present invention relates to a method for determining and reproducing virtual, location-based information for a region of space, comprising the steps of:

• • using a sensor device to detect measurement data from at least one part of a body of a viewer in the region of space,
  • determining a posture of the viewer on the basis of the measurement data, identifying a spatial position of the viewer relative to the region of space,
  • determining a viewing direction of the viewer relative to the region of space on the basis of the spatial position and the posture,
  • determining the virtual, location-based information on the basis of the viewing direction, and
  • using a display device to reproduce the virtual, location-based information.

Claims

1. A method for determining and reproducing virtual, location-based information for a region of space, comprising the steps of:

using a sensor device to detect measurement data from at least one part of a body of a viewer in the region of space,

determining a posture of the viewer on the basis of the measurement data,

identifying a spatial position of the viewer relative to the region of space,

determining a viewing direction of the viewer relative to the region of space on the basis of the spatial position and the posture,

determining the virtual, location-based information on the basis of the viewing direction, and

using a display device to reproduce the virtual, location-based information.

2. The method as claimed in claim 1, characterized in that three-dimensional measurement data is detected as the measurement data.

3. The method as claimed in claim 1, characterized in that the sensor device is arranged in the region of space independently of the viewer.

4. The method as claimed in claim 1, characterized in that the sensor device (34)4s arranged in a fixed position in the region of space.

5. The method as claimed in claim 1, characterized in that the sensor device automatically determines a sensor position relative to the region of space.

6. The method as claimed in claim 1, characterized in that the sensor device automatically determines a sensor orientation relative to the region of space.

7. The method as claimed in claim 1, characterized in that a multiplicity of sensor devices are used.

8. The method as claimed in claim 1, characterized in that at least an arm region of the viewer is used as the at least one part of the body of the viewer.

9. The method as claimed in claim 1, characterized in that at least a chest region of the viewer is used as the at least one part of the body of the viewer.

10. The method as claimed in claim 1, characterized in that a skeleton model is formed on the basis of the measurement data, and the skeleton model is used to determine the posture of the viewer.

11. The method as claimed in claim 1, characterized in that a movement of the viewing direction is detected, and the viewing direction is determined on the basis of the movement.

12. The method as claimed in claim 1, characterized in that CAD data is used as the virtual, location-based information.

13. The method as claimed in claim 1, characterized in that a tablet computer is used as the display device 28.

14. The method as claimed in claim 1, characterized in that additional real, location-based information is reproduced on the display device.

15. A device for determining and reproducing virtual, location-based information for a region of space, comprising;

a sensor device for detecting measurement data from at least one part of a body of a viewer in the region of space,

a control and analysis unit for determining a posture of the viewer on the basis of the measurement data, for identifying a spatial position of the viewer relative to the region of space, for determining a viewing direction of the viewer relative to the region of space on the basis of the spatial position and the posture, and for determining the virtual, location-based information on the basis of the viewing direction,

and a display device for reproducing the virtual, location-based information.

16. A control and analysis unit for a device for determining and reproducing virtual, location-based information for a region of space, comprising

means for receiving measurement data from a sensor device, which detects measurement data from at least one part of a body of a viewer in the region of space,

means for determining a posture of the viewer on the basis of the measurement data,

means for identifying a spatial position of the viewer relative to the region of space,

means for determining a viewing direction of the viewer relative to the region of space on the basis of the spatial position and the posture,

means for determining the virtual, location-based information on the basis of the viewing direction, and

means for providing the virtual, location-based information for reproducing the virtual, location--based information.

17. A method for operating a control and analysis unit for a device for determining and reproducing virtual, location-based information for a region of space, comprising the steps of:

receiving measurement data from a sensor device, which detects measurement data from at least one part of a body of a viewer in the region of space,

determining a posture of the viewer on the basis of the measurement data,

identifying a spatial position of the viewer relative to the region of space,

determining a viewing direction of the viewer relative to the region of space on the basis of the spatial position and the posture,

determining the virtual, location-based information on the basis of the viewing direction, and

providing the virtual, location-based information for reproducing the virtual, location-based information.

18. A non-transitory computer-readable recording medium that stores therein a computer program product, which, when executed by a processor, causes the method as claimed in claim 17 to be performed.