DEVICE, METHOD AND COMPUTER PROGRAM FOR RECONSTRUCTING A MOTION OF AN OBJECT

• US 20150310656A1
• Filed: 11/12/2013
• Published: 10/29/2015
• Est. Priority Date: 11/22/2012
• Status: Active Grant

• Current Assignee: Fraunhofer Gesellschaft Zur Foerderung Der Angewandten Forsching E.V.
• Original Assignee: Fraunhofer Gesellschaft Zur Foerderung Der Angewandten Forsching E.V.
• Inventors: OTTO, Stephan, BRETZ, Ingmar, FRANKE, Norbert, VON DER GRUEN, Thomas, MUTSCHLER, Christopher
• Granted Patent: US 9,754,400 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06T 13/40 of characters, e.g. humans, animals or virtual beings
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training

Abstract

In a method for reconstructing a motion of an object from a sequence of motion pattern segments of a computer model of the object, a motion transition between an initial motion state and a final motion state of the object in a time interval of the motion is captured based on position data of the at least one sampling point which is received from the position marker. Further, at least one motion pattern segment corresponding to the motion transition is selected from a plurality of motion patterns of the computer model which are stored in a database such that the selected motion pattern segment leads with sufficient probability from the initial motion state to the final motion state for the time interval. Furthermore, an image of the motion of the object for the time interval is reconstructed using the initial motion state and the selected motion pattern segment.

Claims

1. A method for reconstructing a motion of an object from a sequence of motion pattern segments of a 3D computer model of the object, wherein each motion pattern segment corresponds to a different time interval of the motion, and wherein the object comprises at least one sampling point coupled to a position marker, the method comprising:

a) capturing a motion transition between an initial motion state and a final motion state of the object in a time interval of the motion based on position data of the at least one sampling point which is received from the position marker;

b) selecting at least one digital motion pattern segment corresponding to the motion transition from a plurality of digital motion patterns of the 3D computer model which are stored in a database such that the selected digital motion pattern segment for the 3D computer model leads with sufficient probability from the initial motion state to the final motion state for the time interval; and

c) reconstructing an image of the motion of the object for the time interval by use of the 3D computer model using the initial motion state and the selected digital motion pattern segment of the 3D computer model.

2. The method of claim 1, wherein acts a) to c) form a current iteration of an iterative method for reconstructing the motion, and wherein the initial motion state for the current iteration was reconstructed in a previous iteration of the iterative method so that the reconstructed image of the motion adds up from a plurality of digital motion pattern segments corresponding to selected and consecutive time intervals or iterations.

3. The method of claim 1, wherein, when selecting, captured motion transitions of the object are iteratively compared to the stored digital motion patterns of the 3D computer model such that a hypothesis is determined for a current motion state of the object based on at least one past motion state of the object and a current transition probability which corresponds to a possible motion transition between at least two temporarily consecutive, discrete motion states of the object.

4. The method of claim 3, wherein the current motion state and the at least one past motion state of the object form a sequence of a Markov model.

5. The method of claim 1, wherein, by selecting the at least one digital motion pattern segment, the most probable sequence of motion states in a predefined Markov model and a captured sequence of motion transitions is determined in order to reconstruct the motion of the object.

6. The method of claim 1, wherein the digital motion pattern segment is initially selected based on a subset of a set of possible motion states, wherein the subset is adjusted in order to be able to at least coarsely reconstruct the image of the motion, and wherein, following a coarse reconstruction, the image of the motion is finely reconstructed based on further states taken from the set outside the subset.

7. The method of claim 1, wherein, when selecting the digital motion pattern segment, after a predefined period of time after capturing the motion transition, a digital motion pattern segment is selected which, after this period of time, leads with the highest probability from the initial motion state to the final motion state for the time interval.

8. The method of claim 1, wherein the digital motion patterns stored in the database are normalized, and wherein, to select the digital motion pattern segment, a scaling factor corresponding to an object size is applied to the position data received from the position marker in order to obtain a normalized motion of the object.

9. The method of claim 1, wherein the digital motion pattern segment comprises at least one frame of a digital motion pattern of the 3D computer model which corresponds to the time interval.

10. The method of claim 1, wherein the digital motion pattern segment is normalized and wherein a scaling factor corresponding to an object size is applied to the same for reconstructing the image in order to reconstruct a denormalized motion course of the object with the at least one sampling point.

12. The method of claim 1, wherein different priorities are assigned to different sampling points of the object, and position data of higher-priority sampling points is evaluated earlier in time than position data of lower-priority sampling points.

13. The method of claim 1, wherein a higher priority is assigned to a larger object than to a comparatively smaller object, and wherein position data of higher-priority objects is evaluated earlier in time than position data of lower-priority objects.

14. The method of claim 1, wherein the digital motion patterns stored in the database are predefined three-dimensional motion patterns of the 3D computer model which correspond to possible real motions of the object.

15. The method of claim 1, further comprising:

transmitting, by a radio transmitter coupled to the at least one position marker, position data to an evaluation device which is adjusted to perform the method for reconstructing the motion of the object.

16. The method of claim 1, wherein the position data comes from position markers of a real-time locating system and the acts of the method are performed under real-time conditions.

11. The method of claim wherein, up to a first instant after receiving the position data, the digital motion pattern segment is selected from the plurality of stored digital motion patterns which, at this first instant, corresponds with the highest probability to the captured motion of the object, and wherein, after the first instant up to a second instant, the search for a better-matching digital motion pattern segment for the time interval is continued.

17. A computer program product, comprising a non-transitory computer-readable medium having a computer readable program code embodied therein, the computer readable program code adapted to be executed to implement a method for reconstructing a motion of an object from a sequence of motion pattern segments of a 3D computer model of the object, wherein each motion pattern segment corresponds to a different time interval of the motion, and wherein the object comprises at least one sampling point coupled to a position marker, the method comprising:

a) capturing a motion transition between an initial motion state and a final motion state of the object in a time interval of the motion based on position data of the at least one sampling point which is received from the position marker;

b) selecting at least one digital motion pattern segment corresponding to the motion transition from a plurality of digital motion patterns of the 3D computer model which are stored in a database such that the selected digital motion pattern segment for the 3D computer model leads with sufficient probability from the initial motion state to the final motion state for the time interval; and

c) reconstructing an image of the motion of the object for the time interval by use of the 3D computer model using the initial motion state and the selected digital motion pattern segment of the 3D computer model.

18. A device for reconstructing a motion of an object from a sequence of motion pattern segments of a 3D computer model of the object, wherein each motion pattern segment corresponds to a different time interval of the motion, and wherein the object comprises at least one sampling point coupled to a position marker, the device comprising:

a capturing unit configured to capture a motion transition between an initial motion state and a final motion state of the object in a time interval of the motion based on position data of the at least one sampling point which is received by the position marker;

a selecting unit configured to select at least one digital motion pattern segment corresponding to the motion transition from a plurality of digital motion patterns of the 3D computer model which are stored in a database, wherein the selected digital motion pattern segment for the 3D computer model leads with sufficient probability from the initial motion state to the final motion state for the time interval; and

a reconstructing unit configured to reconstruct an image of the motion of the object for the time interval by use of the 3D computer model using the initial motion state and the selected digital motion pattern segment of the 3D computer model.