METHOD OF DETERMINING REFERENCE FEATURES FOR USE IN AN OPTICAL OBJECT INITIALIZATION TRACKING PROCESS AND OBJECT INITIALIZATION TRACKING METHOD
First Claim
1. A method of determining reference features for use in an optical object initialization tracking process, said method comprising the following steps:
- a) providing at least one current image of a real environment or synthetically generated by rendering a virtual model of a real object to be tracked with at least one camera and extracting current features from the at least one current image;
b) providing reference features adapted for use in an optical object initialization tracking process;
c) matching a plurality of the current features with a plurality of the reference features;
d) estimating at least one parameter associated with the current image based on a number of current and reference features which were matched, and determining for each of the reference features which were matched with one of the current features whether they were correctly or incorrectly matched;
e) wherein the steps a) to d) are processed iteratively multiple times, wherein in step a) of every respective iterative loop a respective new current image is captured by at least one camera and steps a) to d) are processed with respect to the respective new current image;
f) determining at least one indicator associated to reference features which were correctly matched and/or to reference features which were incorrectly matched, wherein the at least one indicator is determined depending on how often the respective reference feature has been correctly matched or incorrectly matched, respectively, andwherein in step d) the method includes the step of comparing at least one property of the current image with at least one property of a reference image, which provides the reference features, under consideration of a pose of the at least one camera while capturing the at least one current image, and verifying the pose of the at least one camera based on the comparison, and wherein the at least one indicator is updated if the pose of the at least one camera is verified, and wherein the comparison is according to pixel information of the current and reference images.
1 Assignment
0 Petitions
Accused Products
Abstract
A method of determining reference features for use in an optical object initialization tracking process is disclosed, said method comprising the following steps: a) capturing at least one current image of a real environment or synthetically generated by rendering a virtual model of a real object to be tracked with at least one camera and extracting current features from the at least one current image, b) providing reference features adapted for use in an optical object initialization tracking process, c) matching a plurality of the current features with a plurality of the reference features, d) estimating at least one parameter associated with the current image based on a number of current and reference features which were matched, and determining for each of the reference features which were matched with one of the current features whether they were correctly or incorrectly matched, e) wherein the steps a) to d) are processed iteratively multiple times.
-
Citations
18 Claims
-
1. A method of determining reference features for use in an optical object initialization tracking process, said method comprising the following steps:
-
a) providing at least one current image of a real environment or synthetically generated by rendering a virtual model of a real object to be tracked with at least one camera and extracting current features from the at least one current image; b) providing reference features adapted for use in an optical object initialization tracking process; c) matching a plurality of the current features with a plurality of the reference features; d) estimating at least one parameter associated with the current image based on a number of current and reference features which were matched, and determining for each of the reference features which were matched with one of the current features whether they were correctly or incorrectly matched; e) wherein the steps a) to d) are processed iteratively multiple times, wherein in step a) of every respective iterative loop a respective new current image is captured by at least one camera and steps a) to d) are processed with respect to the respective new current image; f) determining at least one indicator associated to reference features which were correctly matched and/or to reference features which were incorrectly matched, wherein the at least one indicator is determined depending on how often the respective reference feature has been correctly matched or incorrectly matched, respectively, and wherein in step d) the method includes the step of comparing at least one property of the current image with at least one property of a reference image, which provides the reference features, under consideration of a pose of the at least one camera while capturing the at least one current image, and verifying the pose of the at least one camera based on the comparison, and wherein the at least one indicator is updated if the pose of the at least one camera is verified, and wherein the comparison is according to pixel information of the current and reference images. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. An object initialization tracking method making use of reference features, said method comprising the following steps:
-
capturing at least one second current image with at least one camera and extracting current features from the at least one second current image; providing reference features adapted for use in an optical object initialization tracking process, and providing at least one indicator associated to each of the reference features, wherein the indicator is determined by; a) providing at least one current image of a real environment or synthetically generated by rendering a virtual model of a real object to be tracked with at least one camera and extracting current features from the at least one current image; b) providing reference features adapted for use in an optical object initialization tracking process; c) matching a plurality of the current features with a plurality of the reference features; d) estimating at least one parameter associated with the current image based on a number of current and reference features which were matched, and determining for each of the reference features which were matched with one of the current features whether they were correctly or incorrectly matched; e) wherein the steps a) to d) are processed iteratively multiple times, wherein in step a) of every respective iterative loop a respective new current image is captured by at least one camera and steps a) to d) are processed with respect to the respective new current image; f) determining at least one indicator associated to reference features which were correctly matched and/or to reference features which were incorrectly matched, wherein the at least one indicator is determined depending on how often the respective reference feature has been correctly matched or incorrectly matched, respectively, and wherein in step d) the method includes the step of comparing at least one property of the current image with at least one property of a reference image, which provides the reference features, under consideration of a pose of the at least one camera while capturing the at least one current image, and verifying the pose of the at least one camera based on the comparison, and wherein the at least one indicator is updated if the pose of the at least one camera is verified, wherein the comparison is according to pixel information of the current and reference images; and using the indicator for a selection or prioritization of reference features which are to be matched with current features of the at least one second current image, and using the selected or prioritized reference features in an object initialization tracking process. - View Dependent Claims (10)
-
-
11. An object initialization tracking method making use of reference features, said method comprising the steps of:
-
a) providing at least one first current image of a real environment or synthetically generated by rendering a virtual model of a real object to be tracked with at least one camera and extracting current features from the at least one first current image; b) providing reference features adapted for use in an optical object initialization tracking process; c) matching a plurality of the current features with a plurality of the reference features; d) determining at least one parameter associated with the first current image in an object initialization tracking process based on a number of current and reference features which were matched, and determining for each of the reference features which were matched with one of the current features whether they were correctly or incorrectly matched; e) updating at least one indicator associated to reference features which were correctly matched and/or to reference features which were incorrectly matched; f) using the indicator for a selection or prioritization of reference features which are to be matched with current features of at least one second current image captured by at least one camera, and using the selected or prioritized reference features in an object initialization tracking process with respect to the second current image, and wherein in step d) the method includes the step of comparing at least one property of the current image with at least one property of a reference image, which provides the reference features, under consideration of a pose of the at least one camera while capturing the at least one current image, and verifying the pose of the at least one camera based on the comparison, and wherein the at least one indicator is updated if the pose of the at least one camera is verified, and wherein the comparison is according to pixel information of the current and reference images. - View Dependent Claims (12, 13, 14, 15, 16, 17)
-
-
18. A non-transitory computer-readable medium comprising software code sections adapted to be loaded into the internal memory of a digital computer system, and being used to determine reference features for use in an optical object initialization tracking process, and by means of which the following steps are performed:
-
a) providing at least one current image of a real environment or synthetically generated by rendering a virtual model of a real object to be tracked with at least one camera and extracting current features from the at least one current image; b) providing reference features adapted for use in an optical object initialization tracking process; c) matching a plurality of the current features with a plurality of the reference features; d) estimating at least one parameter associated with the current image based on a number of current and reference features which were matched, and deteiinining for each of the reference features which were matched with one of the current features whether they were correctly or incorrectly matched; e) wherein the steps a) to d) are processed iteratively multiple times, wherein in step a) of every respective iterative loop a respective new current image is captured by at least one camera and steps a) to d) are processed with respect to the respective new current image; f) determining at least one indicator associated to reference features which were correctly matched and/or to reference features which were incorrectly matched, wherein the at least one indicator is determined depending on how often the respective reference feature has been correctly matched or incorrectly matched, respectively; and wherein in step d) the method includes the step of comparing at least one property of the current image with at least one property of a reference image, which provides the reference features, under consideration of a pose of the at least one camera while capturing the at least one current image, and verifying the pose of the at least one camera based on the comparison, and wherein the at least one indicator is updated if the pose of the at least one camera is verified, and wherein the comparison is according to pixel information of the current and reference images.
-
Specification