SYSTEM AND METHOD FOR FAULT DETECTION AND RECOVERY FOR CONCURRENT ODOMETRY AND MAPPING
First Claim
1. A method, comprising:
- modifying, at an electronic device, a three-dimensional representation of the environment of the electronic device based on first mapping data received from a motion tracking module, wherein the first mapping data is based on images captured from one or more visual sensors and non-visual data from one or more non-image sensors;
in response to receiving second mapping data from the motion tracking module after receiving an indication from the motion tracking module that a fault condition exists, omitting the second mapping data from the three-dimensional representation; and
in response to receiving third mapping data from the motion tracking module after receiving an indication from the motion tracking module that the fault condition has resolved, modifying the three-dimensional representation based on the third mapping data.
2 Assignments
0 Petitions
Accused Products
Abstract
An electronic device detects and recovers from fault conditions while tracking its motion and building a map of its environment. A front-end motion tracking module detects fault conditions while tracking motion over time and provides mapping data to a back-end mapping module. The front-end motion tracking module indicates to the back-end mapping module when a fault condition has been detected and when the fault condition is no longer detected. The back-end mapping module generates maps from the mapping data and merges the maps to build a three-dimensional representation of the environment. The back-end mapping module buffers or discards any mapping data received from the front-end motion tracking module during the existence of a fault condition. The back-end mapping module merges the maps generated based on mapping data received before and after the fault condition and adds the merged maps to the three-dimensional representation of the environment.
29 Citations
20 Claims
-
1. A method, comprising:
-
modifying, at an electronic device, a three-dimensional representation of the environment of the electronic device based on first mapping data received from a motion tracking module, wherein the first mapping data is based on images captured from one or more visual sensors and non-visual data from one or more non-image sensors; in response to receiving second mapping data from the motion tracking module after receiving an indication from the motion tracking module that a fault condition exists, omitting the second mapping data from the three-dimensional representation; and in response to receiving third mapping data from the motion tracking module after receiving an indication from the motion tracking module that the fault condition has resolved, modifying the three-dimensional representation based on the third mapping data. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A method, comprising:
-
generating, at an electronic device, a three-dimensional representation of an environment of the electronic device based on first mapping data received from a motion tracking module of the electronic device, the mapping data comprising feature descriptors of one or more spatial features representing an object in the environment of the electronic device based on images captured from one or more visual sensors and non-visual data from one or more non-image sensors; in response to receiving from the motion tracking module an indication of a fault condition, interrupting generating the three-dimensional representation of the environment; and in response to receiving an indication from the motion tracking module that the fault condition has resolved, resuming generating the three-dimensional representation based on second mapping data received from the motion tracking module after the indication that the fault condition has resolved. - View Dependent Claims (10, 11, 12, 13, 14, 15)
-
-
16. An electronic device, comprising:
-
a motion tracking module configured to track motion of the electronic device relative to an environment of the electronic device based on mapping data comprising feature descriptors of one or more spatial features representing one or more objects in the environment and to indicate a fault condition, wherein the feature descriptors are generated based on images captured from one or more visual sensors and non-visual data from one or more non-image sensors; and a mapping module configured to generate a three-dimensional representation of the environment of the electronic device based on first mapping data received from the motion tracking module, wherein the mapping module is further configured to interrupt generating the three-dimensional representation of the environment in response to receiving from the motion tracking module an indication of a fault condition and, in response to receiving an indication from the motion tracking module that the fault condition has resolved, resume generating the three-dimensional representation based on second mapping data received from the motion tracking module after the indication that the fault condition has resolved. - View Dependent Claims (17, 18, 19, 20)
-
Specification