Redundant tracking system

• US 10,692,285 B2
• Filed: 09/23/2019
• Issued: 06/23/2020
• Est. Priority Date: 10/24/2016
• Status: Active Grant

• Current Assignee: Snap, Inc.
• Original Assignee: Snap, Inc.
• Inventors: McPhee, Andrew James, Hare, Samuel Edward, Yu, Peicheng, Murphy, Robert Cornelius, Sagar, Dhritiman
• Primary Examiner(s): Broome, Said
• Application Number:
  US16/579,463
• Publication Number:
  US 20200020158A1
• Time in Patent Office: 274 Days
• Field of Search: None
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: G06F 11/08 Error detection or correction by redundancy in data representation, e.g. by using checking codes
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 2203/0382 Plural input, i.e. interface arrangements in which a plurality of input device of the same type are in communication with a PC
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments

Abstract

A redundant tracking system comprising multiple redundant tracking sub-systems, enabling seamless transitions between such tracking sub-systems, provides a solution to this problem by merging multiple tracking approaches into a single tracking system. This system is able to combine tracking objects with six degrees of freedom (6DoF) and 3DoF through combining and transitioning between multiple tracking systems based on the availability of tracking indicia tracked by the tracking systems. Thus, as the indicia tracked by any one tracking system becomes unavailable, the redundant tracking system seamlessly switches between tracking in 6DoF and 3DoF thereby providing the user with an uninterrupted experience.

Claims

1. A system comprising:

a memory; and

at least one hardware processor coupled to the memory and comprising a redundant tracking system, and one or more processors that cause the system to perform operations comprising;

causing display of a presentation of a space at a client device, the presentation of the space comprising a plurality of features;

receiving an input that selects a point in the presentation of the space;

receiving a selection of a template from among a set of templates;

identifying a set of tracking indicia based on the point in the presentation of the space and the template, the tracking indicia comprising at least a portion of the plurality of features;

generating an object based on the template;

rendering the object at a position in the presentation of the space, the position based on the point selected by the input; and

tracking the position of the object in the presentation of the space based on the set of tracking indicia.

2. The system of claim 1, wherein the set of indicia comprises at least six indicia.

3. The system of claim 1, wherein the system further comprises a plurality of tracking systems, the plurality of tracking systems including at least a natural feature tracking system and a gyroscopic tracking system.

4. The system of claim 3, wherein the tracking the position of the object in the presentation of the space based on the set of tracking indicia is based on the natural feature tracking system, and the instructions cause the system to perform operations further comprising:

detecting an interruption in at least a portion of the tracking indicia; and

tracking the position of the object in the presentation of the space based on the gyroscopic tracking system in response to the detecting the interruption.

5. The system of claim 3, wherein the gyroscopic tracking system tracks pitch, yaw, roll, and translations based on at least a subset of the set of tracking indicia.

6. The system of claim 1, wherein the template comprises a set of object parameters, and the generating the object based on the template includes generating the object based on the set of object parameters of the template.

7. The system of claim 1, wherein the object includes an interactive media object.

8. A method comprising:

causing display of a presentation of a space at a client device, the presentation of the space comprising a plurality of features;

receiving an input that selects a point in the presentation of the space;

receiving a selection of a template from among a set of templates;

identifying a set of tracking indicia based on the point in the presentation of the space and the template, the tracking indicia comprising at least a portion of the plurality of features;

generating an object based on the template;

rendering the object at a position in the presentation of the space, the position based on the point selected by the input; and

tracking the position of the object in the presentation of the space based on the set of tracking indicia.

9. The method of claim 8, wherein the set of indicia comprises at least six indicia.

10. The method of claim 8, wherein the tracking the position of the object in the presentation of the space is performed by a plurality of tracking systems, the plurality of tracking systems including at least a natural feature tracking system and a gyroscopic tracking system.

11. The method of claim 10, wherein the tracking the position of the object in the presentation of the space based on the set of tracking indicia is based on the natural feature tracking system, and the method further comprises:

detecting an interruption in at least a portion of the tracking indicia; and

tracking the position of the object in the presentation of the space based on the gyroscopic tracking system in response to the detecting the interruption.

12. The method of claim 10, wherein the gyroscopic tracking system tracks pitch, yaw, roll, and translations based on at least a subset of the set of tracking indicia.

13. The method of claim 8, wherein the template comprises a set of object parameters, and the generating the object based on the template includes generating the object based on the set of object parameters of the template.

14. The method of claim 8, wherein the object includes an interactive media object.

15. A non-transitory machine-readable storage medium including a redundant tracking system, the redundant tracking system comprising a set of tracking systems, and comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

causing display of a presentation of a space at a client device, the presentation of the space comprising a plurality of features;

receiving an input that selects a point in the presentation of the space;

receiving a selection of a template from among a set of templates;

identifying a set of tracking indicia based on the point in the presentation of the space and the template, the tracking indicia comprising at least a portion of the plurality of features;

generating an object based on the template;

rendering the object at a position in the presentation of the space, the position based on the point selected by the input; and

tracking the position of the object in the presentation of the space based on the set of tracking indicia.

16. The non-transitory machine-readable storage medium of claim 15, wherein the set of indicia comprises at least six indicia.

17. The non-transitory machine-readable storage medium of claim 15, wherein the tracking the position of the object in the presentation of the space is performed by a plurality of tracking systems, the plurality of tracking systems including at least a natural feature tracking system and a gyroscopic tracking system.

18. The non-transitory machine-readable storage medium of claim 17, wherein the tracking the position of the object in the presentation of the space based on the set of tracking indicia is based on the natural feature tracking system, and the instructions cause the machine to perform operations further comprising:

detecting an interruption in at least a portion of the tracking indicia; and

tracking the position of the object in the presentation of the space based on the gyroscopic tracking system in response to the detecting the interruption.

19. The non-transitory machine-readable storage medium of claim 17, wherein the gyroscopic tracking system tracks pitch, yaw, roll, and translations based on at least a subset of the set of tracking indicia.

20. The non-transitory machine-readable storage medium of claim 15, wherein the template comprises a set of object parameters, and the generating the object based on the template includes generating the object based on set of object parameters of the template.