System and method for synchronizing fiducial markers

• US 9,626,764 B2
• Filed: 06/30/2015
• Issued: 04/18/2017
• Est. Priority Date: 07/01/2014
• Status: Active Grant

• Current Assignee: Tilt Five, Inc.
• Original Assignee: Castar, Inc.
• Inventors: Ellsworth, Jeri J., Clements, Ken
• Primary Examiner(s): NAKHJAVAN, SHERVIN K
• Application Number:
  US14/788,483
• Publication Number:
  US 20160005174A1
• Time in Patent Office: 658 Days
• Field of Search: None
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2207/30208 Marker matrix
• CPC Class Codes: G06T 2207/30244 Camera pose
• CPC Class Codes: G06T 7/73 using feature-based methods

Abstract

A system of active fiducial markers for pose calculation of head mounted displays is described in which information is exchanged among said markers for the purpose of synchronization. Fiducial patterns are made more easily identifiable by selective duty cycles of sub groups of synchronized emitters and means is described to propagate pose information among markers.

Claims

1. A method of active fiducial marker synchronization comprising

(a) providing a plurality of light emitting fiducial markers having means to modulate emitted light, or radio frequency, patterns and to receive and demodulate information encoded as light, or radio frequency, patterns;

(b) encoding synchronization time stamps as modulated light patterns at a first marker and transmitting said patterns from said first marker to secondary markers;

(c) receiving and demodulating said time stamps at one or more said secondary fiducial markers; and

(d) using said received time stamps to set schedules for emission of patterns of light from said fiducial markers.

2. The method of claim 1 further comprising:

(a) providing a camera or cameras having the means to image said fiducial markers;

(b) calculating the pose of said camera or cameras relative to said fiducial markers from said images;

(c) providing communicating means for said cameras to encode and transmit said relative pose information to said fiducial markers and providing communication means at said fiducial markers to receive and decode said information;

(d) sending said relative pose information to said markers and receiving said pose information at said fiducial markers;

(e) storing said relative pose information at said fiducial markers.

3. The method of claim 2 further comprising:

(a) providing communication means for said fiducial markers to exchange said relative pose information; and

(b) exchanging said relative pose information among said fiducial markers.

4. The method of claim 2 further comprising:

(a) providing a motion sensor at said camera or cameras; and

(b) using said motion sensor to track the motion of said camera or cameras when images of said fiducial markers are out of view.

5. The method of claim 4 further comprising using said tracked motion to calculate estimates of the relative pose of fiducial markers when said fiducial markers are brought into view.

6. The method of claim 2 further comprising using averaging or other statistical means to combine pose estimates so as to reduce pose uncertainty.