Method and apparatus for determining degrees of freedom of a camera

• US 5,832,139 A
• Filed: 07/31/1996
• Issued: 11/03/1998
• Est. Priority Date: 07/31/1996
• Status: Expired due to Term

• Current Assignee: Omniplanar, Inc. (Honeywell International Inc.)
• Original Assignee: Omniplanar, Inc. (Honeywell International Inc.)
• Inventors: Dunphy, Robert H., Batterman, Eric P., Chandler, Donald G.
• Primary Examiner(s): Boudreau, Leo H.
• Assistant Examiner(s): Mariam, Daniel G.
• Application Number:
  US08/688,838
• Time in Patent Office: 825 Days
• Field of Search: 382/103, 382/291, 382/151, 382/201, 382/275, 348/135, 348/140
• US Class Current: 382/291
• CPC Class Codes: G06F 3/0321 by optically sensing the absolute position with respect to a regularly patterned surface forming a passive digitiser, e.g. pen optically detecting position indicative tags printed on a paper sheet constructional details of pen-shaped pointing devices G06F3/03545, G06F3/03542, G06F3/037
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Abstract

A method for determining up to six degrees of freedom of a camera relative to a reference frame comprises sensing an optically modulated target with the camera and processing the camera'"'"'s video output signal with a digital computer. The target may have a single pattern, multiple patterns, or patterns of varying size. Multiple targets may also be used. A very wide field of view camera may be used in conjunction with a method for removing geometric distortion from the camera'"'"'s view. Target patterns may be transmissive, reflective, or retroreflective, or may actively emit light. Asymmetric patterns are used to eliminate ambiguity in the recovery of the degrees of freedom.

Claims

1. A method for determining at least three degrees of freedom of a camera relative to a reference frame, said reference frame having a known spatial relationship to an optically modulated target, wherein said optically modulated target is asymmetric whereby ambiguity in the determination of said at least three degrees of freedom of said camera is substantially eliminated, wherein said optically modulated target further comprises at least one quadrilateral, and wherein said camera comprises an optical imaging means producing a predetermined geometric distortion, said method comprising:

(a) sensing at least a portion of said optically modulated target using said camera to produce a video signal;

(b) processing said video signal using digital computing means, wherein said step of processing said video signal further comprises;

determining first coordinates of a first point from said video signal;

computing second coordinates of a second point, wherein said second coordinates are computed based upon said first coordinates and based upon said predetermined geometric distortion;

determining the vertices of said quadrilateral by computing the intersections of adjacent pairs of sides of said quadrilateral; and

using said vertices to determine said at least three degrees of freedom.

2. The optically modulated target of claim 1 wherein said optically modulated target comprises at least one larger pattern and at least one smaller pattern.

3. The optically modulated target of claim 2 wherein said at least one larger pattern is used to determine said at least three degrees of freedom of said camera when said camera is relatively far from said optically modulated target, and wherein said at least one smaller pattern is used to determine said at least three degrees of freedom of said camera when said camera is relatively close to said optically modulated target.

4. The optically modulated target of claim 1 wherein said optically modulated target comprises a plurality of patterns, and wherein sensing any one of said plurality of patterns is sufficient to determine said at least three degrees of freedom of said camera.

5. The optically modulated target of claim 4 wherein each pattern of said plurality of patterns is uniquely identifiable.

6. The method of claim 1 wherein said camera has a field of view of at least about 100 degrees.

7. The method of claim 1 wherein said optically modulated target comprises a plurality of patterns, said method further comprising combining numeric values determined from at least two patterns of said plurality of patterns to determine said at least three degrees of freedom.

8. The method of claim 1 for determining at least three degrees of freedom of a camera relative to a reference frame, wherein said system further includes, a plurality of optically modulated targets wherein each target of said plurality of optically modulated targets has a distinct known spatial relationship to said reference frame.

9. The optically modulated target of claim 1 wherein said optically modulated target has spatially varying optical transmittance, and wherein at least a portion of light emitted by a light source is transmitted through said optically modulated target to said camera.

10. The optically modulated target of claim 1 wherein said optically modulated target has spatially varying optical reflectance, and wherein at least a portion of light emitted by a light source is reflected by said optically modulated target to said camera.

11. The optically modulated target of claim 10, wherein said light source is attached to said camera.

12. The optically modulated target of claim 11, wherein said optically modulated target comprises a retroreflector.

13. The optically modulated target of claim 1 wherein said optically modulated target comprises a plurality of light sources disposed in a predetermined spatial arrangement.

14. A system for determining at least three degrees of freedom of a camera relative to a reference frame, said system comprising:

an optically modulated target having a known spatial relationship to said reference frame, said optically modulated target being asymmetric whereby ambiguity in the determination of said at least three degrees of freedom of said camera is substantially eliminated, and wherein said optically modulated target further comprises at least one quadrilateral;

a camera having an optical image forming apparatus for forming an image on an image sensor, said optical image forming apparatus producing a predetermined geometric distortion of a formed image on said image sensor, said formed image on said image sensor including at least a portion of said optically modulated target;

an optical image converting apparatus for converting said formed image on said image sensor to an electrical video signal; and

a digital computer responsive to said electrical video signal, said digital computer determining first coordinates of a first point from said electrical video signal, and second coordinates of a second point, wherein said second coordinates are computed based upon said first coordinates and said predetermined geometric distortion, said digital computer being responsive to said electrical video signal to determine the vertices of said quadrilateral by computing the intersections of adjacent pairs of sides of said quadrilateral, and using said vertices to determine said at least three degrees of freedom.

15. A system in accordance with claim 14, wherein said optically modulated target comprises at least one larger pattern and at least one smaller pattern.

16. A system in accordance with claim 15, wherein said at least one larger pattern is used to determine said at least three degrees of freedom of said camera when said camera is relatively far from said optically modulated target, and wherein said at least one smaller pattern is used to determine said at least three degrees of freedom of said camera when said camera is relatively close to said optically modulated target.

17. A system in accordance with claim 14, wherein said optically modulated target comprises a plurality of patterns, and wherein sensing any one of said plurality of patterns is sufficient to determine said at least three degrees of freedom of said camera.

18. A system in accordance with claim 17, wherein each pattern of said plurality of patterns is uniquely identifiable.

19. A system in accordance with claim 14, wherein said camera has a field of view of at least about 100 degrees.

20. A system in accordance with claim 14, wherein said optically modulated target comprises a plurality of patterns, said method further comprising combining numeric values determined from at least two patterns of said plurality of patterns to determine said at least three degrees of freedom.

21. A system in accordance with claim 14, further including a plurality of optically modulated targets wherein each target of said plurality of optically modulated targets has a distinct known spatial relationship to said reference frame.

22. A system in accordance with claim 14, wherein said optically modulated target has spatially varying optical transmittance, and wherein at least a portion of light emitted by a light source is transmitted through said optically modulated target to said camera.

23. A system in accordance with claim 14, wherein said optically modulated target has spatially varying optical reflectance, and wherein at least a portion of light emitted by a light source is reflected by said optically modulated target to said camera.

24. The optically modulated target of claim 23, wherein said light source is attached to said camera.

25. The optically modulated target of claim 24, wherein said optically modulated target comprises a retroreflector.

26. A system in accordance with claim 14, wherein said optically modulated target comprises a plurality of light sources disposed in a predetermined spatial arrangement.

27. In a system for determining at least three degrees of freedom of a camera relative to a reference frame, said system including an optically modulated target having a known spatial relationship to said reference frame, said optically modulated target being asymmetric whereby ambiguity in the determination of said at least three degrees of freedom of said camera is substantially eliminated, and wherein said optically modulated target further comprises at least one quadrilateral, an apparatus comprising:

a camera having an optical image forming apparatus for forming an image on an image sensor, said optical image forming apparatus producing a predetermined geometric distortion of a formed image on said image sensor, said formed image on said image sensor including at least a portion of said optically modulated target;

an optical image converting apparatus for converting said formed image on said image sensor to an electrical video signal; and

a digital computer responsive to said electrical video signal, said digital computer determining first coordinates of a first point from said electrical video signal, and second coordinates of a second point, wherein said second coordinates are computed based upon said first coordinates and said predetermined geometric distortion, said digital computer being responsive to said electrical video signal to determine the vertices of said quadrilateral by computing the intersections of adjacent pairs of sides of said quadrilateral, and using said vertices to determine said at least three degrees of freedom.