IMAGING BASED STABILIZATION

• US 20120249774A1
• Filed: 04/04/2011
• Published: 10/04/2012
• Est. Priority Date: 04/04/2011
• Status: Active Grant

• Current Assignee: Flir Detection, Inc. (Teledyne Technologies Incorporated)
• Original Assignee: CyPhy Works, Inc.
• Inventors: Johnson, Samuel A., Shein, Andrew, Greiner, Helen
• Granted Patent: US 8,736,676 B2
• Time in Patent Office: Days
• US Class Current: 348/113
• CPC Class Codes: B64C 1/00 Fuselages; Constructional features common to fuselages, wings, stabilising surfaces or the like
• CPC Class Codes: G01C 21/20 Instruments for performing navigational calculations G01C21/24, G01C21/26 take precedence
• CPC Class Codes: G06T 2207/30244 Camera pose
• CPC Class Codes: G06T 2207/30252 Vehicle exterior; Vicinity of vehicle
• CPC Class Codes: G06T 7/75 involving models

Abstract

An image-based sensor system for a mobile unit makes use of light emitters and imagers to acquire illumination patterns of emitted light impinging on the floor and/or walls surrounding the unit. The illumination pattern is used to estimate location and/or orientation of the unit. These estimates are used for one or more functions of stabilization, calibration, localization, and mapping of or with respect to the unit.

Claims

1. An apparatus comprising mobile part, the mobile part comprising:

a first light emitter for forming a first light emission comprising a plurality of emitted rays on a cone or cylinder that is symmetrical about a central axis of the mobile part; and

a first imager for acquiring images from a point of view along the central axis showing an illumination pattern at intersections of the emitted rays and a first surface upon which the first light emission impinges;

wherein the apparatus further includes a first estimator for processing the acquired images and using the acquired images to determine at least one of (a) an orientation of the central axis of the apparatus with respect to the first surface, and (b) a distance from the surface along the central axis.

2. The apparatus of claim 1 wherein the mobile part comprises an aerial vehicle, and wherein the apparatus further comprises a module configured to be responsive to the determined orientation and/or distance to perform at least one function from a group of functions consisting of stabilization, calibration, localization, and mapping.

3. The apparatus of claim 2 wherein the module responsive to the determined orientation and/or distance comprises a control system configured to generate control signals for flight controls of the aerial vehicle.

4. The apparatus of claim 3 wherein the control system is configured to be responsive to the determined orientation to stabilize an orientation of the vehicle.

5. The apparatus of claim 3 wherein the control system is configured to be responsive to the determined distance to stabilize an altitude of the vehicle above the surface.

6. The apparatus of claim 1 wherein the first light emitter comprises a plurality of optical elements disposed at a fixed radius perpendicular from a point on the central axis.

7. The apparatus of claim 6 wherein the plurality of optical elements comprise a plurality of laser light sources.

8. The apparatus of claim 6 wherein the plurality of optical elements comprise a plurality reflectors, and the first light emitter further comprises a laser light source configured to reflect rays off the plurality of reflectors to form the first light emission.

9. The apparatus of claim 1 wherein the estimator is configured to determine the orientation according to an eccentricity of the illumination pattern.

10. The apparatus of claim 1 wherein the estimator is configured to determine the distance according to a size of the illumination pattern.

11. The apparatus of claim 1 wherein the first light emitter comprises a reflector configured to rotate about the central axis, and a laser light source configured to reflect a ray off the rotating mirror to form the rays on the cone that is symmetrical about the central axis.

12. The apparatus of claim 11 wherein the mobile part comprises an aerial vehicle having a propeller assembly configured to rotate about the central axis to provide lift for the aerial vehicle, and wherein the reflector is coupled to the propeller assembly to rotate with the rotation of the propeller assembly.

13. The apparatus of claim 1 wherein the mobile part further comprises:

a second light emitter for forming a second light emission comprising a plurality of emitted rays from the central axis of the mobile part; and

a second imager for acquiring images showing an illumination pattern at intersections of the emitted rays of the second light emission and one or more second surfaces upon which the second light emission impinges;

wherein the apparatus comprises a second estimator for processing the acquired images for the second imager and using the acquired images to determine a location of the mobile part relative to the one or more second surfaces.

14. The apparatus of claim 13 wherein the rays of the second emission are on a plane that is perpendicular to the central axis of the mobile part.

15. The apparatus of claim 14 wherein the second imager acquires images from one or more points of view that are displaced in the direction of the central axis from the plane of the rays of the second light emission.

16. The apparatus of claim 15 wherein the estimator is configured to determine the location relative to the surface according to a displacement of the displacement in the images acquired by the second imager of the illumination pattern in a direction corresponding to the central axis.

17. The apparatus of claim 13 wherein the second imager comprises a plurality of imagers disposed about the periphery of the mobile part, and wherein the second imager is configured to combine the images of the plurality of imagers to form an imaging including all directions extending from the central axis.

18. The apparatus of claim 13 wherein the second estimator is configured to be responsive to the location to perform at least one function from a group of functions consisting of stabilization, calibration, localization, and mapping.

19. The method of claim 1 wherein the first estimator is implemented in the mobile part of the apparatus.

20. The method of claim 1 wherein the mobile part comprises an aerial vehicle that is tethered to a control station, and wherein the first estimator is implemented at least in part at the control station.

21. A method for calibrating a image-guided apparatus, comprising:

placing the apparatus in a calibration unit, the calibration unit having a substantially cylindrical inner surface, the apparatus being placed to align a central axis of the apparatus with the central axis of the cylinder;

emitting a light emission from a light emitter affixed to the apparatus, the light emission comprising rays in a symmetrical pattern about the central axis, the rays impinging on the inner surface of the cylinder;

acquiring images from an imager affixed to the apparatus, the images showing an illumination pattern at intersections of the emitted rays and the inner surface of the cylinder; and

calibrating an estimator of the apparatus according to known dimensions of the calibration unit and the illumination pattern.