Vehicle positioning or navigation utilizing associated feature pairs
First Claim
1. A materials handling vehicle comprising a camera, one or more vehicular processors, a drive mechanism configured to move the materials handling vehicle along an inventory transit surface, a materials handling mechanism configured to store and retrieve goods in a storage bay of an industrial facility, and vehicle control architecture in communication with the drive and materials handling mechanisms, wherein:
- the camera is communicatively coupled to the one or more vehicular processors and captures an input image of overhead features;
an industrial facility map comprises a plurality of three-dimensional global feature points associated with a mapping of the overhead features; and
the one or more vehicular processors of the materials handling vehicle execute vehicle functions to;
(i) create a plurality of associated feature pairs by retrieving a set of camera data from the camera comprising two-dimensional UV space information, forming pairs from the UV space information, and mapping pairs from the UV space information with pairs from the plurality of three-dimensional global feature points of the industrial facility map;
(ii) calculate respective vehicle poses for associated feature pairs within a visual range of the camera;
(iii) determine a smallest pose sum error by comparing a plurality of pose sum errors of the plurality of associated feature pairs;
(iv) calculate a best estimate pose of the materials handling vehicle based on a highest-ranked pair of the plurality of associated feature pairs, wherein the highest-ranked pair comprises the smallest pose sum error of the plurality of associated feature pairs; and
(v) navigate the materials handling vehicle utilizing the best estimate pose.
2 Assignments
0 Petitions
Accused Products
Abstract
A method for vehicle positioning or navigation utilizing associated feature pairs may include creating a plurality of associated feature pairs by retrieving an initial set of camera data from the camera comprising two-dimensional UV space information, forming pairs from the UV space information, and associating each pair from the UV space information with pairs from each of the plurality of three-dimensional global feature points of the industrial facility map, calculating a best estimate poses from calculated vehicle poses of the associated feature pairs, using an accumulated odometry to update the best estimate pose to a current localized position and setting a seed position as the current localized position. The navigation of the materials handling vehicle is tracked and/or navigated along the inventory transit surface navigate in at least a partially automated manner utilizing the current localized position.
37 Citations
20 Claims
-
1. A materials handling vehicle comprising a camera, one or more vehicular processors, a drive mechanism configured to move the materials handling vehicle along an inventory transit surface, a materials handling mechanism configured to store and retrieve goods in a storage bay of an industrial facility, and vehicle control architecture in communication with the drive and materials handling mechanisms, wherein:
-
the camera is communicatively coupled to the one or more vehicular processors and captures an input image of overhead features; an industrial facility map comprises a plurality of three-dimensional global feature points associated with a mapping of the overhead features; and the one or more vehicular processors of the materials handling vehicle execute vehicle functions to; (i) create a plurality of associated feature pairs by retrieving a set of camera data from the camera comprising two-dimensional UV space information, forming pairs from the UV space information, and mapping pairs from the UV space information with pairs from the plurality of three-dimensional global feature points of the industrial facility map; (ii) calculate respective vehicle poses for associated feature pairs within a visual range of the camera; (iii) determine a smallest pose sum error by comparing a plurality of pose sum errors of the plurality of associated feature pairs; (iv) calculate a best estimate pose of the materials handling vehicle based on a highest-ranked pair of the plurality of associated feature pairs, wherein the highest-ranked pair comprises the smallest pose sum error of the plurality of associated feature pairs; and (v) navigate the materials handling vehicle utilizing the best estimate pose. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A system comprising a materials handling vehicle and a management server, wherein:
-
the materials handling vehicle comprises a camera, one or more vehicular processors, a drive mechanism configured to move the materials handling vehicle along an inventory transit surface, a materials handling mechanism configured to store and retrieve goods in a storage hay of an industrial facility, and vehicle control architecture in communication with the drive and materials handling mechanisms; the camera is communicatively coupled to the one or more vehicular processors and the management server and captures an input image of overhead features; the one or more vehicular processors are communicatively coupled to the management server; an industrial facility map stored on the management server is communicatively coupled to the one or more vehicular processors, wherein the industrial facility map comprises a plurality of three-dimensional global feature points associated with a mapping of the overhead features; and the one or more vehicular processors of the materials handling vehicle executes vehicle functions to; (i) create a plurality of associated feature pairs by retrieving a set of camera data from the camera comprising two-dimensional UV space information, forming pairs from the UV space information, and mapping pairs from the UV space information with pairs from the plurality of three-dimensional global feature points of the industrial facility map; (ii) calculate respective vehicle poses for associated feature pairs within a visual range of the camera; (iii) determine a smallest pose sum error by comparing a plurality of pose sum errors of the plurality of associated feature pairs; (iv) calculate a best estimate pose of the materials handling vehicle from the calculated vehicle poses based on a highest-ranked pair of the plurality of associated feature pairs, wherein the highest-ranked pair comprises the smallest pose sum error of the plurality of associated feature pairs; and (v) navigate the materials handling vehicle utilizing the best estimate pose. - View Dependent Claims (10, 11, 12, 13, 14)
-
-
15. A method of navigating or tracking a navigation of a materials handling vehicle along an inventory transit surface, the method comprising:
-
disposing a materials handling vehicle upon an inventory transit surface of an industrial facility, wherein the materials handling vehicle is in communication with a management server, wherein the materials handling vehicle comprises a camera, one or more vehicular processors, a drive mechanism configured to move the materials handling vehicle along the inventory transit surface, a materials handling mechanism configured to store and retrieve goods in a storage bay of the industrial facility, and vehicle control architecture in communication with the drive and materials handling mechanisms; utilizing the drive mechanism to move the materials handling vehicle along the inventory transit surface; capturing an input image of overhead features of the industrial facility via the camera as the materials handling vehicle moves along the inventory transit surface; providing an industrial facility map comprising a plurality of three-dimensional global feature points associated with a mapping of the overhead features; creating a plurality of associated feature pairs by retrieving a set of camera data from the camera comprising two-dimensional UV space information, forming pairs from the UV space information, and mapping pairs from the UV space information with pairs from the plurality of three-dimensional global feature points of the industrial facility map; via the one or more vehicular processors, calculating respective vehicle poses for associated feature pairs within a visual range of the camera; via the one or more vehicular processors, determining a smallest pose sum error by comparing a plurality of pose sum errors of the plurality of associated feature pairs; via the one or more vehicular processors, calculating a best estimate pose of the materials handling vehicle from the calculated vehicle poses based on a highest-ranked pair of the plurality of associated feature pairs, wherein the highest-ranked pair comprises the smallest pose sum error of the plurality of associated feature pairs; and navigating the materials handling vehicle along the inventory transit surface utilizing the best estimate pose. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification