Industrial vehicle with feature-based localization and navigation
First Claim
1. An industrial vehicle comprising a drive mechanism, a steering mechanism, a vehicle controller, a camera, and a navigation module, wherein:
- the camera is communicatively coupled to the navigation module;
the vehicle controller is responsive to commands from the navigation module;
the drive mechanism and the steering mechanism are responsive to commands from the vehicle controller;
the camera is configured to capture an input image of a warehouse ceiling comprising elongated skylights characterized by different rates of image intensity change along longitudinal and transverse axial directions, and ceiling lights characterized by a circularly symmetric rate of image intensity change; and
the navigation module is configured to distinguish between the ceiling lights and the skylights by executing machine readable instructions tocreate a Gaussian scale space pyramid from the input image of the warehouse ceiling, wherein the Gaussian scale space pyramid comprises a plurality of scale space images,calculate a determinant of Hessian response for each image within the Gaussian scale space pyramid,build a determinant of Hessian response pyramid of the same size and structure as the Gaussian scale space pyramid,calculate a trace of Hessian response for each image within the Gaussian scale space pyramid,build a trace of Hessian response pyramid of the same size and structure as the Gaussian scale space pyramid,utilize the determinant of Hessian response pyramid to identify ceiling light candidates in the input image of the warehouse ceiling,utilize the trace of Hessian response pyramid to identify skylight candidates in the input image of the warehouse ceiling,subject ceiling light candidates to ceiling light candidate feature processing to identify valid ceiling lights in the warehouse,subject skylight candidates to skylight candidate feature processing to identify valid skylights in the warehouse, andsend commands to the vehicle controller to navigate the industrial vehicle through the warehouse based upon valid ceiling light identification, valid skylight identification, or both.
1 Assignment
0 Petitions
Accused Products
Abstract
An industrial vehicle is provided comprising a drive mechanism, a steering mechanism, a vehicle controller, a camera, and a navigation module. The camera is communicatively coupled to the navigation module, the vehicle controller is responsive to commands from the navigation module, and the drive mechanism and the steering mechanism are responsive to commands from the vehicle controller. The camera is configured to capture an input image of a warehouse ceiling comprising elongated skylights characterized by different rates of image intensity change along longitudinal and transverse axial directions, and ceiling lights characterized by a circularly symmetric rate of image intensity change. The navigation module is configured to distinguish between the ceiling lights and the skylights and send commands to the vehicle controller for localization, or to navigate the industrial vehicle through the warehouse based upon valid ceiling light identification, valid skylight identification, or both.
51 Citations
23 Claims
-
1. An industrial vehicle comprising a drive mechanism, a steering mechanism, a vehicle controller, a camera, and a navigation module, wherein:
-
the camera is communicatively coupled to the navigation module; the vehicle controller is responsive to commands from the navigation module; the drive mechanism and the steering mechanism are responsive to commands from the vehicle controller; the camera is configured to capture an input image of a warehouse ceiling comprising elongated skylights characterized by different rates of image intensity change along longitudinal and transverse axial directions, and ceiling lights characterized by a circularly symmetric rate of image intensity change; and the navigation module is configured to distinguish between the ceiling lights and the skylights by executing machine readable instructions to create a Gaussian scale space pyramid from the input image of the warehouse ceiling, wherein the Gaussian scale space pyramid comprises a plurality of scale space images, calculate a determinant of Hessian response for each image within the Gaussian scale space pyramid, build a determinant of Hessian response pyramid of the same size and structure as the Gaussian scale space pyramid, calculate a trace of Hessian response for each image within the Gaussian scale space pyramid, build a trace of Hessian response pyramid of the same size and structure as the Gaussian scale space pyramid, utilize the determinant of Hessian response pyramid to identify ceiling light candidates in the input image of the warehouse ceiling, utilize the trace of Hessian response pyramid to identify skylight candidates in the input image of the warehouse ceiling, subject ceiling light candidates to ceiling light candidate feature processing to identify valid ceiling lights in the warehouse, subject skylight candidates to skylight candidate feature processing to identify valid skylights in the warehouse, and send commands to the vehicle controller to navigate the industrial vehicle through the warehouse based upon valid ceiling light identification, valid skylight identification, or both. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22)
-
-
23. An industrial vehicle comprising a drive mechanism, a steering mechanism, a vehicle controller, a camera, and a navigation module, wherein:
-
the camera is communicatively coupled to the navigation module; the vehicle controller is responsive to commands from the navigation module; the drive mechanism and the steering mechanism are responsive to commands from the vehicle controller; the camera is configured to capture an input image of a warehouse ceiling comprising elongated skylights characterized by different rates of image intensity change along longitudinal and transverse axial directions, and ceiling lights characterized by a circularly symmetric rate of image intensity change; and the navigation module is configured to distinguish between the ceiling lights and the skylights by executing machine readable instructions to create a Gaussian scale space pyramid from the input image of the warehouse ceiling, wherein the Gaussian scale space pyramid comprises a plurality of scale space images, calculate a determinant of Hessian response for each image within the Gaussian scale space pyramid, build a determinant of Hessian response pyramid of the same size and structure as the Gaussian scale space pyramid, calculate a trace of Hessian response for each image within the Gaussian scale space pyramid, build a trace of Hessian response pyramid of the same size and structure as the Gaussian scale space pyramid, utilize the determinant of Hessian response pyramid to identify ceiling light candidates in the input image of the warehouse ceiling, utilize the trace of Hessian response pyramid to identify skylight candidates in the input image of the warehouse ceiling, subject ceiling light candidates to ceiling light candidate feature processing to identify valid ceiling lights in the warehouse, subject skylight candidates to skylight candidate feature processing to identify valid skylights in the warehouse, and localize the industrial vehicle in the warehouse based upon valid ceiling light identification, valid skylight identification, or both.
-
Specification