VEHICLE LOCALIZATION IN OPEN-PIT MINING USING GPS AND MONOCULAR CAMERA
First Claim
1. A method for vehicle localization in an open pit mining environment, comprising:
- providing a camera calibrated in a fixed coordinate system with a field of view encompassing a region of vehicle operation in the mining environment;
analysing at least one picture frame from the camera using a vehicle recognition algorithm to determine the presence of a vehicle in the camera field of view;
analysing a sequence of picture frames from the camera using a vehicle tracking algorithm to determine an image position of the vehicle within the region of vehicle operation;
ascertaining at least one independent measure of the vehicle location within the region of vehicle operation relative to the fixed coordinate system; and
providing an output of vehicle localization over time using the image position of the vehicle and the at least one independent vehicle location measurement.
1 Assignment
0 Petitions
Accused Products
Abstract
Described herein is a method and system for vehicle localization in an open pit mining environment having intermittent or incomplete GPS coverage. The system comprises GPS receivers associated with the vehicles and providing GPS measurements when available, as well as one or more cameras 50,55 overlooking the mine region 10. The cameras 50,55 are at a known location and are used for generating a sequence of images in a field of view with predetermined calibration in a fixed coordinate system. The system further comprises a vehicle recognition processor 120 for analysing individual images from the camera to identify and locate within an image a vehicle in the mine region, as well as a vehicle tracking processor 130 for analysing a sequence of images from the camera to track the identified vehicle location in the sequence of images. A data fusion processor 160 is coupled to receive GPS measurements, when available, from the vehicle GPS receivers, to fuse the received GPS measurement and corresponding vehicle image location, and to output a vehicle localization output 125.
-
Citations
13 Claims
-
1. A method for vehicle localization in an open pit mining environment, comprising:
-
providing a camera calibrated in a fixed coordinate system with a field of view encompassing a region of vehicle operation in the mining environment; analysing at least one picture frame from the camera using a vehicle recognition algorithm to determine the presence of a vehicle in the camera field of view; analysing a sequence of picture frames from the camera using a vehicle tracking algorithm to determine an image position of the vehicle within the region of vehicle operation; ascertaining at least one independent measure of the vehicle location within the region of vehicle operation relative to the fixed coordinate system; and providing an output of vehicle localization over time using the image position of the vehicle and the at least one independent vehicle location measurement. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A method for continuous vehicle localization in an open pit mining environment in which vehicles carrying GPS receivers operate in a region of intermittent or incomplete GPS coverage, comprising:
-
generating digital images with a field of view overlooking the mine region from a fixed location as vehicles move about the mine; processing the digital images by analysing the image data to identify the presence and location of a vehicle in an image; and fusing the identified image location of the vehicle with a measurement from the corresponding vehicle GPS receiver to provide continuous vehicle localization data.
-
-
10. A system for localization of vehicles in an open pit mining environment having intermittent or incomplete GPS coverage, comprising:
-
GPS receivers associated with the vehicles and providing GPS measurements when available; a camera overlooking the mine region from a known location for generating a sequence of images in a field of view with predetermined calibration in a fixed coordinate system; a vehicle recognition processor for analysing individual images from the camera to identify and locate within an image a vehicle in the mine region; a vehicle tracking processor for analysing a sequence of images from the camera to track the identified vehicle location in the sequence of images; and a data fusion processor coupled to receive GPS measurements, when available, from the vehicle GPS receivers, to fuse the received GPS measurement and corresponding vehicle image location, and to output a vehicle localization output. - View Dependent Claims (11, 12, 13)
-
Specification