High volume earth observation image processing

• US 8,768,104 B2
• Filed: 01/07/2009
• Issued: 07/01/2014
• Est. Priority Date: 01/08/2008
• Status: Active Grant

• Current Assignee: PCI Geomatics Enterprises, Inc. (PCI Geomatics Group Incorporated)
• Original Assignee: PCI Geomatics Enterprises, Inc. (PCI Geomatics Group Incorporated)
• Inventors: Moses, Robert, Stanley, David, Burry, Louis, Pollock, Richard
• Primary Examiner(s): ENTEZARI, MICHELLE M
• Application Number:
  US12/349,959
• Publication Number:
  US 20090232349A1
• Time in Patent Office: 2,001 Days
• Field of Search: None
• US Class Current: 382/305
• CPC Class Codes: G06F 9/5072 Grid computing
• CPC Class Codes: G06T 2207/10032 Satellite or aerial image; Remote sensing
• CPC Class Codes: G06T 2207/30181 Earth observation
• CPC Class Codes: G06T 5/80 Geometric correction
• CPC Class Codes: G06T 7/33 using feature-based methods
• CPC Class Codes: G06T 7/35 using statistical methods

Abstract

The present invention is related to the processing of data, and more particularly to a method of and system for processing large volumes of Earth observation imagery data. A system for processing a large volume of Earth observation imaging data is described, comprising a computer including a visual display and a user interface, a plurality of servers, an image database storing said Earth observation imaging data as a plurality of separate image data files, and a network for interconnecting the computer, plurality of servers and image database. The plurality of servers is operable to process the separate data files in a distributed manner, at least one of the plurality of servers is operable to process the separate data files in a multiprocessing environment and at least one of the plurality of servers is operable to collate the processed separate data files into a single imaging result.

Claims

1. A system for processing a large volume of Earth observation imaging data comprising:

a computer including a visual display and a user interface;

a plurality of compute servers;

an image database storing said Earth observation imaging data as a plurality of separate image data files;

a network for interconnecting said computer, said plurality of compute servers and said image database;

said plurality of compute servers being operable to process said separate image data files in a distributed manner using different classification methods;

at least one of said plurality of compute servers being operable to process said separate image data files in a multiprocessing environment;

at least one of said plurality of compute servers being operable to collate processed separate image data files into a single imaging result; and

is operable to execute a voting scheme to select the output of one of said different classification methods as an optimal result;

further comprising a central job database for storing a list of jobs to be performed, said jobs defining said processing to be performed, and said plurality of compute servers being operable to request jobs from said list;

wherein each of said separate image data files includes Ground Control Points, and said processing is performed using said Ground Control Points to correct to ground co-ordinates; and

wherein each of said separate image data files includes Tie-Points, and said processing is performed using said Tie-Points, to minimize errors between overlapping images.

2. The system of claim 1, wherein said central job database is further operable to store job status, history data and metadata, said plurality of compute servers being operable to send job status, history data and metadata to said central job database.

3. The system of claim 2, wherein said central job database comprises a relational database.

4. The system of claim 1, wherein said plurality of compute servers are operable to request jobs from said list when they have capacity.

5. The system of claim 4, wherein said plurality of compute servers are operable to request jobs from said list during specified times.

6. The system of claim 4, wherein each of said plurality of compute servers includes a configuration file specifying the number of jobs which may be run.

7. The system of claim 1, wherein said jobs comprise scripts.

8. The system of claim 7, wherein said scripts call stored processing modules having a standard application programming interface (API).

9. The system of claim 8, further comprising an interface generator operable to translate the API and documentation to the particulars and syntax of a desired scripting language, allowing processing modules to be called from scripts written in different languages.

10. The system of claim 8, wherein said processing modules are operable to receive input data from local files, databases, memory objects or Web services.

11. The system of claim 1, wherein said network includes a local area network (LAN) and at least one of said plurality of compute servers is accessible via said LAN.

12. The system of claim 1, wherein said network includes an Internet network and at least one of said plurality of compute servers is accessible via the Internet.

13. The system of claim 1, wherein at least one of said plurality of compute servers is operable to process said separate image data files using specialized internal hardware.

14. The system of claim 13, wherein said specialized internal hardware is selected from the group consisting of multiple CPUs, one or more Graphical Processing Units and a Cell processor.

15. The system of claim 13, wherein at least one of said plurality of compute servers is operable to process said separate image data files using symmetric multi-processing (SMP).

16. The system of claim 1, wherein said image database comprises a parallel virtual file system (PVFS).

35. The system of claim 1, wherein said voting scheme comprises selecting a most common output as the optimal result.

36. The system of claim 35, wherein said different classification methods are selected from the group consisting of maximum likelihood classification, neural networks, minimum distance, KNN and K-means.

17. A method for processing a large volume of Earth observation imaging data comprising the steps of:

storing said Earth observation imaging data as a plurality of separate image data files on an image database;

storing a list of jobs to be performed, on a central job database, said jobs defining processing to be performed;

processing said separate image data files in a distributed manner on a plurality of compute servers, using different classification methods, said plurality of compute servers and said image database interconnected by a network;

said processing including processing using Ground Control Points to correct to ground co-ordinates, and processing using Tie-Points, to minimize errors between overlapping images;

at least one of said plurality of compute servers requesting a job from said list of jobs and processing said separate image data files using multiprocessing;

collating said processed separate image data files into a single imaging result on one of said plurality of compute servers, executing a voting scheme to select the output of one of said different classification methods as an optimal result; and

interfacing with said single imaging result via a computer including a visual display and a user interface.

18. The method of claim 17, further comprising the steps of:

said plurality of compute servers sending job status, history data and metadata to said central job database; and

said central job database storing received job status, history data and metadata.

19. The method of claim 18, wherein said central job database comprises a relational database.

20. The method of claim 18, wherein said step of said plurality of compute servers requesting jobs from said list comprises the step of said plurality of compute servers requesting jobs from said list when they have capacity.

21. The method of claim 20, wherein said step of said plurality of compute servers requesting jobs from said list comprises the step of said plurality of compute servers requesting jobs from said list during specified times.

22. The method of claim 20, further comprising the step of said plurality of compute servers referring to a configuration file specifying the number of jobs which may be run, in determining whether they have capacity.

23. The method of claim 17, wherein said jobs comprise scripts.

24. The method of claim 23, further comprising the step of said scripts calling stored processing modules having a standard application programming interface (API).

25. The method of claim 24, further comprising the step of an interface generator operable translating the API and documentation to the particulars and syntax of a desired scripting language, allowing processing modules to be called from scripts written in different languages.

26. The method of claim 24, further comprising the step of said processing modules obtaining input data from local files, databases, memory objects or Web services.

27. The method of claim 17, wherein said network includes a local area network (LAN) and at least one of said plurality of compute servers is accessible via said LAN.

28. The method of claim 17, wherein said network includes an Internet network and at least one of said plurality of compute servers is accessible via the Internet.

29. The method of claim 17, further comprising the step of at least one of said plurality of compute servers processing said separate data files using specialized internal hardware.

30. The method of claim 28, wherein said specialized internal hardware comprises at least one device selected from the group consisting of multiple CPUs, one or more Graphical Processing Units, and a Cell processor.

31. The method of claim 28, wherein said step of processing said separate data files using multiprocessing, comprises the step of processing using symmetric multiple processing (SMP).

32. The method of claim 17, wherein said image database comprises a parallel virtual file system (PVFS).

33. The method of claim 17, wherein said voting scheme comprises selecting a most common output as the optimal result.

34. The method of claim 17, wherein said step of performing a different classification method comprises performing a classification method selected from the group consisting of maximum likelihood classification, neural networks, minimum distance, KNN and K-means.