Hybrid image processing system for a single field of view having a plurality of inspection threads

• US 8,462,369 B2
• Filed: 06/25/2007
• Issued: 06/11/2013
• Est. Priority Date: 04/23/2007
• Status: Expired due to Fees

• Current Assignee: Kyndryl Incorporated
• Original Assignee: International Business Machines Corporation
• Inventors: Doi, Munehiro, Kim, Moon J., Mori, Yumi, Moulic, James R., Nakano, Hiroki
• Primary Examiner(s): Yang, Qian
• Application Number:
  US11/767,728
• Publication Number:
  US 20080259086A1
• Time in Patent Office: 2,178 Days
• Field of Search: 358/1.15, 358/1.13, 345/502
• US Class Current: 358/1.15
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining

Abstract

The present invention provides a hybrid image processing system, which generally includes an image processing unit for receiving image data corresponding to a set of images, generating commands for processing the image data, and sending the images and the commands to an image processing unit of the hybrid image processing system. Upon receipt, the image processing unit will recognize and interpret the commands, assign and/or schedule tasks for processing the image data to a set of (e.g., special) processing engines based on the commands, and return results and/or processed image data to the image interface unit.

Claims

1. A hybrid image processing system, comprising:

an image interface unit being configured to;

receive a plurality of images from a plurality of cameras for a single field of view of a same object and generate commands for processing of the images, wherein each image is at a same time and a different area of the same object; and

an image processing unit being configured to;

receive the plurality of images and the commands from the image interface unit,

assign the commands to process the plurality of images, and

distribute the processing of the plurality of images among a plurality of special purpose processing engines (SPEs), wherein the plurality of special purpose processing engines configured to;

receive an off-load of at least one library function at a run time, wherein the at least one library function is written for the plurality of SPEs, wherein the at least one library function supports the processing of the plurality of images, and wherein the at least one library function is one of a plurality of algorithms, an optimization for a processor architecture, and a wrapper for a scripting language,

process the plurality of images based on the commands, wherein the single field of view has a plurality of inspection threads, and wherein each inspection thread runs an algorithm that is different from the algorithm of any other inspection thread, and

send the processed plurality of images to the image interface unit.

2. The hybrid image processing system of claim 1, the image interface unit being further configured to generate the commands based upon an image processing command library and send the commands to the image processing unit to distribute image processing tasks among the plurality of processing engines.

3. The hybrid image processing system of claim 1, the image interface unit and the image processing unit being coupled via a communications switch.

4. The hybrid image processing system of claim 1, the image interface unit comprising a set of servers, each of the set of servers comprising:

a set of image grabbers being configured to receive image data from the plurality of cameras;

a set of communications cards; and

a set of high density drives (HDDs) for storing the plurality of images collected from the plurality of cameras.

5. The hybrid image processing system of claim 4, the image processing unit comprising a set of processors, each of the set of processors comprising a communications card.

6. The hybrid image processing system of claim 5, further comprising:

a Gigabit Ethernet (GbE) switch coupled to the image processing unit; and

a network file system coupled to the GbE switch.

7. The hybrid image processing system of claim 6, the network file system comprising a server having a HDD.

8. The hybrid image processing system of claim 1, the image interface unit and the image processing unit being embodied within an image co-processor, the image co-processor communicating with a control processor.

9. A hybrid image processing system, comprising:

an image interface unit configured for;

receiving a plurality of images for a single field of view of a same object, wherein each image is at a same time and a different area of the same object,

generating commands for processing of the plurality of images,

sending the plurality of images and the commands for processing the plurality of images, and

receiving processed plurality of images, the image interface unit comprising a client application, an image grabber library, a first communications library, and an image processing command library; and

an image processing unit configured for;

receiving the plurality of images and the commands from the image interface unit,

distributing the plurality of images among a plurality of special purpose processing engines (SPEs) based on the commands,

receiving an off-load of at least one library function at a run time, wherein the at least one library function is written for the plurality of SPEs, wherein the at least one library function supports the processing of the plurality of images, and wherein the at least one library function is one of a plurality of algorithms, an optimization for a processor architecture, and a wrapper for a scripting language,

assigning the commands to process the plurality of images to the plurality of special purpose,

processing the plurality of images based on the commands, wherein the single field of view has a plurality of inspection threads, and wherein each inspection thread runs an algorithm that is different from the algorithm of any other inspection thread, and

sending the processed plurality of images to the image interface unit, the image processing unit comprising a cell application, a command dispatcher, an image processing library, a software developer kit library, and a second communications library.

10. The hybrid image processing system of claim 9, the cell application processing the plurality of images based on the commands received from the client application, commands being generated using the image processing command library.

11. The hybrid image processing system of claim 9, the image interface unit further comprising:

a set of offload stubs;

a communications card, the set of offload stubs and the communications card being used by the client application to send the plurality of images to the cell application and to receive the processed plurality of images from the cell application; and

an image grabber card, the image grabber card being used by the client application to receive the plurality of images from a plurality of cameras.

12. The hybrid image processing system of claim 9, the command dispatcher recognizing the commands, and distributing tasks for processing the plurality of images to the plurality of special purpose processing engines.

13. The hybrid image processing system of claim 9, the commands and plurality of images being sent from the client application to the cell application using the first communication library, the second communications library and a set of communications cards.

14. The hybrid image processing system of claim 9, the image interface unit and the image processing unit each further comprising an operating system, firmware and a processor.

15. The system of claim 9, the image interface unit and the image processing unit being implemented as a co-processor.

16. A method for processing images, comprising:

receiving a plurality of images on an image interface unit from a plurality of cameras for a single field of view of a same object, wherein each image is at a same time and a different area of the same object;

generating commands for processing of the plurality of images;

sending the plurality of images and the commands for processing the plurality of images;

receiving the plurality of images and commands on an image processing unit;

assigning the commands to process the plurality of images;

distributing the processing the plurality of images based on the commands among a plurality of special purpose processing engines (SPEs);

receiving an off-load of at least one library function at a run time, wherein the at least one library function is written for the plurality of SPEs, wherein the at least one library function supports the processing of the plurality of images, and wherein the at least one library function is one of a plurality of algorithms, an optimization for a processor architecture, and a wrapper for a scripting language,

processing the plurality of images on the image processing unit based on the commands, wherein the single field of view has a plurality of inspection threads, and wherein each inspection thread runs an algorithm that is different from the algorithm of any other inspection thread; and

sending the processed plurality of images from the image processing unit to the image interface unit.

17. The method of claim 16, further comprising generating the commands on the image interface unit using an image processing command library.

18. The method of claim 16, further comprising:

interpreting the commands on the image processing unit; and

scheduling tasks for processing the plurality of images on the image processing unit.

19. The method of claim 16, the sending and the returning occurring via communication libraries accessed by the image interface unit and the image processing unit.

20. The method of claim 16, the receiving occurring via a set of image grabbers of the image interface unit.

21. A method for processing images, comprising:

receiving a plurality of images on an image interface unit for a single field of view of a same object, wherein each image is at a same time and a different area of the same object;

generating commands using an image processing command library for the processing of the plurality of images;

interpreting the commands on an image processing unit;

assigning tasks to and distributing tasks among a plurality of special purpose processing engines (SPEs) to process the plurality of images based on the commands;

receiving an off-load of at least one library function at a run time, wherein the at least one library function is written for the plurality of SPEs, wherein the at least one library function supports the processing of the plurality of images, and wherein the at least one library function is one of a plurality of algorithms, an optimization for a processor architecture, and a wrapper for a scripting language; and

processing the plurality of images in response to the tasks, wherein the single field of view has a plurality of inspection threads, and wherein each inspection thread runs an algorithm that is different from the algorithm of any other inspection thread.

22. A program product stored on at least one non-transitory computer readable medium for processing images, the at least one non-transitory computer readable medium comprising program code for causing at least one computer system to:

receive a plurality of images from a plurality of cameras for a single field of view of a same object, wherein each image is at a same time and a different area of the same object;

generate commands for processing of the plurality of images;

interpret the commands;

assign tasks to and distribute tasks among a plurality of special purpose processing engines (SPEs) based on the commands to process the plurality of images;

receive an off-load of at least one library function at a run time, wherein the at least one library function is written for the plurality of SPEs, wherein the at least one library function supports the processing of the plurality of images, and wherein the at least one library function is one of a plurality of algorithms, an optimization for a processor architecture, and a wrapper for a scripting language; and

process the plurality of images in response to the tasks, wherein the single field of view has a plurality of inspection threads, and wherein each inspection thread runs an algorithm that is different from the algorithm of any other inspection thread.

23. The program product of claim 22, the at least one non-transitory computer readable medium further comprising program code for causing at least one computer system to send processed plurality of images.

24. The program product of claim 22, the commands being generated using an image processing command library.

25. The program product of claim 22, the plurality of images being received by a set of image grabbers.

26. A method for deploying a system for processing images, comprising:

providing a computer infrastructure being operable to;

receive a plurality of images from a plurality of cameras for a single field of view of a same object, wherein each image is at a same time and a different area of the same object;

generate commands for processing of the plurality of images;

interpret the commands;

assign tasks to and distribute tasks among a plurality of special purpose processing engines (SPEs) based on the commands to process the plurality of images;

receive an off-load of at least one library function at a run time, wherein the at least one library function is written for the plurality of SPEs, wherein the at least one library function supports the processing of the plurality of images, and wherein the at least one library function is one of a plurality of algorithms, an optimization for a processor architecture, and a wrapper for a scripting language; and

process the plurality of images in response to the tasks, wherein the single field of view has a plurality of inspection threads, and wherein each inspection thread runs an algorithm that is different from the algorithm of any other inspection thread.