Digital image capture and processing system employing multi-layer software-based system architecture permitting modification and/or extension of system features and functions by way of third party code plug-ins

• US 7,708,205 B2
• Filed: 12/18/2006
• Issued: 05/04/2010
• Est. Priority Date: 11/13/2003
• Status: Expired due to Fees

• Current Assignee: Metrologic Instruments Incorporated (Honeywell International Inc.)
• Original Assignee: Metrologic Instruments Incorporated (Honeywell International Inc.)
• Inventors: Zhu, Xiaoxun, Kotlarsky, Anatoly
• Primary Examiner(s): Kim; Ahshik
• Application Number:
  US11/640,814
• Publication Number:
  US 20070215706A1
• Time in Patent Office: 1,233 Days
• Field of Search: 235/462.24, 235/462.15, 235/462.25, 235/462.42, 235/462.22
• US Class Current: 235/462.24
• CPC Class Codes: G06F 9/44526 Plug-ins; Add-ons
• CPC Class Codes: G06K 2207/1012 Special detection of object
• CPC Class Codes: G06K 7/10712 Fixed beam scanning
• CPC Class Codes: G06K 7/10722 Photodetector array or CCD scanning
• CPC Class Codes: G06K 7/10732 Light sources
• CPC Class Codes: G06K 7/10821 further details of bar or optical code scanning devices
• CPC Class Codes: G06K 7/10831 Arrangement of optical elements, e.g. lenses, mirrors, prisms optical elements per se G02B
• CPC Class Codes: G06K 7/10851 Circuits for pulse shaping, amplifying, eliminating noise signals, checking the function of the sensing device basic electronic circuitry H03
• CPC Class Codes: G06K 7/10881 constructional details of hand-held scanners
• CPC Class Codes: G06K 7/14 using light without selection of wavelength, e.g. sensing reflected white light G06K7/10831 - G06K7/1097 take precedence
• CPC Class Codes: G06K 7/1413 1D bar codes
• CPC Class Codes: G06K 7/1417 2D bar codes
• CPC Class Codes: G06K 7/1426 Multi-level bar codes
• CPC Class Codes: G06K 7/1443 locating of the code in an image

Abstract

A digital image capture and processing system, and software development environment, that supports manufacturer-constrained system behavior modification and/or extension by end-users and third-parties through the development and installation/deployment of plug-in modules within the application layer of the system by persons other than the original system designers. By virtue of the present invention, the standard features and functionalities of such systems can now be flexibly modified and/or extended by end-users and third-parties (e.g. VARs, OEMs etc), and thus satisfy customized end-user application requirements, without possessing or acquiring detailed knowledge about the hard-ware platform of the system, its communication interfaces with the outside environment, and user-related interfaces.

Claims

1. A digital image capture and processing system designed by one or more original system designers, and having a set of standard features and functions, and a set of custom features and functions that satisfy customized end-user application requirements, said digital image capture and processing system comprising:

a digital camera subsystem for projecting a field of view (FOV) upon an object to be imaged in said FOV, and detecting imaged light reflected off the object during illumination operations in an image capture mode in which one or more digital images of the object are formed and detected by said digital camera subsystem;

a digital image processing subsystem for processing said one or more digital images and (i) producing raw or processed data, or (ii) recognizing or acquiring information graphically represented in said one or more digital images, and producing output data representative of said recognized information;

an input/output subsystem for transmitting said output data, or said raw or processed data, to an external host system or other information receiving or responding device;

a system control subsystem for controlling and/or coordinating the operation of said subsystems above; and

a computing platform for supporting the implementation of one or more of said subsystems above, and the features and functions of said digital image capture and processing system;

said computing platform including (i) memory for storing pieces of original product code written by said one or more original system designers, and (ii) a microprocessor for running one or more applications by calling and executing pieces of said original product code in a particular sequence, so as to support a set of standard features and functions which characterize a standard behavior of said digital image capture and processing system;

wherein said one or more pieces of original product code have a set of place holders into which pieces of third-party product code can be inserted or plugged by third parties, including value-added resellers (VARs), original equipment manufacturers (OEMs), and also end-users of said digital image capture and processing system; and

wherein one or more pieces of third-party code that have been plugged into said set of place holders, operate to extend the features and functions of said digital image capture and processing system, and modify the standard behavior of said digital image capture and processing system into a custom behavior for said digital image capture and processing system.

2. The digital image capture and processing system of claim 1, which further comprises a housing having a light transmission window, wherein said FOV is projected through said light transmission window and upon said object to be imaged in said FOV.

3. The digital image capture and processing system of claim 2, wherein said housing contains said subsystems.

4. The digital image capture and processing system of claim 3, wherein when said pieces of third-party code are plugged into said place holders, the features and functions of said digital image capture and processing system are modified and/or extended, and the standard behavior of said digital image capture and processing system is modified into said custom behavior for said digital image capture and processing system.

5. The digital image capture and processing system of claim 4, wherein said one or more pieces of original product code and said third-party product code are maintained in one or more libraries.

6. The digital image capture and processing system of claim 5, wherein said memory comprises a memory architecture having different kinds of memory, each having a different access speed and performance characteristics.

7. The digital image capture and processing system of claim 1, wherein an end-user, such as a value-added reseller (VAR) or original equipment manufacturer (OEM), can write said one or more pieces of third-party code according to specifications set by said original system designers, and said one or more pieces of third-party code can be plugged into said place holders, so as to extend the features and functions of said digital image capture and processing system, and modify the standard behavior of said digital image capture and processing system into said custom behavior for said digital image capture and processing system, without permanently modifying the standard features and functions of said digital image capture and processing system.

8. The digital image capture and processing system of claim 1, which is integrated or embodied into a third-party product.

9. The digital image capture and processing system of claim 8, wherein said third-party product is selected from the group consisting of image-processing based bar code symbol reading systems, portable data terminals (PDTs), mobile phones, computer mice-type devices, personal computers, keyboards, consumer appliances, automobiles, ATMs, vending machines, reverse-vending machines, retail POS-based transaction systems, 2D or 2D digitizer, and CAT scanning systems, automobile identification systems, package inspection systems, and personal identification systems.

10. The digital image capture and processing system of claim 8, which is selected from the group consisting of image-processing based bar code symbol reading systems, portable data terminals (PDTs), mobile phones, computer mice-type devices, personal computers, keyboards, consumer appliances, automobiles, ATMs, vending machines, reverse-vending machines, retail POS-based transaction systems, 2D or 2D digitizers, and CAT scanning systems, automobile identification systems, package inspection systems, and personal identification systems.

11. The digital image capture and processing system of claim 1, which has the form factor of a digital imaging engine module that can be integrated into a third-party product selected from the group consisting of image-processing based bar code symbol reading systems, portable data terminals (PDTs), mobile phones, computer mice-type devices, personal computers, keyboards, consumer appliances, automobiles, ATMs, vending machines, reverse-vending machines, retail POS-based transaction systems, 2D or 2D digitizers, and CAT scanning systems, automobile identification systems, package inspection systems, and personal identification systems.

12. The digital image capture and processing system of claim 11, which further comprises at least one printed circuit board that can be installed within a housing of a third-party product, along with said digital imaging engine module, and interfaced with said digital imaging engine module, and at least one component within said housing of said third-party product.

13. The digital image capture and processing system of claim 1, wherein said original product code and said third-party code each comprises executable binary code.

14. The digital image capture and processing system of claim 1, wherein said digital camera subsystem comprises:

a digital image formation and detection subsystem having (i) image formation optics for projecting said FOV through a light transmission window and upon said object to be imaged in said FOV, and (ii) an image sensing array for detecting imaged light reflected off the object during illumination operations in said image capture mode in which sensor elements in said image sensing array are enabled so as to detect one or more digital images of the object formed on said image sensing array;

an illumination subsystem having an illumination array for producing and projecting a field of illumination through said light transmission window and within said FOV during the image capture mode; and

an image capturing and buffering subsystem for capturing and buffering said one or more digital images detected by said image formation and detection subsystem.

15. The digital image capture and processing system of claim 1, wherein said memory maintains system parameters used to configure said functions of said digital image capture and processing system.

16. The digital image capture and processing system of claim 1, wherein said computing platform implements said digital image processing subsystem, said input/output subsystem and said system control subsystem.

17. The digital image capture and processing system of claim 1, wherein said memory comprises a memory architecture that supports a three-tier modular software architecture characterized by an Operating System (OS) layer, a System CORE (SCORE) layer, and an application layer and responsive to the generation of a triggering event within said digital-imaging based code symbol reading system.

18. The digital image capture and processing system of claim 17, wherein said OS layer includes one or more software modules selected from the group consisting of an OS kernal module, an OS file system module, and device driver modules;

wherein said SCORE layer includes one or more of software modules selected from the group consisting of a tasks manager module, an events dispatcher module, an input/output manager module, a user commands manager module, the timer subsystem module, an input/output subsystem module and a memory control subsystem module;

wherein said application layer includes one or more software modules selected from the group consisting of a code symbol decoding module, a function programming module, an application events manager module, a user commands table module, and a command handler module.

19. The digital image capture and processing system of claim 18, wherein, prior to capturing one or more digital images of the object, said microprocessor rapidly initializes said computing platform by performing the following operations:

(1) accessing one or more software modules from said OS layer and executing code contained therein;

(2) accessing one or more software modules from said SCORE layer and executing code contained therein; and

(3) accessing one or more software modules from said application layer and executing code contained therein.

20. The digital image capture and processing system of claim 1, wherein said illumination operations comprises narrow-band illumination produced from an array of light emitting diodes (LEDs).

21. The digital image capture and processing system of claim 10, wherein said digital image processing subsystem processes said one or more digital images, so as to read one or more code symbols graphically represented therein, and producing said output data in the form of symbol character data representative of said read one or more code symbols.

22. The digital image capture and processing system of claim 21, wherein each said code symbol is a bar code symbol selected from the group consisting of a 1D bar code symbol, a 2D bar code symbol, and a data matrix type code symbol structure.

23. The digital image capture and processing system of claim 14, wherein said digital camera subsystem further comprises an illumination control subsystem for controlling the operation of said illumination subsystem during said image capture mode.

24. The digital image capture and processing system of claim 17, said computing platform implements said digital image processing subsystem, said input/output subsystem and said system control subsystem, and wherein said application layer includes said one or more libraries and said one or more libraries include one or more software modules selected from the group consisting of a code symbol decoding module, a function programming module, an application events manager module, a user commands table module, and a command handler module.

25. The digital image capture and processing system of claim 1, which further comprises an automatic object detection subsystem for automatically detecting the presence of the object in said FOV, and in response thereto, generating a trigger signal indicative of a triggering event.

26. The digital image capture and processing system of claim 1, which further comprises a trigger manually actuatable by an operator of said digital image capturing and processing system so as to generate a trigger signal indicating a triggering event.

27. The digital image capture and processing system of claim 1, which further comprises an automatic object detection subsystem disposed in said housing, for automatically detecting the presence of the object in said FOV, and in response thereto, generating a trigger signal indicating a triggering event.

28. The digital image capture and processing system of claim 2, wherein said housing is a hand-supportable housing.

29. The digital image capture and processing system of claim 1, wherein said digital image processing subsystem, said input/output subsystem and said system control subsystem are implemented using said computing platform.

30. The digital image capture and processing system of claim 29, wherein said digital camera subsystem is implemented as an electro-optical module.

31. The digital image capture and processing system of claim 30, wherein said computing platform is implemented on a printed circuit (PC) board, and wherein said electro-optical module and said PC board are interfaced and contained in a housing having a light transmission window, through which said FOV is projected.

32. The digital image capture and processing system of claim 1, wherein said digital image processing subsystem, said input/output subsystem and said system control subsystem are implemented using said computing platform, and wherein said digital camera subsystem is implemented on a camera board.

33. The digital image capture and processing system of claim 32, wherein said printed circuit (PC) board and said camera board are electrically interfaced.

34. The digital image capture and processing system of claim 33, wherein said printed circuit (PC) board and said camera board are mounted within a housing having a light transmission window, through which said FOV is projected.

35. The digital image capture and processing system of claim 33, wherein a host computer system, operated by said third-party, can be interfaced with said input/output system so as to load said one or more pieces of third-party code into said memory, and plugged into said set of place holders, so as operate to extend the features and functions of said digital image capture and processing system, and modify the standard behavior of said digital image capture and processing system into said custom behavior for said digital image capture and processing system.

36. The digital image capture and processing system of claim 1, wherein a host computer system, operated by said third-party, can be interfaced with said input/output system so as to load said one or more pieces of third-party code into said memory, and plugged into said set of place holders, so as operate to extend the features and functions of said digital image capture and processing system, and modify the standard behavior of said digital image capture and processing system into said custom behavior for said digital image capture and processing system.

37. The digital image capture and processing system of claim 1, wherein a host computer system, operated by said third-party, can be interfaced with said input/output system so as to load said one or more pieces of third-party code into said memory, and plugged into said set of place holders, so as operate to extend the features and functions of said digital image capture and processing system, and modify the standard behavior of said digital image capture and processing system into said custom behavior for said digital image capture and processing system, without permanently modifying the standard features and functions of said digital image capture and processing system.

38. The digital image capture and processing system of claim 1, wherein said digital camera subsystem comprises an illumination subsystem for illuminating said FOV during said illumination operations.

39. The digital image capture and processing system of claim 38, wherein said illumination subsystem supports functions selected from the group consisting of illumination mode, automatic illumination control, and illumination field type.

40. The digital image capture and processing system of claim 39, wherein said illumination mode includes ambient illumination, continuous LED-based illumination, and strobe or flash based LED illumination.

41. The digital image capture and processing system of claim 39, wherein said automatic illumination control comprises measuring the intensity of light reflected off an illuminated object, in a particular region of said FOV.

42. The digital image capture and processing system of claim 39, wherein said illumination field type includes types of illumination fields selected from the group consisting of narrow-area near-field illumination, wide-area far-field illumination, narrow-area field of illumination, and wide-area field of illumination, narrow-area field of illumination, wide-area field of illumination.

43. The digital image capture and processing system of claim 14, wherein said digital image formation and detection subsystem supports standard functions selected from the group consisting of image capture mode, image capture control, electronic gain of said image sensing array, image frame exposure control, programmable exposure time for each block of imaging pixels within the image sensing array, programmable exposure time for each image frame detected by said image sensing array and field of view (FOV) marking.

44. The digital image capture and processing system of claim 43, wherein said image capture mode is either a narrow-area image capture mode or a wide-area image capture mode.

45. The digital image capture and processing system of claim 43, wherein said image capture control is either single frame control or video frame control.

46. The digital image capture and processing system of claim 43, wherein said electronic gain of said image sensing array is programmable.

47. The digital image capture and processing system of claim 43, wherein said image frame exposure control is programmable.

48. The digital image capture and processing system of claim 43, wherein said exposure time for each image frame detected by said image sensing array is programmable.

49. The digital image capture and processing system of claim 43, wherein said exposure time for each block of imaging pixels within said image sensing array is programmable.

50. The digital image capture and processing system of claim 43, wherein said field of view marking is selected from the group consisting of a one dot pattern, a two dot pattern, a four dot pattern, a visible line pattern, and a composite four dot and line pattern.

51. The digital image capture and processing system of claim 14, wherein said input/output subsystem supports standard functions selected from the group consisting of data communication protocols, output image file formats, output video file formats, data output format, keyboard interface, and graphical display interface.

52. The digital image capture and processing system of claim 14, wherein said system control subsystem supports standard functions selected from the group consisting of a plurality of different modes of system operation, each being programmably selected by a function parameter stored in said memory.