Item recognition method and apparatus

• US 6,592,033 B2
• Filed: 02/11/2002
• Issued: 07/15/2003
• Est. Priority Date: 08/10/1999
• Status: Expired due to Fees

• Current Assignee: Ajax Cooke Pty., Ltd.
• Original Assignee: Ajax Cooke Pty., Ltd.
• Inventors: Jennings, Andrew John, Waldron, John Gerard, Eastwood, Brett
• Primary Examiner(s): Lee, Michael G.
• Assistant Examiner(s): Caputo, Lisa M.
• Application Number:
  US10/071,246
• Publication Number:
  US 20020138374A1
• Time in Patent Office: 519 Days
• Field of Search: 235/385, 235/378, 705/16, 364/403
• US Class Current: 235/385
• CPC Class Codes: G06F 18/00 Pattern recognition
• CPC Class Codes: G06Q 10/0875 Itemisation or classification of parts, supplies or services, e.g. bill of materials
• CPC Class Codes: G06V 10/752 Contour matching

Abstract

A method is provided for recognizing an individual item at an identification station from a variety of known products for purposes of entry into an inventory and/or register system. A backlit viewplate is used and a digital image capturing device captures and stores a reference image of the viewplate. A backlit image of the item to be identified adjacent the viewplate is then captured and converted into a digitized image signal representing the captured image. The digitized image signal is processed by subtraction of a representation of said stored reference image to remove viewplate artifact, to provide a background-compensated image signal. The background-compensated image signal is analyzed to generate image descriptors characterizing features of size and/or shape of the item, and the descriptors are compared with the data stored on a computerized product database to identify data sets with the highest correlation. Visual representations of products corresponding to the data sets with the highest correlation are displayed; and an operator confirms the recognition result for entry into the inventory and/or register system.

Claims

1. A method for recognising an individual item at an identification station from a variety of known products for purposes of entry into an inventory and/or register system, said method comprising the steps of;

providing a viewplate at said identification station;

illuminating said viewplate from the backside to provide a backlit image viewable from the front side of the viewplate;

providing a digital image capturing means positioned relative to the viewplate to capture said backlit image;

capturing and storing a reference image of said viewplate;

supporting the item to be identified adjacent the viewplate;

viewing said item with said digital image capturing means to capture said backlit image;

providing a digitised image signal representing said captured image;

processing said digitised image signal by subtraction of a representation of said stored reference image to remove viewplate artifact, to provide a background-compensated image signal;

image-analysing said background-compensated image signal to generate at least one image descriptor characterising features of size and/or shape of the item to be identified;

providing a computerised product database for storage of data sets representing image descriptors characterising features of size and/or shape for all of said variety of known products;

comparing said at least one item image descriptor with the data stored on said computerised product database to identify data sets with the highest correlation;

displaying a recognition result, being a visual representation of at least one product corresponding to the data sets with the highest correlation; and

providing means for selective verification whereby an operator can confirm the recognition result for entry into the inventory and/or register system.

2. A method according to claim 1, wherein said digital image capturing means is a black-and-white digital camera and said digitised image signal is a grey-scale image signal.

3. A method according to claim 1, wherein said identification station is a checkout counter in a retail goods outlet, provided with a display screen for displaying said recognition result.

4. A method according to claim 1, wherein said viewplate is associated with a weight data means capturing weight data of said item to be identified, and said weight data is also used in said computerised product database and said comparison step to produce the recognition result.

5. A method according to claim 1, wherein said digitised image signal or said background compensated image signal is subjected to a binary threshold step.

6. A method according to claim 1, wherein said background compensated image signal is subjected to a filtering step to reduce or remove noise and/or errors.

7. A method according to claim 1, wherein said image analysing step includes an object segmentation step which serves to isolate a segmented image of an individual item from any other parts of the image.

8. A method according to claim 7, wherein the object segmentation step involves a selection based on prescribed criteria of size, shape and/or position to select a segmented image of an individual item from other segmented images.

9. A method according to claim 1, wherein said generation of said at least one image descriptor involves calculating a representation of at least one parameter of said background-compensated image signal selected from the group of:

width;

length;

area;

occupation ratio;

circularity;

perimeter;

eccentricity;

hole number;

hole size;

boundary feature;

radial diameters signature;

minimum radial diameters;

maximum radial diameters;

mean of radial diameters;

standard deviation of radial diameters;

radial radii signature;

minimum radial radii;

maximum radial radii;

mean of radial radii;

standard deviation of radial radii;

first Hu moment;

second Hu moment;

third Hu moment;

fourth Hu moment;

fifth Hu moment;

sixth Hu moment; and

seventh Hu moment.

10. A method according to claim 1, wherein said comparison step involves a pattern recognition algorithm.

11. A method according to claim 10, wherein the pattern recognition algorithm involves a K-Nearest Neighbour technique.

12. A method according to claim 1, wherein said recognition result is a candidate list of a number of said products with the data sets having the highest ranking correlation.

13. A method according to claim 1, wherein the visual representation includes an image of a product or products stored on said computerised product database.

14. A method according to claim 1, wherein the display step includes the display on a touchscreen for product selection by the operator.

15. A method according to claim 1, wherein said capturing and storing of the reference image is repeated at intervals.

16. An item recognition apparatus for recognising an individual item from a variety of known products for purposes of entry into an inventory and/or register system, said apparatus comprising:

an identification station having;

a viewplate with backside illumination to provide a backlit image viewable from the frontside of the viewplate;

a digital image capture means arranged to view said backlit image;

a display screen for viewing by an operator; and

an entry means for the operator to selectively make entries into the inventory and/or register system;

computer storage and processing means having;

a first memory store containing data representing a reference image of said viewplate;

a second memory store containing a product database of data sets representing image descriptors characterising features of size and/or shape for all of said variety of known products; and

digitised image processing and analysing means for processing and analysing a digitised image captured by said digital image capture means, including;

means for using the data in said first memory store to subtract the representation of said reference image;

means for generating at least one image descriptor characterising features of size and/or shape of the item to be identified; and

means for comparing said at least one image descriptor with said stored data in said second memory store to identify stored data sets with the highest correlation and to produce a recognition result;

and means for communicating said recognition result to said display screen.

17. An apparatus according to claim 16, wherein said entry means includes a touchscreen.

18. An apparatus according to claim 17, including a plurality of identification stations, the computer storage and processing means having a first memory store associated with each identification station and a central second memory store for communication with each of the plurality of identification stations.

19. An apparatus according to claim 17, wherein said identification station includes a weighscale associated with said viewplate, said product database including data characterising the weight of all of said variety of known products, and said comparison means including means to compare weight data from an item with stored weight data in the product database.

20. A checkout station in a retail goods outlet incorporating an item recognition apparatus according to claim 17.

21. A system including the item recognition apparatus of claim 17 in combination with an inventory and/or register system.