Produce size recognition system

• US 6,005,959 A
• Filed: 07/21/1997
• Issued: 12/21/1999
• Est. Priority Date: 02/17/1995
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Mohan, Rakesh, Bolle, Rudolf Maarten, Connell, Jonathan Hudson
• Primary Examiner(s): Boudreau, Leo H.
• Assistant Examiner(s): MEHTA, BHAVESH M
• Application Number:
  US08/897,146
• Time in Patent Office: 883 Days
• Field of Search: 382/110, 382/141-143, 382/152, 382/286, 382/199, 382/100, 382/203, 382/170, 348/86, 348/89, 348/91, 364/555, 364/560, 209/525, 356/379, 356/380, 356/383, 356/384
• US Class Current: 382/110
• CPC Class Codes: G01B 11/024 by means of diode-array scanning
• CPC Class Codes: G01G 19/4144 for controlling weight of goods in commercial establishments, e.g. supermarket, P.O.S. systems
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30128 Food products
• CPC Class Codes: G06T 7/12 Edge-based segmentation
• CPC Class Codes: G06T 7/194 involving foreground-background segmentation
• CPC Class Codes: G06T 7/62 of area, perimeter, diameter or volume
• CPC Class Codes: G06T 7/64 of convexity or concavity
• CPC Class Codes: G07G 1/0054 with control of supplementary check-parameters, e.g. weight or number of articles

Abstract

The present system and apparatus uses image processing to recognize object size within a scene. The system includes novel image processing apparatus and methods to segment one or more object images from a background image of the scene. A processed image (that can be used to characterize size features) of the object(s) is then compared to stored reference images. The object size is recognized when a match occurs. The system can recognize object sizes independent of number of objects present and the objects may be touching each other and overlapping. The system can be trained to recognize object sizes that it was not originally programmed to recognize.

Claims

1. A system for characterization of the size of a target object comprising:

a visual input device for receiving a scanned scene image, the scene image including an image of the target object and a background image;

means for determining a boundary of the image of the target object, the boundary being a plurality of transition points between the target object image and the background image;

means for determining a plurality of intermediate sizes of the target object, each of said intermediate sizes determined from three of said transition points on the boundary of the target object, and an image point on the image of the target object, each of said intermediate sizes being along a substantially same direction with respect to a predetermined scan direction; and

means for determining a size characterization of the target object from said plurality of the determined intermediate sizes.

2. A system according to claim 1, wherein said means for determining a size comprises means for determining an average of two or more of said intermediate sizes and wherein said means determines the size from said average.

3. A system according to claim 1, wherein said means for determining a size comprises means for determining a median of two or more of said intermediate sizes and wherein said means determines the size from said median.

4. A system for determining a size of target objects having a boundary, the boundary having a radius of curvature, comprising:

a visual input device for receiving a scanned scenic image, the scene image including an image of the target objects and a background image;

means for determining a boundary of the image of the target object defined as a plurality of transition points between the target object and the background image;

means for determining a plurality of intermediate sizes of said target object, each of said plurality of intermediate sizes determined from three points on the boundary of the target object and an image point on the image of the target object, and each of said intermediate sizes being along a same direction with respect to a predetermined scan direction;

means for storing a plurality of predetermined reference object size characterizations;

means for comparing the plurality of intermediate sizes with one or more of said stored reference object size characterizations and generating a result of said comparing; and

means for determining a size of the target object based on said result.

5. A system according to claim 4, further comprising:

means for selecting a plurality of sets of three points on the object boundary, wherein said means for comparing compares said selected sets with said reference object size characterizations and

wherein said means for determining a size of the target object determines the size based on said comparing.

6. A system according to claim 5, wherein the intermediate size represents a determined diameter of said target object and the reference size represents a reference diameter.

7. A system according to claim 6, wherein said means for determining a size comprises:

means for determining a chord between a first and second point on the image boundary;

means for selecting a plurality of reference points on the chord;

means for determining a first distance, a, for each of said reference points, defined as being the distance between the first point and the reference point

means for determining a second distance, b, for each of said reference points, defined as being the distance between the second point and the reference point;

means for calculating a third distance c, for each of said reference points, being the distance between from the reference point orthogonal to a point on the boundary;

means for determining a plurality of intermediate target diameters, D, by the equation;

space="preserve" listing-type="equation">if(a+1≦

2c) then D=a.sup.2 +b.sup.2 +c.sup.2 +(ab/c).sup.2

wherein

said means for determining the intermediate size calculates a plurality of intermediate sizes, S, where S is selectable between S=π

D² (area) and S=π

D³ (volume).

8. A system according to claim 7, wherein said means for determining a size calculates an average of said plurality of intermediate sizes of a single instance of the target object and determines the size of the target object based on said average.

9. A system according to claim 7, wherein said means for determining the target size characteristic calculates a histogram of two or more of the intermediate sizes S and compares said histogram to a histogram of two or more of said stored plurality of intermediate reference sizes.

10. A system according to claim 7, wherein said means for determining the target size characteristic calculates a normalized histogram of two or more of the intermediate sizes S and compares said histogram to a normalized histogram of two or more of said stored plurality of intermediate reference sizes.

11. A system according to claim 7, wherein said means for determining a size calculates a peak value of a histogram of two or more of the intermediate target sizes S and compares said peak value to said stored plurality of intermediate reference sizes.

12. A system according to claim 7, further comprising means for representing the determined target object size through a user interface.

13. A system according to claim 12, wherein said means for determining a size determines a set of two or more estimated sizes of the object and said user interface outputs said estimated sizes.

14. A system according to claim 12, further comprising:

means for prestoring a price data;

a scale that determines the weight of the object; and

means for calculating a price of the object based upon the determined weight and determined size of the object and said prestored price data.

15. A system according to claim 7 wherein said means for determining a size calculates a median of the determined plurality of intermediate sizes of a single instance of the target object and determines the size based on said median.

16. A system according to claim 4 wherein said means for determining a size comprises means for determining, based on said two or more intermediate sizes, that a size characteristic of the target object does not correspond to said plurality of prestored reference size characterizations, and further comprising means for outputting a NO MATCH data in response.

17. A system according to claim 16 further comprising a user interface means for outputting in a human recognizable form a signal representing said NO MATCH data.

18. A system according to claim 17 further comprising:

a user input means for receiving a size characterization; and

means for storing said received size characterization into said means for storing said predetermined plurality of reference size characterizations.