Apparatus, method and article for evaluating a stack of objects in an image

• US 8,606,002 B2
• Filed: 09/14/2012
• Issued: 12/10/2013
• Est. Priority Date: 08/26/2009
• Status: Expired due to Fees

• Current Assignee: Sg Gaming, Inc. (Light & Wonder Incorporated)
• Original Assignee: Bally Gaming Incorporated (Light & Wonder Incorporated)
• Inventors: Rajaraman, Arun, Arbogast, Christopher P.
• Primary Examiner(s): Sherali, Ishrat I
• Application Number:
  US13/618,846
• Publication Number:
  US 20130071014A1
• Time in Patent Office: 452 Days
• Field of Search: 382162-167, 382/100, 382135-139, 382/192, 382/194, 382/190, 382/199, 2502221-2222, 250/559.47, 414/901, 235/379, 235/435, 235/375
• US Class Current: 382/165
• CPC Class Codes: G06F 2218/00 Aspects of pattern recognition specially adapted for signal processing
• CPC Class Codes: G06Q 10/087 Inventory or stock management, e.g. order filling, procurement or balancing against orders
• CPC Class Codes: G06T 7/12 Edge-based segmentation
• CPC Class Codes: G06T 7/90 Determination of colour characteristics

Abstract

An evaluation system to determine a value of a stack of objects preprocess a pixelated color image to produce a set of two color contour data, processes the two color contour data to identify a location of a top and a bottom of the stack, and locates, for each of the objects in the stack, a respective set of color pixels from the pixelated color image corresponding to each object based on the identified locations of the top and bottom of the stack. Each of the objects in the stack are then classified into a color classification based on the object'"'"'s respective set of color pixels, and the value of the object is determined based on a known correspondence between the color classification and a value. The cumulative value of the stack is determined by summing the determined values for each of the objects in the stack.

Claims

1. A method of computationally processing images of areas which may contain objects, the method comprising:

acquiring a pixelated color image of an area as a set of pixilated color image data at least temporarily stored in at least one processor-readable medium;

computationally preprocessing by at least one processor the set of pixelated color image data for at least a portion of the area to produce a set of two color contour image data that represents at least the portion of the pixilated color image, wherein a first color of the two color contour image data corresponds to contour pixels and a second color of the two color contour image corresponds to non-contour pixels;

computationally processing by the at least one processor the set of two color contour image data to find a location of a bottom of a stack of objects in the set of two color contour image data and to find a location of a top of the stack of objects in the set of two color contour image data, if any objects are in the at least portion of the area, wherein the stack of objects includes at least one object if any objects are in the at least portion of the area;

determining a horizontal center of the stack of objects based on an overall concentration of contour pixels in the set of two color contour image data;

determining an estimated height of individual objects in the stack of objects based on a mean/average height of an individual object of the stack rationalized for a distance between an image acquisition device used to acquire the pixelated color image and an expected location of the stack, said distance adjusted based on the location of the bottom of the stack at the determined horizontal center of the stack relative to the expected location of the stack of objects; and

subsequent to determining the horizontal center of the stack of objects and the estimated height of individual objects in the stack of objects, computationally determining by the at least one processor a total number of objects in the stack, if any based at least in part on a knowledge of the location of the bottom of the stack of objects, the location of the top of the stack of objects and the determined estimated height of individual objects in the stack of objects.

2. The method of claim 1 wherein computationally preprocessing by at least one processor the set of pixelated color image data for at least a portion of the area to produce a set of two color contour image data includes:

converting at least a portion of the set of the pixelated color image data to a set of gray scale image data; and

edge detection filtering the set of gray scale image data to produce a set of contour image data.

3. The method of claim 2 wherein computationally preprocessing by at least one processor the set of pixelated color image data for at least a portion of the area to produce a set of two color contour image data further includes:

converting by the at least one processor at least a portion of the set of contour image data to a set of black and white contour image data.

4. The method of claim 1 wherein computationally preprocessing by at least one processor the set of pixelated color image data for at least a portion of the area to produce a set of two color contour image data further includes:

eliminating extraneous pixels from the set of two color contour image data.

5. The method of claim 3 wherein converting by the at least one processor at least a portion of the set of contour image data to a set of black and white contour image data includes:

converting by the at least one processor a set of gray scale contour image data to a set of hue, saturation, and brightness (HSB) contour image data; and

converting by the at least one processor the set of HSB contour image data to the set of black and white contour image data.

6. The method of claim 1 wherein computationally preprocessing by at least one processor the set of pixelated color image data for at least a portion of the area to produce a set of two color contour image data includes:

color balancing a set of pixilated color image data representing a pixelated reference image of the area to have it more closely match the set of two color contour image data, said reference image having no stack of objects;

rotating the set of two color contour image data to compensate for camera distortion for one or more stacks of objects that are near edges of the two color contour image data;

aligning the set of pixilated color image data representing the pixelated reference image and the set of two color contour image data to account for movement of an image acquisition device used to acquire the pixelated color image;

subtracting the set of pixilated color image data representing a pixelated reference image of the area from the set of two color contour image data;

adding back to the set of two color contour image data image data representing an element of average background color of the area; and

either before the subtracting or after the subtracting, converting the set of pixilated color image data representing the pixelated reference image of the area and the set of two color contour image data to gray scale if the converting to gray scale had been determined likely to improve accuracy of the determining of the total number of objects in the stack.

7. A method of computationally processing images of areas which may contain objects, the method comprising:

acquiring a pixelated color image of an area as a set of pixilated color image data at least temporarily stored in at least one processor-readable medium;

computationally preprocessing by at least one processor the set of pixelated color image data for at least a portion of the area to produce a set of two color contour image data that represents at least the portion of the pixilated color image, wherein a first color of the two color contour image data corresponds to contour pixels and a second color of the two color contour image corresponds to non-contour pixels, wherein computationally preprocessing by at least one processor to produce the set of two color contour image data further comprises eliminating extraneous pixels from the set of two color contour image data;

computationally processing by the at least one processor the set of two color contour image data to find a location of a bottom of a stack of objects in the set of two color contour image data and to find a location of a top of the stack of objects in the set of two color contour image data, if any objects are in the at least portion of the area, wherein the stack of objects includes at least one object if any objects are in the at least portion of the area; and

computationally determining by the at least one processor a total number of objects in the stack, if any based at least in part on a knowledge of the location of the bottom of the stack of objects and the location of the top of the stack of objects.

8. The method of claim 7 wherein computationally preprocessing by at least one processor the set of pixelated color image data for at least a portion of the area to eliminate extraneous pixels from the set of two color contour image data further includes:

eliminating extraneous pixels from the set of two color contour image data that are outside the at least portion of the area; and

eliminating extraneous pixels that are not part of groups that at least approximately form the shape of a stack object based on a minimum threshold number of pixels.

9. The method of claim 7 wherein computationally preprocessing by at least one processor the set of pixelated color image data for at least a portion of the area to produce a set of two color contour image data further includes:

logically segmenting the two color contour image data into a set of target pixel areas, each of the target pixel areas including a set of n by m pixels.

10. The method of claim 9 wherein eliminating extraneous pixels from the set of two color contour image data comprises:

for each target pixel area of the set of target pixel areas, eliminating all contour pixels in the target pixel area from the set of two color contour image data if a total number of the contour pixels in the target pixel area is less than a threshold number of pixels per target pixel area; and

for each target pixel area of at least some of the set of target pixel areas, eliminating all contour pixels in the target pixel area from the set of two color contour image data if the target pixel area has less than a nearest neighboring threshold number of nearest neighboring target pixel areas.

11. The method of claim 9 wherein computationally processing by the at least one processor the set of two color contour image data to find a location of a bottom and a top of a stack of objects in the set of two color contour image data includes:

successively applying a sample bounding box to groups of target pixel areas of the set of target pixel areas at successive intervals from a determined bottom of the stack of objects until a top streak of target pixel areas contained within the sample bounding box is empty.

12. A system, comprising:

at least one image capturing device that acquires a pixelated color image of an area as a set of pixelated color image data; and

at least one object evaluation computing system having at least one processor and at least one storage medium that at least temporarily stores the set of pixelated color image data, wherein the object evaluation computing system;

preprocesses the set of pixelated color image data for at least a portion of the area to produce a set of two color contour image data that represents at least the portion of the pixilated color image, wherein said preprocessing to produce the set of two color image data comprises;

converts at least a portion of the set of the pixelated color image data to a set of gray scale image data,

edge detection filters the set of gray scale image data to produce a set of contour image data,

converts at least a portion of the set of contour image data to a set of black and white contour image data,

converts a set of gray scale contour image data to a set of hue, saturation, and brightness (HSB) contour image data, and

converts the set of HSB contour image data to the set of black and white contour image data;

processes the set of two color contour image data to find a location of a bottom of a stack of objects in the set of two color contour image data and to find a location of a top of the stack of objects in the set of two color contour image data, if any objects are in the at least portion of the area, wherein the stack of objects includes at least one object if any objects are in the at least portion of the area; and

determines a total number of objects in the stack, if any based at least in part on a knowledge of the location of the bottom of the stack of objects and the location of the top of the stack of objects.

13. The system of claim 12 wherein the at least one object evaluation computing system further logically segments the two color contour image data into a set of target pixel areas, each of the target pixel areas including a set of n by m pixels.

14. The system of claim 12 wherein the at least one object evaluation computing system preprocesses the set of pixelated color image data by:

comparing a set of pixilated color image data representing a pixelated reference image of the area to the set of two color contour image data, said reference image having no stack of objects; and

removing irregularities from the set of two color contour image data around a stack of objects in the two color contour image data based on the comparing.

15. The system of claim 12 wherein the at least one object evaluation computing system preprocesses the set of pixelated color image data by:

color balancing a set of pixilated color image data representing a pixelated reference image of the area to have it more closely match the set of two color contour image data, said reference image having no stack of objects;

rotating the set of two color contour image data to compensate for camera distortion for one or more stacks of objects that are near edges of the two color contour image data;

aligning the set of pixilated color image data representing the pixelated reference image and the set of two color contour image data to account for movement of an image acquisition device used to acquire the pixelated color image;

subtracting the set of pixilated color image data representing a pixelated reference image of the area from the set of two color contour image data;

adding back to the set of two color contour image data image data representing an element of average background color of the area; and

either before the subtracting or after the subtracting, converting the set of pixilated color image data representing the pixelated reference image of the area and the set of two color contour image data to gray scale if the converting to gray scale had been determined likely to improve accuracy of the determining of the total number of objects in the stack.

16. The system of claim 12 wherein the at least one object evaluation computing system preprocesses the set of pixelated color image data by:

eliminating extraneous pixels from the set of two color contour image data that are outside the at least portion of the area; and

eliminating extraneous pixels that are not part of groups that at least approximately form the shape of a stack object based on a minimum threshold number of pixels.

17. The system of claim 16 wherein eliminating extraneous pixels that are not part of groups comprises:

passing a template shaped as a stack object over the set of two color contour image data;

counting a number of contour pixels within an area defined by the template for each location of the template on the set of two color contour image data; and

eliminating all pixels outside the area defined by the template at each location if the number of contour pixels within the area defined by the template contains the minimum threshold number of pixels.

18. The system of claim 17 wherein the at least one object evaluation computing system eliminates extraneous pixels from the set of two color contour image data further by:

for each target pixel area of the set of target pixel areas, eliminating all contour pixels in the target pixel area from the set of two color contour image data if a total number of the contour pixels in the target pixel area is less than a threshold number of pixels per target pixel area.

19. The system of claim 12 wherein the at least one object evaluation computing system further:

determines a total number of objects in the stack by determining a difference in the top of the stack of objects and the bottom of the stack of objects and a mean/average height of an individual object rationalized for a distance between the image acquisition device and the stack of objects.

20. The system of claim 12 wherein the at least one object evaluation computing system further:

reclassifies an object into a different color class based on a determination that a color of the object is obscured by a shadow in the pixelated color image.

21. The system of claim 20 wherein the at least one object evaluation computing system reclassifies an object by:

determining whether pixels of an object previously classified as black surpass a threshold regarding (HSB) values of the pixels; and

reclassifying the object into a different color class if the threshold is surpassed;

and the at least one object evaluation computing system may be further configured to;

re-determine a value of the object based on the reclassification.