Smart scanning system

• US 8,794,524 B2
• Filed: 05/31/2007
• Issued: 08/05/2014
• Est. Priority Date: 05/31/2007
• Status: Expired due to Fees

• Current Assignee: Toshiba Global Commerce Solutions Holdings Corporation (Toshiba Corporation)
• Original Assignee: Toshiba Global Commerce Solutions Holdings Corporation (Toshiba Corporation)
• Inventors: Connell, Jonathan H. II, Flickner, Myron D., Haas, Norman, Hammershoy, Thomas J., Hampapur, Arun, Pankanti, Sharathchandra U.
• Primary Examiner(s): STANFORD, CHRISTOPHER J
• Application Number:
  US11/756,391
• Publication Number:
  US 20080296382A1
• Time in Patent Office: 2,623 Days
• Field of Search: 235/462.01, 235/454, 235/462.41
• US Class Current: 235/462.14
• CPC Class Codes: G06F 18/256 of results relating to different input data, e.g. multimodal recognition
• CPC Class Codes: G06K 5/00 Methods or arrangements for verifying the correctness of markings on a record carrier; Column detection devices
• CPC Class Codes: G06K 7/0004 Hybrid readers
• CPC Class Codes: G06K 7/10554 Moving beam scanning
• CPC Class Codes: G06K 7/10821 further details of bar or optical code scanning devices
• CPC Class Codes: G06V 10/10 Image acquisition document image scanning and transmission H04N1/00; control of digital cameras H04N23/60
• CPC Class Codes: G06V 10/811 the classifiers operating on different input data, e.g. multi-modal recognition
• CPC Class Codes: G07G 1/0063 with means for detecting the geometric dimensions of the article of which the code is read, such as its size or height, for the verification of the registration

Abstract

The present invention provides a smart scanning system comprising an integrated scanning and image capture system in which one or more image capture device(s) (e.g., still camera, video camera, etc.) and a barcode scanner are positioned within a common enclosure that is a component of a checkout station. The barcode of item is scanned and an image of the item is recorded. The identity of the item as determined based on the barcode is compared to its appearance as determined based on its image. If the identity is inconsistent with its appearance, a discrepancy is registered. It is then determined whether the discrepancy is due to fraud (e.g., theft) or device error. In the case of the latter, the system can be updated to prevent a repeat of the error.

Claims

1. A smart scanning method, comprising:

receiving a scan of a barcode of an item via a dedicated barcode scanner in an integrated scanning and image capture system;

determining an identity of the item based on the barcode;

capturing an image of the item from a substantially horizontal direction via a dedicated image capture device, which is not used to process barcodes, in the integrated scanning and image capture system, the image capture device being distinct from the barcode scanner and adjacent to the barcode scanner in a common enclosure that is affixed as a component of a checkout station;

capturing a second image of the item from a substantially vertical direction below the item via a second dedicated image capture device, wherein the second dedicated image capture device is positioned substantially vertically below a horizontal surface of the common enclosure below an area of the item and facing in an upward direction, wherein the second image is captured through a hole in the common enclosure separate from a scanning window in the horizontal surface, which is not used to process barcodes, in the integrated scanning and image capture system, the second dedicated image capture device being distinct from the barcode scanner and the image capture device and physically separate from the barcode scanner and the image capture device and is affixed as a component of a checkout station; and

determining whether the identity is consistent with an appearance of the item as determined from the image and the second image.

2. The smart scanning method of claim 1, further comprising:

registering a discrepancy if the identity is inconsistent with the appearance; and

providing a notification of the discrepancy, the notification being at least one of a visual notification or an audible notification.

3. The smart scanning method of claim 2, further comprising:

determining a true identity of the item if the identity is inconsistent with the appearance to determine whether the discrepancy is either error or fraud; and

updating the integrated scanning and image capture system to avoid a repeat of the discrepancy if the discrepancy is an error.

4. The smart scanning method of claim 1, the image capture device and the second image capture device being selected from a group consisting of a still image camera or a video camera.

5. The smart scanning method of claim 1, further comprising:

segmenting the image from a background; and

extracting at least one visual feature of the item to determine the appearance.

6. A smart scanning system, comprising:

a module for receiving a scan of a barcode of an item via a dedicated barcode scanner in an integrated scanning and image capture system;

a module for determining an identity of the item based on the barcode;

a module for capturing an image of the item from a substantially horizontal direction via a dedicated image capture device, which is not used to process barcodes, in the integrated scanning and image capture system, the image capture device being distinct from the barcode scanner and adjacent to the barcode scanner in a common enclosure that is affixed as a component of a checkout station;

capturing a second image of the item from a substantially vertical direction below the item via a second dedicated image capture device, wherein the second dedicated image capture device is positioned substantially vertically below a horizontal surface of the common enclosure below an area of the item and facing in an upward direction, wherein the second image is captured through a hole in the common enclosure separate from a scanning window in the horizontal surface, which is not used to process barcodes, in the integrated scanning and image capture system, the second dedicated image capture device being distinct from the barcode scanner and the image capture device and physically separate from the barcode scanner and the image capture device and is affixed as a component of a checkout station; and

a module for determining whether the identity is consistent with an appearance of the item as determined from the image and the second image.

7. The smart scanning system of claim 6, further comprising:

a module for registering a discrepancy if the identity is inconsistent with the appearance; and

a module for providing a notification of the discrepancy, the notification being at least one of a visual notification or an audible notification.

8. The smart scanning system of claim 7, further comprising:

a module for determining a true identity of the item if the identity is inconsistent with the appearance to determine whether the discrepancy is either error or fraud; and

a module for updating the integrated scanning and image capture system to avoid a repeat of the discrepancy if the discrepancy is an error.

9. The smart scanning system of claim 6, the image capture device being a still image capture device.

10. The smart scanning system of claim 6, the image capture device being a video image capture device.

11. An integrated scanning and image capture system, comprising:

a dedicated barcode scanner for scanning a barcode of an item;

a dedicated image capture device, which is not used to process barcodes, the image capture device being distinct from the barcode scanner and adjacent to the barcode scanner, for capturing an image of the item from a substantially horizontal direction, the barcode scanner and the image capture device both being positioned within a common enclosure that is affixed as a component of a checkout station; and

a second dedicated image capture device, which is not used to process barcodes, the second dedicated image capture device being distinct from the barcode scanner and the image capture device and physically separate from the barcode scanner and the image capture device and being affixed as a component of a checkout station with a location outside the common enclosure, for capturing a second image of the item from a substantially vertical direction below the item, wherein the second dedicated image capture device is positioned substantially vertically below a horizontal surface of the common enclosure below an area of the item and facing in an upward direction, wherein the second image is captured through a hole in the common enclosure separate from a scanning window in the horizontal surface.

12. The integrated scanning and image capture system of claim 11, further comprising a set of modules being configured to:

determine an identity of the item based on the barcode;

determine an appearance of the item based on the image;

compare the identity to the appearance; and

determine whether the identity is consistent with the appearance.

13. The integrated scanning and image capture system of claim 12, the set of modules being further configured to:

register a discrepancy if the identity is inconsistent with the appearance;

determine whether the discrepancy is either an error or fraud; and

update the integrated scanning and image capture system to prevent the error from being repeated.

14. The integrated scanning and image capture system of claim 12, the set of modules being further configured to provide a notification of the discrepancy.

15. The integrated scanning and image capture system of claim 14, the notification being at least one of a visual notification or an audible notification.

16. A method for deploying a smart scanning system, comprising:

providing a computer infrastructure being operable to;

receive a scan of a barcode of an item via a dedicated barcode scanner in an integrated scanning and image capture system;

determine an identity of the item based on the barcode;

capture an image of the item from a substantially horizontal direction via a dedicated image capture device, which is not used to process barcodes, in the integrated scanning and image capture system, the image capture device being distinct from the barcode scanner and adjacent to the barcode scanner in a common enclosure that is affixed as a component of a checkout station;

capture a second image of the item from a substantially vertical direction below the item via a second dedicated image capture device, which is not used to process barcodes, in the integrated scanning and image capture system, the second dedicated image capture device being distinct from the barcode scanner and the image capture device and physically separate from the barcode scanner and the image capture device and is affixed as a component of a checkout station with a location outside the common enclosure, wherein the second dedicated image capture device is positioned substantially vertically below a horizontal surface of the common enclosure below an area of the item and facing in an upward direction, wherein the second image is captured through a hole in the common enclosure separate from a scanning window in the horizontal surface; and

determine whether the identity is consistent with an appearance of the item as determined from the image and the second image.

17. The method for claim 16, the computer infrastructure being further operable to:

register a discrepancy if the identity is inconsistent with the appearance;

determine whether the discrepancy is either an error or fraud; and

update the integrated scanning and image capture system to prevent the error from being repeated.

18. The method of claim 16, the computer infrastructure being further operable to provide a notification of the discrepancy.

19. The method for claim 18, the notification being at least one of a visual notification or an audible notification.