Image-based inventory control system and method

• US 9,041,508 B2
• Filed: 06/12/2009
• Issued: 05/26/2015
• Est. Priority Date: 08/08/2008
• Status: Active Grant

• Current Assignee: Snap-On Incorporated
• Original Assignee: Snap-On Incorporated
• Inventors: Glickman, Stephen L., Jackson, David A., Lipsey, Matthew J., Phillips, Preston, Fly, David C., Weeks, Jason L.
• Primary Examiner(s): Lim, Steven
• Assistant Examiner(s): Adnan, Muhammad
• Application Number:
  US12/484,127
• Publication Number:
  US 20100045423A1
• Time in Patent Office: 2,174 Days
• Field of Search: 340/3.1, 340/5.1, 340/5.2, 340/5.92, 700/236, 382106-109, 382254-276, 200/61.61, 705/22, 705/28
• US Class Current: 340/3.1
• CPC Class Codes: B25H 3/00 Storage means or arrangements for workshops facilitating access to, or handling of, work tools or instruments containers or packages with special means for dispensing contents B65D83/00; nail dispensers B25C3/00
• CPC Class Codes: B25H 3/028 by sliding extraction from within a common frame
• CPC Class Codes: G06Q 10/087 Inventory or stock management, e.g. order filling, procurement or balancing against orders
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

Systems and methods for determining an inventory condition of objects based on captured images are described. An exemplary inventory control system or method utilizes a highly efficient and economical approach to apply suitable imaging parameters for capturing images of a storage drawer being accessed by a user, or for manipulating the captured images of the drawer. An inventory condition of the drawer is determined based on the captured images or manipulated images.

Claims

1. An inventory control system for determining an inventory condition of objects stored in the system, the system comprising:

a plurality of storage drawers, each storage drawer including a plurality of storage locations for storing objects;

an image sensing device comprising a plurality of cameras configured to capture images of the drawers;

a data storage device storing imaging parameters corresponding to each storage drawer, the stored imaging parameters comprising known reference data identifying regions of each drawer within a field of view of each of the plurality of cameras, the known reference data further including settings used in capturing the images or processing the images after they are captured; and

a data processor configured to;

determine an identity of a drawer being accessed by the user,

access the imaging parameters corresponding to the determined identity of the drawer, the accessed imaging parameters including the known reference data identifying regions of the identified drawer within the field of view of each of the plurality of cameras,

capture images of the drawer being accessed by the user using the plurality of cameras,

determine relative positional relationships between the images captured by each camera of the plurality of cameras using the known reference data identifying regions of the identified drawer within the field of view of each of the plurality of cameras and stitch together the images captured by the plurality of cameras based on the determined relative positional relationships between the images, and

determine an inventory condition of the objects stored in the storage drawer according to the stitched together image.

2. The system of claim 1, wherein the data processor determines the identity of the storage drawer according to an identifier unique to each storage drawer or a state of a signal generated by a sensor.

3. The system of claim 1, wherein the known reference data include at least one of exposure parameters, shutter parameters, illumination parameters and color gains.

4. The system of claim 1, wherein the imaging parameters are pre-stored in the data storage device.

5. The system of claim 1, wherein the data storage device stores a look-up table including ideal imaging parameters under different illumination conditions for each of a plurality of distances from a storage drawer to an image sensing device.

6. The system of claim 5, wherein the data processor is configured to access the imaging parameters by:

detecting the illumination conditions in an environment of the identified storage drawer;

accessing the reference data stored in the data storage device to obtain a distance from the identified storage drawer to the image sensing device;

obtaining from the look-up table ideal imaging parameters according to the detected illumination conditions and to the obtained distance from the identified storage drawer to the image sensing device; and

providing the ideal imaging parameters to the image sensing device for use by the image sensing device in capturing an image of the drawer being accessed by the user.

7. The system of claim 5, wherein the data processor is configured to access the imaging parameters by

detecting the illumination conditions in an environment of the identified storage drawer;

accessing the reference data stored in the data storage device to obtain a distance from the identified storage drawer to the image sensing device;

obtaining from the look-up table ideal imaging parameters according to the detected illumination conditions and to the obtained distance from the identified storage drawer to the image sensing device; and

using the ideal imaging parameters to manipulate the captured image of the drawer being accessed by the user.

8. The system of claim 1, wherein the image sensing device is configured to determine which of the plurality of cameras to use in capturing the image of the drawer being accessed by the user based on the known reference data identifying regions of the identified drawer within the field of view of each of the plurality of cameras.

9. The system of claim 8, wherein the image sensing device is configured to turn off one of the plurality of cameras in response to determining that a region of the identified drawer is redundantly imaged by another of the plurality of cameras.

10. A imaging control method for use in a tool storage system including a plurality of storage drawers, each storage drawer including a plurality of storage locations for storing objects;

an image sensing device comprising a plurality of cameras configured to capture images of the drawers;

a data storage device storing imaging parameters corresponding to each storage drawer, the stored imaging parameters comprising known reference data identifying regions of each drawer within a field of view of each of the plurality of cameras, the known reference data further including settings used in capturing the images or processing the images after they are captured; and

a data processor, the method comprising;

determining an identity of a drawer being accessed by the user,

accessing the imaging parameters corresponding to the determined identity of the drawer, the accessed imaging parameters including the known reference data identifying regions of the identified drawer within the field of view of each of the plurality of cameras,

capturing images of the drawer being accessed by the user using the plurality of cameras,

determining relative positional relationships between the images captured by each camera of the plurality of cameras using the known reference data identifying regions of the identified drawer within the field of view of each of the plurality of cameras and stitching together the images captured by the plurality of cameras based on the determined relative positional relationships between the images, and

determining an inventory condition of the objects stored in the storage drawer being accessed by the user according to the stitched together image.

11. The method of claim 10, wherein the data processor determines the identity of the storage drawer according to an identifier unique to each storage drawer or a state of a signal generated by a sensor.

12. The method of claim 10, wherein the known reference data include at least one of exposure parameters, shutter parameters, illumination parameters and color gains.

13. The method of claim 10, wherein the imaging parameters are pre-stored in the data storage device.

14. The method of claim 10, further comprising:

storing in the data storage device a look-up table including ideal imaging parameters under different illumination conditions for each of a plurality of distances from a storage drawer to an image sensing device.

15. The method of claim 14, wherein accessing the imaging parameters comprises:

detecting the illumination conditions in an environment of the identified storage drawer;

accessing the reference data stored in the data storage device to obtain a distance from the identified storage drawer to the image sensing device;

obtaining from the look-up table ideal imaging parameters according to the detected illumination conditions and to the obtained distance from the identified storage drawer to the image sensing device; and

providing the ideal imaging parameters to the image sensing device for use by the image sensing device in capturing an image of the drawer being accessed by the user.

16. The method of claim 14, wherein accessing the imaging parameters comprises:

detecting the illumination conditions in an environment of the identified storage drawer;

accessing the reference data stored in the data storage device to obtain a distance from the identified storage drawer to the image sensing device;

obtaining from the look-up table ideal imaging parameters according to the detected illumination conditions and to the obtained distance from the identified storage drawer to the image sensing device; and

using the ideal imaging parameters to manipulate the captured image of the drawer being accessed by the user.

17. An inventory control system for determining an inventory condition of objects stored in the system, the system comprising:

storage means, including a plurality of drawers, for storing objects;

imaging means comprising a plurality of cameras for capturing images of the storage means;

data storage means for storing imaging parameters corresponding to each storage means, the stored imaging parameters comprising known reference data identifying regions of each drawer within a field of view of each of the plurality of cameras, the known reference data further including settings used in capturing the images or processing the images after they are captured; and

data processing means for;

determining an identity of a drawer being accessed by the user,

accessing the imaging parameters corresponding to the determined identity of the drawer, the accessed imaging parameters including the known reference data identifying regions of the identified drawer within the field of view of each of the plurality of cameras,

capturing images of the drawer being accessed by the user using the plurality of cameras,

determining relative positional relationships between the images captured by each camera of the plurality of cameras using the known reference data identifying regions of the identified drawer within the field of view of each of the plurality of cameras and stitching together the images captured by the plurality of cameras based on the determined relative positional relationships between the images, and

determining an inventory condition of the objects stored in the drawer according to the stitched together image.

18. The system of claim 17, wherein the data processing means determines the identity of the storage drawer according to an identifier unique to each storage drawer or a state of a signal generated by a sensor.

19. The system of claim 17, wherein the known reference data include at least one of exposure parameters, shutter parameters, illumination parameters and color gains.

20. The system of claim 17, wherein the imaging parameters are pre-stored in the data storage means.

21. The system of claim 17, wherein the data storage device means further stores a look-up table including ideal imaging parameters under different illumination conditions for each of a plurality of distances from a storage drawer to an image sensing device.

22. The system of claim 21, wherein the data processing means is configured to access the imaging parameters by:

detecting the illumination conditions in an environment of the identified storage drawer;

accessing the reference data stored in the data storage means to obtain a distance from the identified storage drawer to the image sensing device;

obtaining from the look-up table ideal imaging parameters according to the detected illumination conditions and to the obtained distance from the identified storage drawer to the image sensing device; and

performing at least one of;

providing the ideal imaging parameters to the image sensing device for use by the image sensing device in capturing an image of the drawer being accessed by the user; and

using the ideal imaging parameters to manipulate the captured image of the drawer being accessed by the user.