Automated asset management system with multiple sensing technologies

• US 9,741,014 B2
• Filed: 04/13/2016
• Issued: 08/22/2017
• Est. Priority Date: 04/15/2015
• Status: Active Grant

• Current Assignee: Snap-On Incorporated
• Original Assignee: Snap-On Incorporated
• Inventors: Rogers, Frederick J., Fly, David C., Phillips, Preston C., Lipsey, Matthew J., Chwan, Joseph, Newport, Jason, Lobo, Andrew R.
• Primary Examiner(s): Kim, Ahshik
• Application Number:
  US15/097,802
• Publication Number:
  US 20160307150A1
• Time in Patent Office: 496 Days
• Field of Search: 235385, 235375, 340540
• CPC Class Codes: B25H 3/028 by sliding extraction from within a common frame
• CPC Class Codes: G06K 19/06037 multi-dimensional coding
• CPC Class Codes: G06Q 10/08 Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
• CPC Class Codes: G06Q 10/087 Inventory or stock management, e.g. order filling, procurement or balancing against orders
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof

Abstract

An automated asset management system includes a plurality of storage locations for storing objects, and first and second sensing subsystems each configured to sense presence or absence of the objects in the plurality of storage locations. The first and second sensing subsystems are used to sense the presence or absence of a same particular object using different respective sensing modalities. In operation, a first scan of the storage locations is performed using the first sensing subsystem, and the presence or absence of the particular object is determined using the first sensing modality. In turn, a second scan of the storage locations is performed using the second sensing subsystem, and the presence or absence of the particular object is confirmed using both the result of the determination made using the first sensing modality and a determination of the presence or absence of the particular object using the second sensing modality.

Claims

1. An automated asset management system comprising:

a plurality of storage locations for storing objects;

first and second sensing subsystems each configured to sense presence or absence of the objects in the plurality of storage locations of the asset management system, wherein the first and second sensing subsystems are configured to sense the presence or absence of a same particular object in the asset management system using different respective first and second sensing modalities;

a processor; and

a non-transitory machine readable recording medium storing program instructions which, when executed by the processor, cause the processor to;

perform a scan of the storage locations using the first sensing subsystem, and determine the presence or absence of the particular object in the plurality of storage locations using the first sensing modality of the first sensing subsystem, and

perform a scan of the storage locations using the second sensing subsystem, and confirm the presence or absence of the particular object in the plurality of storage locations using both the result of the determination made using the first sensing modality and a determination of the presence or absence of the particular object using the second sensing modality of the second sensing subsystem,

wherein the first sensing subsystem includes optical identification sensors, and

wherein the second sensing subsystem is operative to differentiate between objects that are not differentiated by the first sensing subsystem.

2. The automated asset management system of claim 1, wherein the second sensing subsystem is further configured to read unique identifiers from objects present in the asset management system.

3. The automated asset management system of claim 2, wherein the second sensing subsystem is configured to read unique identifiers stored in radio frequency (RF) identification (RFID) tags associated with objects present in the asset management system.

4. The automated asset management system of claim 2, wherein the second sensing subsystem is configured to read unique identifiers stored in bar-code or quick response (QR) code tags associated with objects present in the asset management system.

5. The automated asset management system of claim 4, wherein the first sensing subsystem is a camera-based image sensing subsystem comprising one or more cameras, the second sensing subsystem is a tag sensing subsystem for sensing bar-code or quick response (QR) code tags associated with objects in the asset management system, and the first and second sensing subsystems use the same one or more cameras for performing scans of the storage locations using the first and second sensing modalities.

6. The automated asset management system of claim 1, wherein the first sensing subsystem is a camera-based image sensing subsystem comprising one or more cameras, and is configured to determine the presence or absence of a particular tool using a camera-based visual sensing modality by capturing an image of a storage location associated with the particular tool and determining whether the tool is present in the captured image, and

the second sensing subsystem is a radio frequency (RF)-based sensing subsystem comprising one or more RF identification (RFID) transceivers, and is configured to determine the presence or absence of the particular tool using an RF-based wireless sensing modality used to sense whether an RF-based tag associated with the particular tool is present in the asset management system.

7. The automated asset management system of claim 6, wherein the processor is configured to determine a total number of RF-based tags that are expected to be present in the asset management system using the first sensing modality, and performs the scan of the storage locations using the RF-based sensing subsystem to identify the determined total number of RF-based tags in the asset management system.

8. The automated asset management system of claim 7, wherein the RF-based sensing subsystem is used to confirm the presence or absence of the particular object using both the result of the determination made by the camera-based visual sensing modality and the RF-based wireless sensing modality.

9. The automated asset management system of claim 2, wherein the second sensing subsystem is configured to read unique identifiers encoded in tags affixed to objects present in the asset management system.

10. The automated asset management system of claim 9, wherein the unique identifiers are encoded in uni-dimensional or multi-dimensional bar-codes on the tags affixed to the surfaces of the objects present in the asset management system.

11. A method comprising:

performing, using a first sensing subsystem, a first scan of a plurality of storage locations for storing objects in an automated asset management system having the first sensing subsystem and a second sensing subsystem each configured to sense presence or absence of the objects in the plurality of storage locations;

determine, based on a result of the first scan, presence or absence of a particular object in the plurality of storage locations using a first sensing modality of the first sensing subsystem;

performing, using the second sensing subsystem, a second scan of the plurality of storage locations; and

confirming the presence or absence of the particular object in the plurality of storage locations using both a result of the determination made using the first sensing modality and a determination of the presence or absence of the particular object using a second sensing modality of the second sensing subsystem,

wherein the first and second sensing subsystems are configured to sense the presence or absence of a same particular object in the asset management system using different respective first and second sensing modalities,

wherein the first sensing subsystem includes optical identification sensors, and

wherein the second sensing subsystem is operative to differentiate between objects that are not differentiated by the first sensing subsystem.

12. The method of claim 11, wherein the performing of the second scan comprises reading, using the second sensing subsystem, unique identifiers from objects present in the asset management system.

13. The method of claim 12, wherein the performing of the second scan comprises reading, using the second sensing subsystem, unique identifiers stored in radio frequency (RF) identification (RFID) tags associated with objects present in the asset management system.

14. The method of claim 12, wherein the performing of the second scan comprises reading, using the second sensing subsystem, unique identifiers stored in bar-code or quick response (QR) code tags associated with objects present in the asset management system.

15. The method of claim 14, wherein the first sensing subsystem is a camera-based image sensing subsystem comprising one or more cameras, the second sensing subsystem is a tag sensing subsystem for sensing bar-code or quick response (QR) code tags associated with objects in the asset management system, and the first and second sensing subsystems use the same one or more cameras for performing the first and second scans of the storage locations using the first and second sensing modalities.

16. The method of claim 11, wherein the first sensing subsystem is a camera-based image sensing subsystem comprising one or more cameras, the performing the first scan comprises capturing an image of a storage location associated with the particular object, and the determining the presence or absence of the particular object based on the result of the first scan comprises determining whether the object is present in the captured image, and

the second sensing subsystem is a radio frequency (RF)-based sensing subsystem comprising one or more RF identification (RFID) transceivers, the performing the second scan comprises sensing whether an RF-based tag associated with the particular object is present in the asset management system, and confirming the presence or absence of the particular object is based on the sensing whether the RF-based tag associated with the particular object is present in the asset management system.

17. The method of claim 16, further comprising determining a total number of RF-based tags that are expected to be present in the asset management system based on the result of the first scan,

wherein the performing of the second scan of the storage locations comprises using the RF-based sensing subsystem to identify the determined total number of RF-based tags in the asset management system.

18. The method of claim 17, wherein the confirming the presence or absence of the particular object comprises using both the result of the determination made by a camera-based visual sensing modality and a RF-based wireless sensing modality.

19. The method of claim 11, wherein the performing of the second scan comprises reading, using the second sensing subsystem, unique identifiers encoded in tags affixed to objects present in the asset management system.

20. The method of claim 19, wherein the unique identifiers are encoded in uni-dimensional or multi-dimensional bar-codes on the tags affixed to the surfaces of the objects present in the asset management system.