Bundled unit identification and tracking

• US 9,990,521 B2
• Filed: 09/06/2016
• Issued: 06/05/2018
• Est. Priority Date: 09/06/2016
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Aalund, Martin Peter, Battles, Jon Stuart, Hill, Michael Barrett
• Primary Examiner(s): ELLIS, SUEZU Y
• Application Number:
  US15/257,806
• Publication Number:
  US 20180068139A1
• Time in Patent Office: 637 Days
• Field of Search: 235385, 705 28
• CPC Class Codes: G06K 7/10722 Photodetector array or CCD scanning
• CPC Class Codes: G06K 7/1413 1D bar codes
• CPC Class Codes: G06K 7/1417 2D bar codes
• CPC Class Codes: G06Q 10/0832 Special goods or special handling procedures, e.g. handling of hazardous or fragile goods
• CPC Class Codes: G06Q 10/0833 Tracking

Abstract

A unique digital identifier of a bundled set of items may be generated based on imaging data or other information captured from the bundled set, stored, and used for any purpose. The imaging data or other information may depict or describe the bundled set after the items have been wrapped or otherwise combined in a unique manner using a binding agent, e.g., a sheet of shrink wrap, a rubber band, or any other materials. Unique digital identifiers of bundled sets of items may be stored in association with information regarding the items. When a bundled set of items is recognized based on its unique digital identifier, information regarding the bundled set may be accessed and used for any purpose, such as to identify a common container for the bundled set based on attributes of any of the items or an order with which the bundled set is associated.

Claims

1. A computer-implemented method comprising:

capturing at least a first image of at least a portion of a first bundled set of items by a first imaging device at a first time, wherein the first bundled set of items comprises at least a first item wrapped at least in part by a first binding agent, wherein the portion of the first bundled set of items includes a portion of the first binding agent, and wherein the first bundled set of items is in a first location at the first time;

generating a first digital identifier of the first bundled set of items based at least in part on the first image by at least one computer processor;

identifying information regarding the first bundled set of items by the at least one computer processor;

storing the information regarding the first bundled set of items in association with the first digital identifier in the at least one data store;

causing the first bundled set of items to be transported from the first location to a second location prior to a second time;

capturing at least a second image of at least the portion of the first bundled set of items by a second imaging device at the second time, wherein the first bundled set of items is in the second location at the second time;

generating a second digital identifier of the first bundled set items based at least in part on the second image by the at least one computer processor;

identifying a plurality of digital identifiers of bundled sets of items stored in at least one data store, wherein each of the digital identifiers was generated prior to the first time based at least in part on at least one image of a bundled set of items comprising at least one item wrapped at least in part by at least one binding agent;

performing a comparison of the second digital identifier to at least some of the plurality of digital identifiers according to at least one image comparison algorithm by the at least one computer processor;

selecting one of the plurality of digital identifiers based at least in part on the comparison of the second digital identifier to the at least some of the plurality of digital identifiers by the at least one computer processor, wherein the selected one of the plurality of digital identifiers is the first digital identifier;

identifying information stored in association with the selected one of the plurality of digital identifiers in the at least one data store, wherein the information stored in association with the selected one of the plurality of digital identifiers is the information regarding the first bundled set of items; and

determining that the information stored in association with the selected one of the plurality of digital identifiers in the at least one data store is associated with the first bundled set of items.

2. The computer-implemented method of claim 1, wherein the first digital identifier comprises at least a portion of the first image depicting at least the portion of the first binding agent, and

wherein each of the plurality of digital identifiers of bundled sets of items comprises a portion of at least one image of a bundled set of items comprising at least one item wrapped at least in part by at least one binding agent.

3. The computer-implemented method of claim 1, wherein the first image is a first depth image of at least the portion of the first bundled set of items at the first time, and

wherein generating the first digital identifier of the first bundled set of items comprises:

generating a first point cloud representative of at least the portion of the first bundled set of items based at least in part on the first depth image by the at least one computer processor,

wherein each of the at least some of the plurality of digital identifiers comprises a point cloud of at least a portion of a bundled set of items comprising at least one item wrapped at least in part by at least one binding agent.

4. The computer-implemented method of claim 1, wherein generating the first digital identifier of the first bundled set of items comprises:

capturing at least a third image of at least the first item prior to wrapping at least the first item at least in part by the first binding agent prior to the first time; and

generating a fourth image based at least in part on the first image and the third image, wherein the fourth image comprises pixel values corresponding to at least the portion of the first binding agent, and wherein the first digital identifier comprises the fourth image,

wherein each of the plurality of digital identifiers of bundled sets of items comprises a portion of an image of a bundled set of items comprising at least one item wrapped at least in part by at least one binding agent prior to the first time, and

wherein selecting the one of the plurality of digital identifiers comprises;

selecting the one of the plurality of digital identifiers including the pixel values corresponding to at least the portion of the first binding agent.

5. The computer-implemented method of claim 4, wherein generating the fourth image comprises:

determining differences between pixel values of the third image and pixel values of the first image according to an image subtraction algorithm,

wherein the third image comprises the differences between the pixel values of the third image and the pixel values of the first image.

6. The computer-implemented method of claim 1, wherein the information stored in association with the selected one of the plurality of identifiers comprises at least one of:

a first attribute of the first bundled set of items;

a second attribute of the first item;

or

a third attribute of an order for at least the first item.

7. The computer-implemented method of claim 6, wherein the first attribute of the first bundled set of items is a dimension of the first bundled set of items,

wherein the second attribute is a handling instruction for the first item, and

wherein the third attribute is one of a destination for at least the first item or an identity of a customer that placed the order for at least the first item.

8. The computer-implemented method of claim 6, further comprising:

selecting a container for the first bundled set of items based at least in part on the information stored in association with the selected one of the plurality of digital identifiers; and

causing the first bundled set of items to be packaged in the selected container.

9. The computer-implemented method of claim 1, wherein the first binding agent comprises a length of at least one of a paper, a plastic, a rubber, a metallic material or a semi-metallic material.

10. The computer-implemented method of claim 1, wherein the first binding agent is wrapped around a first circumference of at least the first item.

11. The computer-implemented method of claim 10, wherein the first bundled set of items further comprises at least one of:

a second binding agent wrapped around the first circumference of at least the first item;

or

a third binding agent wrapped around a second circumference of at least the first item.

12. The computer-implemented method of claim 1, wherein the first bundled set of items consists of the first item wrapped at least in part by the first binding agent.

13. A computer-implemented method comprising:

capturing at least a first image of at least a portion of a first bundled set of items by a first imaging device at a first time, wherein the first bundled set of items comprises at least a first item wrapped at least in part by a first binding agent, and wherein the portion of the first bundled set of items includes a portion of the first binding agent;

generating a first digital identifier of the first bundled set of items based at least in part on the first image by at least one computer processor;

identifying a plurality of digital identifiers of bundled sets of items stored in at least one data store, wherein each of the digital identifiers was generated prior to the first time based at least in part on at least one image of a bundled set of items comprising at least one item wrapped at least in part by at least one binding agent;

performing a comparison of the first digital identifier to at least some of the plurality of digital identifiers according to at least one image comparison algorithm by the at least one computer processor;

selecting one of the plurality of digital identifiers based at least in part on the comparison to the at least some of the plurality of digital identifiers by the at least one computer processor;

identifying information stored in association with the selected one of the plurality of digital identifiers in the at least one data store;

determining that the information stored in association with the selected one of the plurality of digital identifiers in the at least one data store is associated with the first bundled set of items;

selecting a container for the first bundled set of items based at least in part on the information stored in association with the selected one of the plurality of digital identifiers; and

causing the first bundled set of items to be packaged in the selected container.

14. The computer-implemented method of claim 13, further comprising:

capturing at least a second image of at least the portion of the first bundled set of items by a second imaging device at a second time, wherein the second time is prior to the first time;

generating a second digital identifier of the first bundled set of items based at least in part on the second image by the at least one computer processor, wherein the selected one of the plurality of digital identifiers is the second digital identifier;

identifying information regarding the first bundled set of items by the at least one computer processor; and

storing the information regarding the first bundled set of items in association with the second digital identifier in the at least one data store, wherein the information regarding the first bundled set of items is the information stored in association with the selected one of the plurality of digital identifiers.

15. The computer-implemented method of claim 14, wherein the first bundled set of items is in a first location at the first time,

wherein the first bundled set of items is in a second location at the second time, and

wherein the computer-implemented method further comprises:

causing the first bundled set of items to be transported from the second location to the first location prior to the first time.

16. The computer-implemented method of claim 13, wherein the first digital identifier comprises at least the portion of the first image depicting at least a portion of the first binding agent, and

wherein each of the plurality of digital identifiers of bundled sets of items comprises a portion of at least one image of a bundled set of items comprising at least one item wrapped at least in part by at least one binding agent.

17. The computer-implemented method of claim 13, wherein the first image is a first depth image of at least the portion of the first bundled set of items at the first time, and

wherein generating the first digital identifier of the first bundled set of items comprises:

generating a first point cloud representative of at least the portion of the first bundled set of items based at least in part on the first depth image by the at least one computer processor,

wherein each of the at least some of the plurality of digital identifiers comprises a point cloud of at least a portion of a bundled set of items comprising at least one item wrapped at least in part by at least one binding agent.

18. The computer-implemented method of claim 13, wherein generating the first digital identifier of the first bundled set of items comprises:

capturing at least a third image of at least the first item prior to wrapping at least the first item at least in part by the first binding agent prior to the first time;

determining differences between pixel values of the third image and pixel values of the first image according to an image subtraction algorithm; and

generating a fourth image based at least in part on the first image and the third image, wherein the fourth image comprises the differences between the pixel values of the third image and the pixel values of the first image, wherein the first digital identifier comprises the fourth image,

wherein each of the plurality of digital identifiers of bundled sets of items comprises a portion of an image of a bundled set of items comprising at least one item wrapped at least in part by at least one binding agent prior to the first time, and

wherein selecting the one of the plurality of digital identifiers comprises;

selecting the one of the plurality of digital identifiers including the pixel values corresponding to at least the portion of the first binding agent.

19. The computer-implemented method of claim 13, wherein the information stored in association with the selected one of the plurality of identifiers comprises at least one of:

a first attribute of the first bundled set of items, wherein the first attribute of the first bundled set of items is a dimension of the first bundled set of items;

a second attribute of the first item, wherein the second attribute is a handling instruction for the first item;

or

a third attribute of an order for at least the first item, wherein the third attribute is one of a destination for at least the first item or an identity of a customer that placed the order for at least the first item.

20. The computer-implemented method of claim 13, wherein the first binding agent comprises a length of at least one of a paper, a plastic, a rubber, a metallic material or a semi-metallic material.

21. The computer-implemented method of claim 13, wherein the first binding agent is wrapped around a first circumference of at least the first item, and

wherein the first bundled set of items further comprises at least one of:

a second binding agent wrapped around the first circumference of at least the first item;

or

a third binding agent wrapped around a second circumference of at least the first item.

22. The computer-implemented method of claim 13, wherein the first bundled set of items consists of the first item wrapped at least in part by the first binding agent.