System and method for picking validation

• US 10,810,715 B2
• Filed: 09/25/2015
• Issued: 10/20/2020
• Est. Priority Date: 10/10/2014
• Status: Active Grant

• Current Assignee: Hand Held Products Incorporated (Honeywell International Inc.)
• Original Assignee: Hand Held Products Incorporated (Honeywell International Inc.)
• Inventors: Chamberlin, James
• Primary Examiner(s): Logan, Kyle O
• Application Number:
  US14/865,797
• Publication Number:
  US 20160101936A1
• Time in Patent Office: 1,852 Days
• Field of Search: 700214
• CPC Class Codes: B65G 1/1371 with data records
• CPC Class Codes: B65G 1/1375 the orders being assembled on a commissioning stacker-crane or truck
• CPC Class Codes: G01B 11/2522 the position of the object changing and being recorded
• CPC Class Codes: G05B 19/402 characterised by control arrangements for positioning, e.g. centring a tool relative to a hole in the workpiece, additional detection means to correct position G05B19/19 takes precedence
• CPC Class Codes: G05B 2219/31319 Use data groups as inventory control value, adapt inventory need to new data
• CPC Class Codes: G06T 2207/10021 Stereoscopic video; Stereoscopic image sequence
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: H04N 13/204 using stereoscopic image cameras stereoscopic photography G03B35/00
• CPC Class Codes: H04N 13/254 in combination with electromagnetic radiation sources for illuminating objects
• CPC Class Codes: H04N 13/282 for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture

Abstract

A system and a method for validating items gathered (i.e., picked) as part of a logistics process are disclosed. The picking system uses one or more sensors to sense the physical attributes of an item (e.g., weight, color, size/shape, etc.). The sensed-physical attributes are compared to expected-physical attributes stored for the item. Based on the comparison, a user may receive feedback confirming or rejecting the picked item. In some embodiments, the picking system uses the collected physical data to improve, or add to, the expected-physical attributes. The picking system may also be integrated with a powered-industrial vehicle and/or a warehouse management system to improve usability and effectiveness.

Claims

1. A method for validating a picking operation, the method comprising:

picking an item;

placing the picked item on a platform in a field of view of a dimensioning system communicatively coupled to a computing device, wherein the platform is supported by a powered-industrial vehicle;

sensing, using a sensor, a first set of physical attributes of the picked item, wherein the sensor comprises the dimensioning system, a scale, and a digital camera, wherein the sensing is comprised of sensing, using the dimensioning system, dimensions of the picked item while the picked item is on the platform in the field of view of the dimensioning system, wherein at least a portion of the dimensioning system is supported by the powered-industrial vehicle at a higher elevation than the platform so that the field of view of the dimensioning system is directed downwardly toward the platform and multiple sides of the picked item are in the field of view of the dimensioning system, and wherein at least a portion of the digital camera is supported by the powered-industrial vehicle at a higher elevation than the platform so that a field of view of the digital camera is directed downwardly toward the platform;

comparing, using the computing device, the first set of sensed-physical attributes to expected-physical attributes stored on the computing device, wherein the comparing is comprised of comparing, using the computing device, the sensed dimensions of the picked item to expected dimensions of the picked item stored on the computing device; and

in response to the first set of sensed-physical attributes not matching the expected-physical attributes;

generating a picking-error alert, comprising generating the picking-error alert if the sensed dimensions of the picked item do not match the expected dimensions of the picked item, and

updating, in the computing device, the expected-physical attributes based on the first set of sensed-physical attributes and a second set of sensed-physical attributes collected at a different time during a different picking operation.

2. The method according to claim 1, wherein the sensed dimensions of the picked item comprise two-dimensional and/or three-dimensional measurement corresponding to the picked item'"'"'s shape/size.

3. The method according to claim 1, wherein the first set of sensed-physical attributes comprises the picked item'"'"'s weight.

4. The method according to claim 1, wherein the first set of sensed-physical attributes comprises the picked item'"'"'s visual appearance.

5. The method according to claim 1, wherein the first set of sensed-physical attributes comprises (i) two-dimensional and/or three-dimensional measurement corresponding to the picked item'"'"'s shape/size, (ii) the picked item'"'"'s weight, and (iii) the picked item'"'"'s visual appearance.

6. The method according to claim 1, wherein the picking-error alert is (i) an audio alert, a visual alert, or a haptic alert or (ii) combinations thereof.

7. The method according to claim 1, further comprising:

in response to the first set of sensed-physical attributes matching the expected-physical attributes, then updating the expected-physical attributes using the first set of sensed-physical attributes, and

storing the updated one or more expected-physical attributes on the computing device.

8. The method according to claim 1, further comprising:

in response to the first set of sensed-physical attributes matching the expected-physical attributes, generating a picking-confirmation alert.

9. The method according to claim 8, wherein the picking-confirmation alert is (i) an audio alert, a visual alert, or a haptic alert or (ii) combinations thereof.

10. A powered-industrial vehicle, comprising:

a user interface;

at least one sensor configured to;

(i) sense physical attributes of an item placed on a platform of the powered-industrial vehicle during a picking operation and (ii) output physical data; and

a computing device communicatively coupled to the user interface and the at least one sensor, wherein the computing device is configured to;

(i) generate a first set of sensed-physical attributes for the item based on the physical data,

(ii) retrieve a first set of expected-physical attributes for the item from the computing device'"'"'s memory,

(iii) compare the first set of sensed-physical attributes to the first set of expected-physical attributes, and

(iv) based on the comparison, transmit an alert message to the user interface, wherein the at least one sensor comprises;

a dimensioning system having a field of view configured so that the dimensioning system can sense physical attributes of the item upon the platform of the powered-industrial vehicle, and the first set of sensed-physical attributes comprises sensed dimensions of the item, wherein at least a portion of the dimensioning system is supported by the powered-industrial vehicle at a higher elevation than the platform so that the field of view of the dimensioning system is directed downwardly toward the platform,

a scale, and the first set of sensed-physical attributes comprises sensed weight of the item upon the platform of the powered-industrial vehicle, and

a digital camera, and the first set of sensed-physical attributes comprises sensed visual appearance of the item upon the platform of the powered-industrial vehicle, wherein at least a portion of the digital camera is supported by the powered-industrial vehicle at a higher elevation than the platform so that a field of view of the digital camera is directed downwardly toward the platform, and

wherein the computing device being configured to compare the first set of sensed-physical attributes to the first set of expected-physical attributes is comprised of;

the computing device being configured to compare the sensed dimensions of the item to expected dimensions of the item,

the computing device being configured to compare the sensed weight of the item to expected weight of the item, and

the computing device being configured to compare the sensed visual appearance of the item to expected visual appearance of the item, and

wherein to transmit the alert message the computing device being configured to;

transmit a picking-error alert if the sensed dimensions of the item do not match the expected dimensions of the item; and

update the first set of expected-physical attributes to generate a second set of expected-physical attributes, based on the first set of sensed-physical attributes and a second set of sensed-physical attributes collected at a different time during a different picking operation.

11. The powered-industrial vehicle according to claim 10, wherein the sensed dimensions of the item comprise two-dimensional and/or three-dimensional measurement corresponding to the item'"'"'s shape/size.

12. The powered-industrial vehicle according to claim 10, wherein the alert message comprises (i) an indication that the wrong item has been placed on the powered-industrial vehicle or (ii) an indication that the correct item has been placed on the powered-industrial vehicle.

13. A picking system, comprising:

a host computer for creating a pick list, the pick list comprising one or more items to be picked during a picking operation and a first set of expected-physical attributes corresponding to the one or more items to be picked;

at least one sensor configured to;

(i) sense physical attributes of a picked item and (ii) output physical data;

a mobile computer communicatively coupled to the host computer and the at least one sensor, wherein the mobile computer comprises;

a user interface,

a memory for storing the pick list, and

a processor communicatively coupled to the memory, the user interface, and the at least one sensor, wherein the processor is configured to;

(i) generate, based on the physical data, a first set of sensed-physical attributes corresponding to the picked item,

(ii) retrieve the first set of expected-physical attributes for the picked item from the memory,

(iii) compare the first set of sensed-physical attributes to the first set of expected-physical attributes,

(iv) based on the comparison, create an alert message, and

(v) transmit the alert message to the user a powered-industrial vehicle including a platform,

wherein the at least one sensor comprises;

a dimensioning system having a field of view configured so that the dimensioning system can sense physical attributes of the picked item, and the first set of sensed-physical attributes comprises sensed dimensions of the picked item while the picked item is on the platform, wherein at least a portion of the dimensioning system is supported by the powered-industrial vehicle at a higher elevation than the platform so that the field of view of the dimensioning system is directed downwardly toward the platform,

a scale, and the first set of sensed-physical attributes comprises sensed weight of the picked item while the picked item is on the platform, and

a digital camera, and the first set of sensed-physical attributes comprises sensed visual appearance of the picked item while the picked item is on the platform, portion of the digital camera is supported by the powered-industrial vehicle at a higher elevation than the platform so that a field of view of the digital camera is directed downwardly toward the platform,

wherein the processor being configured by software to compare the first set of sensed-physical attributes to the set of expected-physical attributes is comprised of;

the processor being configured by software to compare the sensed dimensions of the picked item to expected dimensions of the picked item,

the processor being configured to compare the sensed weight of the picked item to expected weight of the picked item, and

the processor being configured to compare the sensed visual appearance of the picked item to expected visual appearance of the picked item, and

wherein the processor being configured to;

transmit the alert message to the user interface, comprising transmitting a picking-error alert if the sensed dimensions of the item do not match the expected dimensions of the item, and

update the first set of expected-physical attributes to generate a second set of expected-physical attributes, based on the first set of sensed-physical attributes and a second set of sensed-physical attributes collected at a different time during a different picking operation.

14. The picking system according to claim 13, wherein the sensed dimensions of the picked item comprise two-dimensional and/or three-dimensional measurement corresponding to the picked item'"'"'s shape/size.