Providing computer-based instructions without displays

• US 9,477,888 B1
• Filed: 03/27/2014
• Issued: 10/25/2016
• Est. Priority Date: 03/27/2014
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Lewis, Kimberly Anne
• Primary Examiner(s): WANG, JIN CHENG
• Application Number:
  US14/227,667
• Time in Patent Office: 943 Days
• Field of Search: 345/8, 345/633, 359/630, 705/26.9, 705/340, 705/338
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/0123 comprising devices increasing the field of view
• CPC Class Codes: G02B 2027/0127 comprising devices increasing the depth of field
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06Q 10/083 Shipping
• CPC Class Codes: G06Q 10/0835 Relationships between shipper or supplier and carriers
• CPC Class Codes: G06Q 10/08355 Routing methods
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/0639 Item locations

Abstract

Computer-based instructions for performing a task may be provided to workers using system components that display such instructions in a convenient manner and location that permit the workers to perform the task without diverting their attention from their workstations. Such instructions may be projected onto all or a portion of a surface of the workstation, or onto a lens or other optical element of a wearable computer device, thereby enabling the worker to maintain his or her focus on the task at hand, rather than having to look away at a mounted computer monitor or printed text in order to receive the instructions.

Claims

1. A wearable computer system comprising:

an imaging device mounted to a frame;

an eye-level display device mounted to the frame, wherein the eye-level display device comprises an optical element; and

a computing device in communication with at least one of the sensor device or the display device,

wherein the computing device is configured to at least;

recognize an item at a workstation using the imaging device, wherein the item is within a field of view of the imaging device;

in response to recognizing the item, determine a shipping requirement for the recognized item;

identify instructions for preparing the recognized item in accordance with the shipping requirement at the workstation;

determine locations of a plurality of resources for preparing the recognized item in accordance with the shipping requirement at the workstation;

select a first position of a first window on the optical element of the eye-level display device based at least in part on a first location of a first resource for preparing the recognized item in accordance with a first instruction, wherein the first resource is not within the field of view of the imaging device; and

render the first instruction in the first window in the first position on the optical element of the eye-level display device.

2. The wearable computer system of claim 1, wherein the computing device is further configured to at least:

transmit a request for the instructions for preparing the recognized item to at least one server over a network; and

receive the instructions for preparing the recognized item from the at least one server over the network,

wherein the locations of the plurality of resources for preparing the recognized item in accordance with the shipping requirement are determined in response to receiving the instructions for preparing the recognized item in accordance with the shipping requirement.

3. The wearable computer system of claim 1, wherein the computing device is further configured to at least:

generate the instructions for preparing the recognized item based at least in part on the first location of the first resource at the workstation,

wherein the instructions are generated in response to determining the locations of the plurality of resources for preparing the recognized item in accordance with the shipping requirement.

4. The wearable computer system of claim 1, wherein the computing device is further configured to at least:

receive an acknowledgement of a performance of the first instruction;

select a second position of a second window on the optical element of the eye-level display device based at least in part on a second location of a second resource for preparing the recognized item in accordance with a second instruction, wherein the second resource is not within the field of view of the imaging device; and

render the second instruction in the second position in the second window on the optical element of the eye-level display device.

5. A method for providing instructions for completing a task at a workstation, the method comprising:

identifying information regarding the task using at least one computer processor;

determining at least one requirement for completing the task using the at least one computer processor;

identifying information regarding at least one resource for completing the task in accordance with the at least one requirement using the at least one computer processor, wherein the information regarding the at least one resource comprises a location of the at least one resource at the workstation;

generating at least one instruction for completing the task with the at least one resource using the at least one computer processor, wherein the at least one instruction is generated based at least in part on the information regarding the task and the at least one requirement for completing the task; and

causing information regarding the at least one instruction to be displayed by a wearable computer device, wherein information regarding the at least one instruction comprises at least one identifier of the at least one resource.

6. The method of claim 5, wherein the task comprises preparing an item for delivery at the workstation, and

wherein identifying the information regarding the task comprises:

identifying the item in a vicinity of the workstation.

7. The method of claim 6, wherein identifying the item in the vicinity of the workstation comprises at least one of:

interpreting at least a first identifier on an exterior surface of the item;

interpreting at least a second identifier on one of a tote associated with the item, a cart associated with the item or a bin associated with the item;

recognizing at least one of a data transfer device associated with the item or a vehicle associated with the item;

determining a mass of the item;

or

receiving a message comprising the information regarding the item.

8. The method of claim 6, wherein identifying the information regarding the task comprises:

identifying a destination for the item;

or

identifying an order including the item.

9. The method of claim 6, wherein identifying the information regarding the at least one resource for completing the task in accordance with the at least one requirement comprises:

determining an inventory of a plurality of resources available at the workstation using the at least one computer processor, wherein the plurality of resources comprises the at least one resource.

10. The method of claim 9, further comprising:

determining a location of at least some of the plurality of resources available at the workstation, wherein the at least some of the plurality of resources comprises the at least one resource.

11. The method of claim 5, wherein the at least one resource is one of a container, a type of dunnage, a label or an adhesive.

12. The method of claim 6, wherein the at least one requirement for completing the task at the workstation is determined based on at least one attribute of the item.

13. The method of claim 6, wherein generating the at least one instruction for completing the task at the workstation with the at least one resource comprises:

generating a plurality of instructions for preparing the item for delivery with the at least one resource, wherein the plurality of instructions comprises the at least one instruction.

14. The method of claim 13, wherein the at least one instruction comprises at least one of:

an instruction intrinsic to the item;

an instruction for preparing a container;

an instruction for providing dunnage in the container;

an instruction for placing the item in the container;

an instruction for sealing the container;

or

an instruction for causing a delivery of the container to a destination.

15. The method of claim 13, wherein causing the information regarding the at least one instruction to be displayed by the wearable computer device comprises:

projecting the at least one instruction into a field of view of a user of the wearable computer device.

16. The method of claim 13, wherein causing the information regarding the at least one instruction to be displayed by the wearable computer device comprises:

projecting a first instruction into a field of view of a user of the wearable computer device, wherein the first instruction is one of the plurality of instructions;

receiving an acknowledgment of the performance of the first instruction from the user; and

projecting a second instruction into the field of view of the user of the wearable computer device, wherein the second instruction is one of the plurality of instructions.

17. The method of claim 5, wherein the information regarding the at least one identifier is a visual reference to the location of the at least one resource at the workstation.

18. The method of claim 17, wherein the visual reference virtually points in a direction of the location of the at least one resource at the workstation.

19. A method comprising:

identifying an item to be prepared for delivery to a destination by at least one computer processor;

determining at least one attribute of the item by the at least one computer processor;

determining a location of at least one resource for preparing the item for delivery at a workstation by the at least one computer processor;

generating at least one process step for preparing the item for delivery at the workstation with the at least one resource by the at least one computer processor, wherein the at least one process step is generated based at least in part on the at least one attribute of the item; and

causing a display of information regarding the at least one process step for preparing the item for delivery onto an optical element of a wearable computer device,

wherein the information regarding the at least one process step comprises a visual reference to the location of the at least one resource.

20. The method of claim 19, wherein the at least one attribute is one of a dimension of the item, a mass of the item, a source of the item or a destination for the item.

21. The method of claim 20, wherein the at least one resource is one of a container, a type of dunnage to be included in the container, an order description to be included in the container, a gift card to be included in the container, an adhesive for sealing the container or a label to be affixed to the container.

22. The method of claim 19, further comprising:

selecting a position for the display of the information regarding the at least one process step for preparing the item onto the optical element based at least in part on the location of the at least one resource; and

causing the display of the information regarding the at least one process step for preparing the item in the selected position.