Wearable devices for courier processing and methods of use thereof

• US 10,198,030 B2
• Filed: 05/15/2015
• Issued: 02/05/2019
• Est. Priority Date: 05/15/2014
• Status: Active Grant

• Current Assignee: Federal Express Corporation (FedEx Corporation)
• Original Assignee: Federal Express Corporation (FedEx Corporation)
• Inventors: Burch, Reuben F.
• Primary Examiner(s): Jansen, II, Michael J
• Application Number:
  US14/713,983
• Publication Number:
  US 20150332075A1
• Time in Patent Office: 1,362 Days
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 1/1696 the I/O peripheral being a printing or scanning device
• CPC Class Codes: G06F 2203/04106 Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06K 2007/10504 Data fields affixed to objects or articles
• CPC Class Codes: G06K 7/10801 Multidistance reading
• CPC Class Codes: G06K 7/10821 further details of bar or optical code scanning devices

Abstract

The disclosed embodiments include wearable devices and methods for performing courier services. In one implementation, the device includes a depth camera for detecting object depths in a field of view, a scanner for decoding visual codes, a speaker for producing audible sounds in response to an electrical signal, memory, and a processor. The processor may execute instructions to detect a scanning event based on a first signal received from the depth camera, determine a scan region associated with the scanning event, provide a second signal to the scanner causing the scanner to decode a visual code located within the scan region, generate scan data based on a third signal received from the scanner, and provide a fourth signal to the speaker causing the speaker to emit a notification sound. The wearable device may also capture signatures, dimension objects, and disable device functions based on time and place restrictions.

Claims

1. A wearable, electronic device for performing courier services, comprising:

a depth camera for detecting object depths in a field of view;

a scanner for decoding visual codes;

a speaker for producing audible sounds in response to an electrical signal;

a memory for storing instructions; and

one or more processors communicatively connected to the depth camera, the scanner, and the speaker, the one or more processors configured to execute the instructions to perform the operations of;

detecting a scanning event based on a first signal received from a bioacoustic sensor, the scanning event comprising a gesture input performed in proximity to a first surface,

determining a scan region associated with the scanning event based on a location and depth of the gesture input,

providing a second signal to the scanner causing the scanner to decode a visual code located within the scan region,

generating scan data based on a third signal received from the scanner, the third signal reflecting information obtained from the visual code, and

providing a fourth signal to the speaker causing the speaker to emit a notification sound in response to generating the scan data.

2. The device of claim 1, further comprising an adjustable connector facilitating wearing the device around an upper portion of a human arm, such that the device has a substantially elliptical cross section when worn.

3. The device of claim 2, further comprising a rugged casing composed substantially of rubber polymers creating a watertight seal around the depth camera, the scanner, and the speaker.

4. The device of claim 1, wherein the device further comprises a communications interface communicatively connected to the one or more processors, and wherein the operations further comprise:

determining whether a communications network having a bandwidth exceeding a bandwidth threshold is currently available based on a fifth signal received from the communications interface; and

providing the scan data to a computing system over the communications network via the communications interface when the communications network is available.

5. The device of claim 4, wherein the operations further comprise:

storing the scan data in memory when the communications network is not available;

scheduling, at a future time slot, a time to determine whether the communications network is available; and

determining whether the communications network is available in accordance with the scheduled time based on a sixth signal received from the communications interface.

6. The device of claim 1, wherein the operations further comprise:

detecting a dimensioning event based on a fifth signal received from the depth camera, the dimensioning event comprising a second gesture input different from the first gesture input;

determining a first region proximate to the second gesture input based on a sixth signal received from the depth camera;

determining an object associated with the first region; and

determining a volume of the object.

7. The device of claim 6, wherein the operations further comprise:

determining a location of an invisible vertex of the object not detected by the depth camera, wherein the location of the invisible vertex is based on an assumed symmetry of the object, and wherein the volume is further based on the location of the invisible vertex.

8. The device of claim 6, wherein determining an object associated with the first region further comprises:

applying an edge detection filter to the sixth signal received from the depth camera;

determining whether the object comprises a second region adjacent to the first region based on a comparison of a depth of a pixel within the second region to a pixel depth of the first region; and

wherein the volume of the object is further based on the second region.

9. The device of claim 1, wherein the device further comprises a projector and a communications interface communicatively connected to the one or more processors, and wherein the operations further comprise:

detecting a signature event based on a fifth signal received from the depth camera, the signature event comprising a second gesture input performed in proximity to a signature surface, the second gesture input different from the first gesture input;

providing a sixth signal to the projector to project a signature interface onto the signature surface;

capturing a signature provided to the signature interface based on a seventh signal received from the depth camera;

processing the signature to generate signature information; and

providing the signature information to a computing system over the communications network via the communications interface.

10. The device of claim 1, further comprising a GPS receiver communicatively connected to the one or more processors, and wherein the operations further comprise:

receiving user credential information associated with a user, the credential information including a unique identifier for the user;

determining at least one of a time restriction or a place restriction for the user based on the unique identifier;

comparing a current device time and a current device location to the at least one of a time restriction or a place restriction, the current device location based on a fifth signal received from the GPS receiver; and

disabling at least function of the device based on the comparison.

11. The device of claim 1, further including a battery for powering the device, and wherein the device delivers electrical power to the battery from at least one of:

a vibration-powered generator for converting device movement into electrical energy;

or

a photoelectric surface placed on a front panel of the device.

12. A computer-implemented method for performing courier services using a wearable electronic device, the wearable electronic device comprising a depth camera for detecting object depths in a field of view, a scanner for decoding visual codes, a bioacoustic sensor for decoding gesture inputs, a speaker for producing audible sounds in response to an electrical signal, and a connector facilitating wearing the device around an upper portion of a human arm, such that the device has a substantially elliptical cross section when worn, the method comprising the following operations performed by one or more processors:

detecting a scanning event based on a first signal received from the bioacoustic sensor, the scanning event comprising a gesture input performed in proximity to a first surface;

determining a scan region associated with the scanning event based on a location and depth of the gesture input;

providing a second signal to the scanner causing the scanner to decode a visual code located within the scan region;

generating scan data based on a third signal received from the scanner, the third signal reflecting information obtained from the visual code; and

providing a fourth signal to the speaker causing the speaker to emit a notification sound in response to generating the scan data.

13. The computer-implemented method of claim 12, wherein the device further comprises a communications interface communicatively connected to the one or more processors, and wherein the operations further comprise:

determining whether a communications network having a bandwidth exceeding a bandwidth threshold is currently available based on a fifth signal received from the communications interface; and

providing the scan data to a computing system over the communications network via the communications interface when the communications network is available.

14. The computer-implemented method of claim 12, wherein the operations further comprise:

storing the scan data in memory when the communications network is not available;

scheduling, at a future time slot, a time to determine whether the communications network is available; and

determining whether the communications network is available in accordance with the scheduled time based on a sixth signal received from the communications interface.

15. The computer-implemented method of claim 12, wherein the operations further comprise:

detecting a dimensioning event based on a fifth signal received from the depth camera, the dimensioning event comprising a second gesture input different from the first gesture input;

determining a first region proximate to the second gesture input based on a sixth signal received from the depth camera;

determining an object associated with the first region; and

determining a volume of the object.

16. The computer-implemented method of claim 15, wherein the operations further comprise:

determining a location of an invisible vertex of the object not detected by the depth camera, wherein the location of the invisible vertex is based on an assumed symmetry of the object, and wherein the volume is further based on the location of the invisible vertex.

17. The computer-implemented method of claim 15, wherein determining an object associated with the first region further comprises:

applying an edge detection filter to the sixth signal received from the depth camera;

determining whether the object comprises a second region adjacent to the first region based on a comparison of a depth of a pixel within the second region to a pixel depth of the first region; and

wherein the volume of the object is further based on the second region.

18. The computer-implemented method of claim 12, wherein the device further comprises a projector and a communications interface communicatively connected to the one or more processors, and wherein the operations further comprise:

detecting a signature event based on a fifth signal received from the depth camera, the signature event comprising a second gesture input performed in proximity to a signature surface, the second input different from the first gesture input;

providing a sixth signal to the projector to project a signature interface onto the signature surface;

capturing a signature provided to the signature interface based on a seventh signal received from the depth camera;

processing the signature to generate signature information; and

providing the signature information to a computing system over the communications network via the communications interface.

19. The computer-implemented method of claim 12, wherein the device further comprises a GPS receiver communicatively connected to the one or more processors, and wherein the operations further comprise:

receiving user credential information associated with a user, the credential information including a unique identifier for the user;

determining at least one of a time restriction or a place restriction for the user based on the unique identifier;

comparing a current device time and a current device location to the at least one of a time restriction or place restriction, the current device location based on a fifth signal received from the GPS receiver; and

disabling at least function of the device based on the comparison.

20. The computer-implemented method of claim 12, wherein the device further includes a battery, and wherein the operations further comprise delivering electrical power to the battery from at least one of:

a vibration-powered generator for converting device movement into electrical energy;

or

a photoelectric surface placed on a front panel of the device.