METHOD, PRODUCT, AND SYSTEM FOR UNMANNED VEHICLES IN RETAIL ENVIRONMENTS

• US 20160110701A1
• Filed: 10/14/2015
• Published: 04/21/2016
• Est. Priority Date: 10/15/2014
• Status: Active Grant

• Current Assignee: Toshiba Global Commerce Solutions Holdings Corporation (Toshiba Corporation)
• Original Assignee: Toshiba Global Commerce Solutions Holdings Corporation (Toshiba Corporation)
• Inventors: HERRING, Dean Frederick, JOHNSON, Brad Matthew, SINGH, Ankit, SMITH, Jeffrey John, TEEPLES, Seth
• Granted Patent: US 10,810,648 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G01B 11/00 Measuring arrangements characterised by the use of optical techniques
• CPC Class Codes: G01B 11/02 for measuring length, width or thickness G01B11/08 takes precedence
• CPC Class Codes: G01G 19/40 with provisions for indicating, recording, or computing price or other quantities dependent on the weight indicating means for weighing apparatus G01G23/18; recording means for weighing apparatus G01G23/18; computers in general G06
• CPC Class Codes: G01G 19/4144 for controlling weight of goods in commercial establishments, e.g. supermarket, P.O.S. systems
• CPC Class Codes: G01S 19/13 Receivers
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06F 18/24 Classification techniques
• CPC Class Codes: G06F 2218/12 Classification; Matching
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06Q 10/087 Inventory or stock management, e.g. order filling, procurement or balancing against orders
• CPC Class Codes: G06Q 20/18 involving self-service terminals [SST], vending machines, kiosks or multimedia terminals
• CPC Class Codes: G06Q 20/204 comprising interface for record bearing medium or carrier for electronic funds transfer or payment credit
• CPC Class Codes: G06Q 20/208 Input by product or record sensing, e.g. weighing or scanner processing
• CPC Class Codes: G06Q 20/209 Specified transaction journal output feature, e.g. printed receipt or voice output
• CPC Class Codes: G06Q 20/322 Aspects of commerce using mobile devices [M-devices]
• CPC Class Codes: G06Q 30/016 After-sales
• CPC Class Codes: G06Q 30/0224 based on user history
• CPC Class Codes: G06Q 30/0235 constrained by time limit or expiration date
• CPC Class Codes: G06Q 30/0251 : Targeted advertisements
• CPC Class Codes: G06Q 30/0269 : based on user profile or attribute
• CPC Class Codes: G06Q 30/0609 : Buyer or seller confidence or verification
• CPC Class Codes: G06Q 30/0623 : Item investigation
• CPC Class Codes: G06Q 30/0629 : for generating comparisons
• CPC Class Codes: G06Q 30/0631 : Item recommendations
• CPC Class Codes: G06Q 30/0633 : Lists, e.g. purchase orders, compilation or processing
• CPC Class Codes: G06Q 30/0635 : Processing of requisition or of purchase orders
• CPC Class Codes: G06Q 30/0639 : Item locations
• CPC Class Codes: G06T 11/60 : Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2207/30232 : Surveillance
• CPC Class Codes: G06T 7/66 : of image moments or centre of gravity
• CPC Class Codes: G06V 20/68 : Food, e.g. fruit or vegetables
• CPC Class Codes: G06V 20/80 : Recognising image objects characterised by unique random patterns
• CPC Class Codes: G06V 40/10 : Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: G06V 40/16 : Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: G06V 40/166 : using acquisition arrangements
• CPC Class Codes: G06V 40/172 : Classification, e.g. identification
• CPC Class Codes: G06V 40/179 : metadata assisted face recognition
• CPC Class Codes: G07G 1/0045 : with a code reader for reading of an identifying code of the article to be registered, e.g. barcode reader or radio-frequency identity [RFID] reader
• CPC Class Codes: G07G 1/0054 : with control of supplementary check-parameters, e.g. weight or number of articles
• CPC Class Codes: G07G 1/0063 : with means for detecting the geometric dimensions of the article of which the code is read, such as its size or height, for the verification of the registration
• CPC Class Codes: G07G 1/0072 : with means for detecting the weight of the article of which the code is read, for the verification of the registration weighing combined with recording means, e.g. in weighing scale, G01G19/415
• CPC Class Codes: G07G 3/003 : Anti-theft control theft alarms G08B13/00
• CPC Class Codes: H04N 23/00 : Cameras or camera modules comprising electronic image sensors; Control thereof
• CPC Class Codes: H04N 23/60 : Control of cameras or camera modules
• CPC Class Codes: H04N 7/181 : for receiving images from a plurality of remote sources

Abstract

Methods, computer program products, and systems for operating a retail environment using unmanned vehicles are provided. The methods include observing a person interacting with one or more items with a camera carried by an unmanned vehicle, identifying the one or more items based on data received from the unmanned vehicle, and adding each identified item to a transaction for the person. The methods can further include charging the person for the transaction, presenting promotions, retrieving a desired item, answering questions, following a person, guiding a customer to a location, and showing images of inventory items.

Claims

1. A method for operating a retail environment, comprising:

observing a person interacting with one or more items with a camera carried by an unmanned vehicle;

identifying the one or more items based on data received from the unmanned vehicle; and

adding each identified item to a transaction for the person.

2. The method of claim 1, further comprising:

charging the person for the transaction.

3. The method of claim 1, wherein identifying the one or more items comprises identifying at least one of the items from one or more images captured with the camera carried by the unmanned vehicle.

4. The method of claim 1, wherein the unmanned vehicle is an unmanned aerial vehicle (UAV).

5. The method of claim 1, wherein observing the person comprises directing the unmanned vehicle to capture an image of an unidentified item with the camera.

6. The method of claim 1, further comprising:

receiving a request from the person for a location of an item; and

leading the person with the unmanned vehicle to the location of the item.

7. The method of claim 1, further comprising:

receiving a request from the person for an item; and

directing the unmanned vehicle to retrieve the requested item.

8. A computer program product for operating a retail environment, the computer program product comprising:

observing a person interacting with one or more items with a camera carried by an unmanned vehicle;

identifying the one or more items based on data received from the unmanned vehicle; and

adding each identified item to a transaction for the person.

9. The computer program product of claim 8, wherein the operation further comprises:

charging the person for the transaction.

10. The computer program product of claim 8, wherein identifying the one or more items comprises identifying at least one of the items from one or more images captured with the camera carried by the unmanned vehicle.

11. The computer program product of claim 8, wherein the unmanned vehicle is an unmanned aerial vehicle (UAV).

12. The computer program product of claim 8, wherein observing the person comprises directing the unmanned vehicle to capture an image of an unidentified item with the camera.

13. The computer program product of claim 8, wherein the operation further comprises:

receiving a request from the person for a location of an item; and

leading the person with the unmanned vehicle to the location of the item.

14. The computer program product of claim 8, wherein the operation further comprises:

receiving a request from the person for an item; and

directing the unmanned vehicle to retrieve the requested item.

15. A system for operating a retail environment, comprising:

a computer processor;

an unmanned vehicle with a camera and a network interface, wherein the unmanned vehicle is communicatively connected with the computer processor via the network interface; and

a memory containing program code which, when executed by the computer processor, causes the system to perform an operation comprising;

observing a person interacting with one or more items with the camera;

identifying the one or more items based on data received from the unmanned vehicle; and

adding each identified item to a transaction for the person.

16. The system of claim 15, wherein the operation further comprises charging the person for the transaction.

17. The system of claim 15, wherein the unmanned vehicle is an unmanned aerial vehicle (UAV).

18. The system of claim 15, wherein the operation further comprises outputting a message recommending an item to the person, based on the identity of the item.

19. The system of claim 15, wherein the operation further comprises:

receiving a request from the person for a location of an item; and

leading the person with the unmanned vehicle to the location of the item.

20. The system of claim 15, wherein the operation further comprises:

receiving a request from the person for an item; and

directing the unmanned vehicle to retrieve the requested item.