Intelligent service robot and related systems and methods

• US 10,311,400 B2
• Filed: 12/05/2016
• Issued: 06/04/2019
• Est. Priority Date: 10/24/2014
• Status: Active Grant

• Current Assignee: Fellow Incorporated
• Original Assignee: Fellow Incorporated
• Inventors: Mascorro Medina, Marco O., Fan, Zhengqin, Ranatunga, Thavidu, Sinha, Utkarsh, Kaza, Sivapriya, Din, Justin, Barry, Daniel T., Krishna, Varun, Mahendran, Jagadish
• Primary Examiner(s): Patton, Spencer D
• Application Number:
  US15/369,812
• Publication Number:
  US 20180075403A1
• Time in Patent Office: 911 Days
• CPC Class Codes: B25J 9/1697 Vision controlled systems
• CPC Class Codes: G06Q 10/087 Inventory or stock management, e.g. order filling, procurement or balancing against orders
• CPC Class Codes: G06Q 30/016 After-sales
• CPC Class Codes: Y10S 901/01 Mobile robot
• CPC Class Codes: Y10S 901/47 Optical

Abstract

A robot for providing intelligent service within a facility includes a locomotion platform, an upper sensor for detecting objects within an upper field of view of the robot, a lower sensor for detecting objects within a lower field of view of the robot, a display and a robot computer in communication with the locomotion platform, the upper sensor and the lower sensor. The robot computer is configured to inventory products within the commercial facility and provide inventory discrepancy data to a user at a computing station.

Claims

1. A robotic system for providing intelligent inventory service within a commercial facility, comprising:

a robot having a locomotion platform, an upper sensor for detecting objects within an upper field of view of the robot, a lower sensor for detecting objects within a lower field of view of the robot, a display, and a robot computer in communication with the locomotion platform, the upper sensor and the lower sensor, the computer having a processor and computer-readable memory; and

a support station located remote to the robot, the support station having a support station display and a support station computer in communication with the support station display, the support station computer having a processor and computer-readable memory, wherein the support station computer further comprises programmable code executable with the processor, wherein the programmable code has a digital inventory management interface with a dashboard displayable on a GUI of the support station computer, and wherein the digital inventory management interface further comprises a graphical map of the commercial facility and an information center portion, wherein the graphical map identifies locations on the graphical ma which represent inventory discrepancies, wherein selection of the locations retrieves textual data on the inventory discrepancies at that location,

wherein the robot is configured to visually capture data of items for sale within the commercial facility and communicate at least a portion of the captured data to the support station.

2. The robotic system of claim 1, wherein the robot computer is further configured to receive commands from an operator at the support station and to operate based on the received commands.

3. The robotic system of claim 2, wherein the robot computer is further configured to inventory products within the commercial facility by:

capturing a visual record of products within the commercial facility; and

processing the visual record of the products to determine a quantity of the products within the commercial facility; and

compare the determined quantity of products to an inventory record.

4. The robotic system of claim 1, further comprising a computing center in communication with the robot computer, wherein the computing center h a digital inventory database accessible to the robot computer.

5. The robotic system of claim 1, wherein the robot computer is further configured to navigate within the commercial facility using a map stored on the robot computer and at least one of the upper sensor and lower sensor.

6. The robotic system of claim 1, further comprising a product scanning device configured to capture a visual record of products within the commercial facility.

7. The robotic system of claim 6, wherein the product scanning device further comprises at least one of:

a camera, a 2D video camera, a 3D video camera, a laser rangefinder, a scanner, a structure light scanner, an ultrasound scanner, a RADAR scanner, a LIDAR scanner, and a RFID scanner.

8. The robotic system of claim 1, wherein the commercial facility includes at least one of:

a shopping store, a mall, a grocery store, a warehouse, an airport, a bus station, a train station, and a market.

9. The system of claim 1, wherein the digital inventory management interface further comprises a shelf page, wherein the shelf page displays a photograph taken by the robot of a product within the commercial facility.

10. The system of claim 9, wherein the photograph further comprises an overlaid graphic indicating a position within the photograph where a missing product should be located.

11. The system of claim 1, wherein the robot further comprises a product scanning device configured to capture a visual record of products within the commercial facility, wherein the product scanning device further comprises at least one of:

a camera, a 2D video camera, a 3D video camera, a laser rangefinder, a scanner, a structure light scanner, an ultrasound scanner, a RADAR scanner, a LIDAR scanner, and a RFID scanner.

12. A robotic system for providing intelligent inventory service within a commercial facility, comprising:

a robot having a locomotion platform, an upper sensor for detecting objects within an upper field of view of the robot, a lower sensor for detecting objects within a lower field of view of the robot, a display, and a robot computer in communication with the locomotion platform, the upper sensor and the lower sensor, the computer having a processor and computer-readable memory; and

a support station located remote to the robot, the support station having a support station display and a support station computer in communication with the support station display, the support station computer having a processor and computer-readable memory,

wherein the robot is configured to visually capture data of items for sale within the commercial facility and communicate at least a portion of the captured data to the support station,

wherein the support station computer further comprises programmable code configured to be executed with the processor, wherein the programmable code has a trends and data analysis interface with a dashboard displayable on a GUI of the support station computer, wherein historical inventory data of the commercial facility is viewable on the GUI of the support station computer.

13. A method of inventorying a commercial facility with a robot, the method comprising:

providing a robot within a commercial facility, wherein the robot has a locomotion platform, an upper sensor for detecting objects within an upper field of view of the robot, a lower sensor for detecting objects within a lower field of view of the robot, a display, a product scanning device configured to capture a visual record of products within the commercial facility, and a robot computer in communication with the locomotion platform, the upper sensor, the lower sensor, and the product scanning device;

providing a support station computer located remotely from the robot, wherein the robot computer is configured to communicate with support station computer, wherein the support station computer has a digital inventory management interface with a dashboard displayable on a GUI of the support station computer, wherein the digital inventory management interface further comprises a graphical map of the commercial facility, wherein the graphical map identifies locations on the graphical map which represent inventory discrepancies, wherein selection of the locations retrieves textual data on the inventory discrepancies at that location;

capturing a visual record of products within the commercial facility with the product scanning device; and

processing the visual record of the products to determine inventory data of the products within the commercial facility.

14. The method of claim 13, wherein processing the visual record of the products to determine inventory data of the products within the commercial facility further comprises comparing a determined quantity of products to a digital inventory database within a computing center positioned remote from the robot.

15. The method of claim 13, wherein capturing the visual record of products within the commercial facility with the product scanning device further comprises scanning products within the commercial facility with at least one of a camera, a 2D video camera, a 3D video camera, a laser rangefinder, a scanner, a structure light scanner, an ultrasound scanner, a RADAR scanner, a LIDAR scanner, and a RFID scanner carried on the robot, wherein the robot moves within the commercial facility.

16. The method of claim 15, wherein the robot records a position within the commercial facility corresponding to a location where the visual record of products is captured.

17. The method of claim 13, further comprising providing a user a digital inventory management interface with a dashboard displayable on a GUI of the support station computer.