Drone and drone-based system and methods for helping users assemble an object

• US 10,372,127 B2
• Filed: 07/18/2016
• Issued: 08/06/2019
• Est. Priority Date: 07/18/2016
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Chefalas, Thomas E., Kochut, Andrzej, Pickover, Clifford A., Weldemariam, Komminist
• Primary Examiner(s): Shafi, Muhammad
• Application Number:
  US15/212,752
• Publication Number:
  US 20180016003A1
• Time in Patent Office: 1,114 Days
• Field of Search: 701 3
• CPC Class Codes: B64D 47/02 Arrangements or adaptations of signal or lighting devices
• CPC Class Codes: B64U 10/10 Rotorcrafts
• CPC Class Codes: B64U 10/13 Flying platforms
• CPC Class Codes: B64U 2101/00 UAVs specially adapted for particular uses or applications
• CPC Class Codes: B64U 2101/26 for manufacturing, inspections or repairs
• CPC Class Codes: B64U 2101/30 for imaging, photography or videography
• CPC Class Codes: B64U 2101/60 for transporting passengers; for transporting goods other than weapons
• CPC Class Codes: B64U 2201/10 autonomous, i.e. by navigating independently from ground or air stations, e.g. by using inertial navigation systems [INS]
• CPC Class Codes: B64U 2201/20 Remote controls
• CPC Class Codes: B64U 30/20 Rotors; Rotor supports
• CPC Class Codes: G05D 1/0088 characterized by the autonomous decision making process, e.g. artificial intelligence, predefined behaviours using knowledge based models G06N5/00
• CPC Class Codes: G06Q 10/1093 Calendar-based scheduling for persons or groups

Abstract

A drone-based system determines a user cohort for one or more users to assemble an object. The drone-based system assesses a task for the one or more users to assemble the object. Based on the determined user cohort and the assessed task, a drone of the drone-based system provides help to the one or more users as the one or more users assemble the object. The drone-based system may comprise a drone and one or more memories and computer readable code and one or more processors. The one or more processors, in response to execution of the computer readable code, cause the drone-based system to perform operations. The drone-based system may be only the drone or the drone and one or more servers.

Claims

1. A drone comprising:

at least one user interface;

at least one imaging device;

one or more memories bearing computer-readable code; and

one or more processors, wherein the one or more processors, in response to execution of the computer-readable code, are configured to cause the drone to perform at least the following;

determine a user cohort for one or more users to assemble an object, wherein a user is a person, wherein the user cohort is based on one of a provided user profile, learning by the drone from observation, and learning from received user inputs;

assess a task for the one or more users to assemble the object; and

provide help, based on the determined user cohort and the assessed task, to the one or more users as the one or more users assemble the object,

wherein the help is at least one of the following;

one or more suggestions to the one or more users to aid the one or more users in assembling the object;

a tool for the one or more users;

scheduled or rescheduled time for one or more users to assemble an object based on calendar information;

information conveyed from interactive assembly instructions to a user about how to use the tool or perform assembly using the tool;

one or more steps to reduce the confusion of the user or to improve timeliness of the assembly by the user.

2. The drone of claim 1, wherein the one or more suggestions comprise at least one of the following:

information that the one or more users are missing a step in assembly of the object;

information that the one or more users are using an incorrect tool for the task;

information that the one or more users do not have a tool to be used for the task; and

information that the one or more users do not have a tool to be used for the task but may use a substitute tool.

3. The drone of claim 1, further comprising a tool grabber,

wherein the one or more processors, in response to execution of the computer-readable code, are further configured to cause the drone to perform at least the following:

select a tool based on the task and the user cohort; and

provide the selected tool to the one or more users.

4. The drone of claim 3, wherein the one or more processors, in response to execution of the computer-readable code, are further configured to cause the drone to perform at least the following:

identify, via the at least one imaging device, the selected tool prior to providing the tool; and

retrieve the tool prior to providing the tool.

5. The drone of claim 3, wherein the one or more processors, in response to execution of the computer-readable code, are further configured to cause the drone to perform at least the following:

identify the selected tool, prior to providing the tool, by one or both of the following;

a barcode on one or more tools via the at least one imaging device; and

information on a radio frequency identification tag attached to one or more tools; and

retrieve the selected tool using the drone prior to providing the selected tool.

6. The drone of claim 3, wherein, when the selected tool is not available, the one or more processors, in response to execution of the computer-readable code, are further configured to cause the drone to perform at least the following:

find an alternate tool that is suitable for use as the selected tool;

choose the alternate tool as the selected tool; and

provide the alternate tool to the one or more users.

7. The drone of claim 3, wherein the one or more processors, in response to execution of the computer-readable code, are further configured to cause the drone to perform at least the following:

detect a need for a cluster of tools and designate the selected tool be the cluster of tools; and

provide the cluster of tools to the one or more users.

8. The drone of claim 3, wherein the one or more processors, in response to execution of the computer-readable code, are further configured to cause the drone to perform at least the following:

learn tool choices by observing and compiling uses by various individuals over time.

9. The drone of claim 3, wherein the one or more processors, in response to execution of the computer-readable code, are further configured to cause the drone to perform at least the following:

communicate with one or more smart toolboxes in order to locate the selected tool.

10. The drone of claim 3, wherein the one or more processors, in response to execution of the computer-readable code, are further configured to cause the drone to perform at least the following:

orchestrate usage of tools among a group of users by arranging, prioritizing, and delivering tools based on tasks to assemble the object and based on context of the task.

11. The drone of claim 1,

wherein the one or more processors, in response to execution of the computer-readable code, are further configured to cause the drone to perform at least the following:

access one or more electronic calendars for at least the one or more users;

obtain calendar information from the one or more electronic calendars; and

schedule or reschedule time for one or more users to assemble an object based on the obtained calendar information.

12. The drone of claim 11, wherein the task comprises multiple tasks and/or the object comprises multiple objects, each object with at least one task such that there are multiple tasks in total, and the one or more processors, in response to execution of the computer-readable code, are further configured to cause the drone to perform at least the following:

estimate a time at which a selected one of the multiple tasks will be performed;

prioritize distribution among the tasks and assembly of the multiple objects of at least one selected tool; and

provide the at least one selected tool to the one or more users assembling the current object at the estimated time.

13. The drone of claim 1, wherein the user cohort comprises one or both of experience level of the one or more users and setting in which assembly of the object is being performed.

14. The drone of claim 1, wherein the assessing of the task is aided by information from an instruction manual comprising assembly instructions for the object.

15. The drone of claim 1, wherein the one or more processors, in response to execution of the computer-readable code, are further configured to cause the drone to perform at least the following:

communicate with one or more remote helpers, in response to a determination the one or more remote helpers are needed.

16. The drone of claim 1, wherein the one or more processors, in response to execution of the computer-readable code, are further configured to cause the drone to perform at least the following:

detect a need for a tool that the user does not have; and

send a signal to trigger a purchase or a loan of such a tool.

17. The drone of claim 1, wherein the drone further comprises one or more lights, and wherein the help comprises using the light to perform one or more of the following:

illuminate a tool as means of suggesting its use;

illuminate a region of the object to help the one or more users during the assembly; and

illuminate a portion of the object or one or more parts to be used in assembling the object.

18. The drone of claim 1, wherein the help comprises projecting a display of one or more steps of an instruction manual or speaking such one or more steps.

19. The drone of claim 1, wherein the one or more processors, in response to execution of the computer-readable code, are further configured to cause the drone to perform at least the following:

communication between the drone and a user.

20. The drone of claim 1, wherein the one or more processors, in response to execution of the computer-readable code, are further configured to cause the drone to perform at least the following:

process interactive assembly instructions for a particular user or cohort or both; and

convey information from the interactive assembly instructions to the particular user about how to use the tool or perform assembly using the tool.

21. The drone of claim 1, wherein the one or more processors, in response to execution of the computer-readable code, are further configured to cause the drone to perform at least the following:

monitor by the drone user behavior to determine whether a user appears confused or is not performing assembly in a timely manner, and

when the user appears confused or is not performing assembly in a timely manner, take one or more steps to reduce the confusion of the user or improve timeliness of the assembly by the user.

22. The drone of claim 1 comprised within a drone system.

23. The drone system of claim 22, comprising a network in communication with the drone and at least one other drone.