Drone and drone-based system and methods for helping users assemble an object

• US 9,958,866 B2
• Filed: 07/29/2016
• Issued: 05/01/2018
• Est. Priority Date: 07/18/2016
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Chefalas, Thomas E., Kochut, Andrzej, Pickover, Clifford A., Weldemariam, Komminist
• Primary Examiner(s): CASS, JEAN PAUL
• Application Number:
  US15/223,359
• Publication Number:
  US 20180017972A1
• Time in Patent Office: 641 Days
• Field of Search: 701 3
• CPC Class Codes: B64C 39/024 of the remote controlled vehicle type, i.e. RPV
• CPC Class Codes: B64D 47/02 Arrangements or adaptations of signal or lighting devices
• CPC Class Codes: B64U 10/10 Rotorcrafts
• CPC Class Codes: B64U 10/13 Flying platforms
• CPC Class Codes: B64U 2101/00 UAVs specially adapted for particular uses or applications
• CPC Class Codes: B64U 2101/26 for manufacturing, inspections or repairs
• CPC Class Codes: B64U 2101/30 for imaging, photography or videography
• CPC Class Codes: B64U 2101/60 for transporting passengers; for transporting goods other than weapons
• CPC Class Codes: B64U 2201/10 autonomous, i.e. by navigating independently from ground or air stations, e.g. by using inertial navigation systems [INS]
• CPC Class Codes: B64U 2201/20 Remote controls
• CPC Class Codes: B64U 30/20 Rotors; Rotor supports
• CPC Class Codes: G05D 1/0088 characterized by the autonomous decision making process, e.g. artificial intelligence, predefined behaviours using knowledge based models G06N5/00
• CPC Class Codes: G06Q 10/1093 Calendar-based scheduling for persons or groups

Abstract

A drone-based system determines a user cohort for one or more users to assemble an object. The drone-based system assesses a task for the one or more users to assemble the object. Based on the determined user cohort and the assessed task, a drone of the drone-based system provides help to the one or more users as the one or more users assemble the object. The drone-based system may comprise a drone and one or more memories and computer readable code and one or more processors. The one or more processors, in response to execution of the computer readable code, cause the drone-based system to perform operations. The drone-based system may be only the drone or the drone and one or more servers.

Claims

1. A method, comprising:

determining, by a drone-based system, a human user cohort for one or more human users to assemble an object, wherein the human user cohort depends on a capability of the one or more human users to assemble the object determined by the drone-based system, and wherein the capability is based on one of a provided human user profile, learning by the drone-based system from observation using circuitry for determining the human user cohort, and learning by the drone-based system from received human user input;

assessing by the drone-based system a task for the one or more human users to assemble the object, using circuitry for assessing the task; and

providing, based on the determined human user cohort and the assessed task, by a drone of the drone-based system, assistance provided by the drone to the one or more human users as the one or more human users assemble the object.

2. The method of claim 1, wherein the drone-based system is the drone.

3. The method of claim 1, wherein the drone-based system comprises the drone and one or more servers.

4. The method of claim 1, wherein the providing further comprises providing by the drone one or more assembly aiding suggestions to the one or more human users to aid the one or more human users in assembling the object.

5. The method of claim 4, in which the suggestions include one or more of the following:

informing the one or more human users that the one or more human users are missing a step in assembly of the object;

informing the one or more human users that the one or more human users are using an incorrect tool for the task;

informing the one or more human users that the one or more human users do not have a tool to be used for the task; and

informing the one or more human users that the one or more human users do not have a tool to be used for the task but may use a substitute tool.

6. The method of claim 1, wherein:

the method further comprises selecting a tool based on the task and the human user cohort; and

the providing further comprises providing by the drone the selected tool to the one or more human users.

7. The method of claim 6, in which the method further comprises the drone-based system accessing one or more electronic calendars for at least the one or more human users, and using calendar information from the one or more electronic calendars in order to schedule or reschedule time for one or more human users to assemble an object.

8. The method of claim 7, in which the method is performed for a current object, there are multiple tasks performed for multiple objects being assembled or to be assembled, and the method further comprises the drone-based system estimating a time at which a selected one of the multiple tasks will be performed and prioritizing distribution among the tasks and assembly of the multiple objects of at least one selected tool to enable providing the at least one selected tool to the one or more human users assembling the current object at the estimated time.

9. The method of claim 6, further comprising:

using imaging in the drone to visually identify the selected tool prior to providing the tool; and

retrieving the tool using the drone prior to providing the tool.

10. The method of claim 6, further comprising:

performing, prior to providing the tool, one or both of the following;

using imaging in the drone to visually identify a barcode on one or more tools and using the barcode to identify the selected tool; and

using wireless circuitry in the drone to identify information on a radio frequency identification tag attached to one or more tools and using the information to identify the selected tool; and

retrieving the selected tool using the drone prior to providing the selected tool.

11. The method of claim 6, wherein:

the selected tool is not available;

the method further comprises finding an alternate tool that is suitable for use as the selected tool and choosing the alternate tool as the selected tool; and

providing comprises providing by the drone the alternate tool to the one or more human users.

12. The method of claim 6, in which the method further comprises detecting by the drone-based system a need for a cluster of tools and making the selected tool be the cluster of tools, and wherein providing comprises providing by the drone the cluster of tools to the one or more human users.

13. The method of claim 6, in which the method further comprises learning tool choices by the drone-based system by observing and compiling uses by various individuals over time.

14. The method of claim 6, further comprising communicating by the drone-based system with one or more smart toolboxes in order to locate the selected tool.

15. The method of claim 6, further comprising orchestrating by the drone-based system the usage of tools among a group of human users by arranging, prioritizing, and delivering tools based on tasks to assemble the object and based on context of the task.

16. The method of claim 1, in which the human user cohort comprises one or both of experience level of the one or more human users and setting in which assembly of the object is being performed.

17. The method of claim 1, in which the assessing of the task is aided by information from an instruction manual comprising assembly instructions for the object.

18. The method of claim 1, further comprising establishing by the drone-based system communication with one or more remote helpers, in response to a determination the one or more remote helpers are needed.

19. The method of claim 1, in which at least the drone is configured for a special purpose.

20. The method of claim 1, further comprising detecting by the drone-based system a need for a tool that the human user does not have and sending a signal to trigger a purchase or a loan the tool.

21. The method of claim 1, in which the drone comprises one or more lights, and wherein the providing assistance provided by the drone to the one or more human users comprises using by the drone the light to perform one or more of the following:

illuminate a tool as means of suggesting use of the tool;

illuminate a region of the object to help the one or more human users during the assembly;

illuminate a portion of the object or one or more parts to be used in assembling the object to highlight the portion for the assembly.

22. The method of claim 1, wherein providing help comprises the drone projecting a display of one or more steps of an instruction manual or speaking such one or more steps.

23. The method of claim 1, wherein the method further comprises performing communication between the drone-based system and the one or more human users, wherein the one or more human users a human user who wears a headset for communication.

24. The method of claim 1, further comprising processing by the drone-based system interactive assembly instructions for a particular human user or cohort or both and conveying by the drone information from the interactive assembly instructions to the particular human user about how to use the tool or perform assembly using the tool.

25. The method of claim 1, further comprising monitoring by the drone-based system human user behavior indicative to the drone-based system that the one or more human users appears confused or is not performing assembly in a timely manner, and in response to a determination the human user appears confused or is not performing assembly in a timely manner, the drone-based system taking one or more steps to reduce the confusion of the human user or improving timeliness of the assembly by the human user.