PORTABLE INSPECTION AND CONTROL DEVICE

• US 20180150070A1
• Filed: 11/29/2016
• Published: 05/31/2018
• Est. Priority Date: 11/29/2016
• Status: Abandoned Application

• Current Assignee: Caterpillar Incorporated
• Original Assignee: Caterpillar Incorporated
• Inventors: Johnson, Lonny Eric, Shah, Harsh P., Nelson, Matthew C.
• Application Number:
  US15/363,788
• Publication Number:
  US 20180150070A1
• Time in Patent Office: Days
• CPC Class Codes: G05B 2219/32014 Augmented reality assists operator in maintenance, repair, programming, assembly, use of head mounted display with 2-D 3-D display and voice feedback, voice and gesture command
• CPC Class Codes: G05B 2219/36542 Cryptography, encrypt, access, authorize with key, code, password
• CPC Class Codes: G06F 21/31 User authentication
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06Q 10/20 Administration of product repair or maintenance
• CPC Class Codes: G06T 7/001 using an image reference approach

Abstract

An inspection assembly for a machine is provided. The inspection assembly includes a portable computing device. The inspection assembly further includes a controller associated with the portable computing device. The controller is configured to determine a set of activities related to inspection of the machine to be performed by an operator using the portable computing device. The set of activities are related to inspection of machine parts during a physical walk around the machine performed by the operator. The controller is configured to determine if the operator has completed performing the set of activities. The controller is configured to selectively augment a set of controls for operating the machine on the portable computing device based on the determination of the completion of the set of activities.

Claims

1. An inspection assembly for a machine, the inspection assembly comprising:

a portable computing device; and

a controller associated with the portable computing device, the controller configured to;

determine a set of activities related to inspection of the machine to be performed by an operator using the portable computing device, wherein the set of activities are related to inspection of machine parts during a physical walk around the machine performed by the operator;

determine if the operator has completed performing the set of activities; and

selectively augment a set of controls for operating the machine on the portable computing device based on the determination of the completion of the set of activities.

2. The inspection assembly of claim 1, wherein the portable computing device is a helmet, glasses, headset capable of displaying an augmented reality image thereon.

3. The inspection assembly of claim 1, wherein the controller is embedded in the portable computing device.

4. The inspection assembly of claim 1, wherein the controller is further configured to determine if the operator is authorized to operate the machine based on access rights of the operator.

5. The inspection assembly of claim 1, wherein the set of controls includes a start control for starting the machine based on the completion of the set of activities.

6. The inspection assembly of claim 1, wherein the portable computing device further includes an image capturing assembly configured to capture an image feed of the physical walk around by the operator for inspecting the machine parts.

7. The inspection assembly of claim 6, wherein the controller is further configured to:

compare the image feed of the physical walk around by the operator with a predetermined inspection feed; and

determine if any one of the set of activities is completed based on the comparison.

8. The inspection assembly of claim 7, wherein the controller is configured to iteratively perform the compare and determine steps based on a movement of the operator around the machine.

9. The inspection assembly of claim 1, wherein the controller is further configured to augment visual cues on the portable computing device to guide the operator for the physical walk around based on a predetermined sequence of performing the set of activities.

10. The inspection assembly of claim 1, wherein the controller is configured to augment an error message on the portable computing device if the set of activities is not completed by the operator.

11. The inspection assembly of claim 1, wherein the controller is configured to selectively augment the set of controls on a dashboard present within an operator cab of the machine.

14. The method of claim 10, wherein the set of controls includes a start control for starting the machine based on the completion of the set of activities.

12. A method for inspection of a machine, the method comprising:

determining, by a controller of a portable computing device, a set of activities related to inspection of the machine to be performed by an operator using the portable computing device, wherein the set of activities are related to inspection of machine parts during a physical walk around the machine performed by the operator;

determining, by the controller, if the operator has completed performing the set of activities; and

selectively augmenting, by the controller, a set of controls for operating the machine on the portable computing device based on the determination of the completion of the set of activities.

13. The method of claim 12 further comprising determining, by the controller, if the operator is authorized to operate the machine based on access rights of the operator.

15. The method of claim 12 further comprising capturing, by an image capturing assembly of the portable computing device, an image feed of the physical walk around by the operator for inspecting the machine parts.

16. The method of claim 15 further comprising:

comparing, by the controller, the image feed of the physical walk around by the operator with a predetermined inspection feed; and

determining, by the controller, if any one of the set of activities is completed based on the comparison.

17. The method of claim 16 further comprising iteratively performing, by the controller, the comparison and determination steps based on a movement of the operator around the machine.

18. The method of claim 12 further comprising augmenting, by the controller, visual cues on the portable computing device to guide the operator for the physical walk around based on a predetermined sequence of performing the set of activities.

19. The method of claim 12 further comprising augmenting, by the controller, an error message on the portable computing device if the set of activities is not completed by the operator.

20. A system comprising:

a machine having a set of physical controls for operating the machine;

a portable computing device adapted to be used for inspection of the machine; and

a controller of the portable computing device, the controller configured to;

determine a set of activities related to the inspection of the machine to be performed by the operator, wherein the set of activities are related to inspection of machine parts during a physical walk around the machine performed by the operator;

determine if the operator has completed performing the set of activities; and

selectively augment a set of controls for operating the machine on the portable computing device based on the determination of the completion of the set of activities.