Systems and methods for managing computing systems utilizing augmented reality

• US 9,712,413 B2
• Filed: 12/21/2015
• Issued: 07/18/2017
• Est. Priority Date: 04/07/2011
• Status: Expired due to Fees

• Current Assignee: Globalfoundries US Incorporated (GlobalFoundries, Inc.)
• Original Assignee: GlobalFoundries, Inc.
• Inventors: Windell, David T.
• Primary Examiner(s): Miah, Razu A
• Application Number:
  US14/976,530
• Publication Number:
  US 20160110244A1
• Time in Patent Office: 575 Days
• Field of Search: 709224
• CPC Class Codes: G06F 11/0709 in a distributed system consisting of a plurality of standalone computer nodes, e.g. clusters, client-server systems
• CPC Class Codes: G06F 11/0742 in a data processing system embedded in a mobile device, e.g. mobile phones, handheld devices
• CPC Class Codes: G06F 11/0751 Error or fault detection not based on redundancy power supply failures G06F1/30; network fault management H04L41/06
• CPC Class Codes: G06F 11/0769 Readable error formats, e.g. cross-platform generic formats, human understandable formats
• CPC Class Codes: G06F 11/079 Root cause analysis, i.e. error or fault diagnosis in a hardware test environment G06F11/22; in a software test environment G06F11/36
• CPC Class Codes: G06F 11/0793 Remedial or corrective actions recovery from an exception in an instruction pipeline G06F9/3861; by retry G06F11/1402; for recovering from a failure of a protocol instance or entity H04L69/40
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06F 2218/12 Classification; Matching
• CPC Class Codes: G06Q 10/103 Workflow collaboration or project management
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2207/10004 Still image; Photographic image
• CPC Class Codes: G06T 2207/30108 Industrial image inspection
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 2201/02 Recognising information on displays, dials, clocks
• CPC Class Codes: H04L 41/0654 using network fault recovery ring fault isolation or reconfiguration in loop networks without recovery actions by a network management system H04L12/437
• CPC Class Codes: H04L 41/0686 Additional information in the notification, e.g. enhancement of specific meta-data
• CPC Class Codes: H04L 43/0817 by checking functioning
• CPC Class Codes: H04L 43/0823 Errors, e.g. transmission errors
• CPC Class Codes: H04L 43/50 Testing arrangements

Abstract

Various embodiments for managing computing systems are provided. In one embodiment, a method comprises comparing an identified target device in a captured environmental input to a model of the target device; recognizing, in real-time, a status condition of the target device based on the comparison; and determining if the target device is functioning properly if the target device and the model of the target device match, wherein if the target device is not functioning properly: a cause of error and troubleshooting instructions are displayed.

Claims

1. A method for managing computing systems utilizing augmented reality using a processor, comprising:

capturing an environmental input;

identifying a target device in the captured environmental input, the target device including at least one identifier included in the captured environmental input;

comparing the identified target device in the captured environmental input to a model of the target device;

recognizing, in real-time, a status condition of the identified target device based on the comparison; and

determining if the identified target device is functioning properly if the identified target device and the model of the target device match, wherein if the identified target device is not functioning properly, performing actions including;

recognizing at least one indicator of the identified target device, and

displaying a cause of error and troubleshooting instructions, based on the at least one indicator of the identified target device.

2. The method of claim 1, wherein identifying the target device comprises identifying the target device via one of a bar code, a radio frequency identifier, and a position of the target device.

3. The method of claim 1, further comprising a display coupled to the processor, the method further comprising displaying, via the display, the information regarding the status condition.

4. The method of claim 3, wherein displaying information regarding the status condition comprises displaying the troubleshooting instructions if the status condition is the error condition.

5. The method of claim 1, wherein capturing the environmental input comprises capturing the environmental input utilizing one of an audio capturing device, a visual capturing device, and a tactile capturing device.

6. The method of claim 1, wherein capturing the environmental input comprises capturing a static visual image of the target device utilizing a camera.

7. The method of claim 1, wherein capturing the environmental input comprises capturing video images of the target device utilizing a camera.

8. The method of claim 1, wherein the at least one indicator includes a power indicator light in the captured environmental input.

9. The method of claim 1, wherein the at least one indicator includes a vibration in the captured environmental input.

10. The method of claim 1, wherein the at least one indicator includes a screen message in the captured environmental input.

11. The method of claim 1, wherein the at least one indicator includes a sound in the captured environmental input.

12. The method of claim 1, wherein the at least one indicator includes a lack of a visual cue in the captured environmental input.

13. The method of claim 1, further comprising automatically querying a network regarding the cause of error in response to determining that the target device is not functioning properly.

14. The method of claim 13, wherein the cause of error and the troubleshooting instructions are received in response to querying the network.

15. A method for managing computing systems utilizing augmented reality using a processor, comprising:

capturing an environmental input;

identifying a target device in the captured environmental input, the target device including at least one identifier included in the captured environmental input;

determining whether the identified target device matches a model of the target device;

in response to the identified target device matching the model of the target device, determining that the identified target device is functioning properly; and

in response to the identified target device not matching the model of the identified target device, performing actions including;

recognizing at least one indicator of the target device in the captured environmental input,

associating an error condition with the at least one indicator of the identified target device, and

displaying the associated error condition and a troubleshooting instruction, based on the at least one indicator.

16. The method of claim 15, wherein the at least one indicator includes a power indicator light in the captured environmental input.

17. The method of claim 15, wherein the error condition includes a power failure of the identified target device.

18. The method of claim 15, further comprising, in response to the identified target device not matching the model of the identified target device, launching a repair interface for the computing systems.

19. The method of claim 15, further comprising, in response to the identified target device not matching the model of the identified target device, automatically querying a network regarding the error condition.

20. The method of claim 19, further comprising receiving at least one cause of error, at least one solution to the error condition, and the troubleshooting instruction in response to querying the network.