System and method for augmented reality display of electrical system information

• US 10,147,234 B2
• Filed: 06/03/2015
• Issued: 12/04/2018
• Est. Priority Date: 06/09/2014
• Status: Active Grant

• Current Assignee: Huntington Ingalls, Inc. (Huntington Ingalls Industries Incorporated)
• Original Assignee: Huntington Ingalls, Inc. (Huntington Ingalls Industries Incorporated)
• Inventors: Bare, Brian, Martin, Jonathan, Ryan, Patrick, Sells, Paul, Lawrence, Mark
• Primary Examiner(s): Wang, Yuehan
• Assistant Examiner(s): Le, Michael
• Application Number:
  US14/729,561
• Publication Number:
  US 20150356786A1
• Time in Patent Office: 1,280 Days
• Field of Search: 345633
• CPC Class Codes: G01R 31/3274 Details related to measuring, e.g. sensing, displaying or computing; Measuring of variables related to the contact pieces, e.g. wear, position or resistance measuring contact resistance G01R27/205
• CPC Class Codes: G01R 31/3275 Fault detection or status indication
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

A method for providing electrical system status information to a mobile device user is presented. The method comprises receiving a request for target area electrical system status information from a mobile device, determining the pose of the mobile interface device relative to the target area, obtaining target area electrical system status information for a target electrical system at least partially disposed within the target area, and assembling AR electrical system status information for transmission to and display on the mobile interface device. The AR electrical system status information is assembled using the target area electrical system status information and is configured for viewing in conjunction with a real-time view of the target area captured by the mobile interface device. The AR electrical system status information is then transmitted to the mobile interface device.

Claims

1. A method for providing electrical system status information to a mobile interface device user in a dynamic structural environment in the form of a flexible structure having an associated environment coordinate system, the method comprising:

receiving on a central data processor over a communication network from a mobile interface device disposed within the flexible structure a request for target area electrical system status information, the request including request information usable by the central data processor to determine the pose of the mobile interface device relative to a target area within the flexible structure;

receiving mobile interface device location information from a local positioning system of the flexible structure, said location information being provided using the environment coordinate system;

determining the pose of the mobile interface device relative to the target area using the request information and the mobile interface device location information;

obtaining target area electrical system status information for a target electrical-component at least partially disposed within the target area, the target electrical component being a part of an electrical circuit;

assembling augmented reality (AR) electrical system status information for transmission to and display on the mobile interface device, the AR electrical system status information being assembled using the target area electrical system status information and being configured for viewing in conjunction with a real-time view of the target area captured by the mobile interface device; and

transmitting the AR electrical system status information to the mobile interface device,

wherein the action of determining the pose of the requesting mobile interface device accounts for spatial changes in the environment coordinate system resulting from flexing of the flexible structure.

2. The method according to claim 1, wherein the mobile interface device is one of the set consisting of a tablet computer, a smartphone, and a wearable heads-up display.

3. The method according to claim 1 wherein the request for target area electrical system status information includes a digital image of the target area captured by the mobile interface device.

4. The method according to claim 3 wherein the action of determining includes:

receiving mobile interface device location information from a local positioning system, said location information being provided in the environment coordinate system associated with the dynamic structure; and

using the location information and the digital image to determine the pose of the mobile interface device.

5. The method according to claim 3 wherein the action of obtaining target area electrical system status information includes:

receiving electrical parameter information for the electrical circuit-from one or more monitoring devices associated with the-electrical circuit, the electrical parameter information including the real-time value for the at least one of the set consisting of energization state, voltage, and current.

6. The method according to claim 5 wherein the AR electrical system status information includes the electrical parameter information and is configured so that when viewed in conjunction with the real-time view of the target area captured by the mobile interface device, the electrical parameter information is displayed adjacent said target electrical component in the captured real-time view.

7. A method according to claim 5 wherein the electrical system status information includes a real-time value for at least one of the set consisting of energization state, voltage, and current for at least a portion of the electrical circuit.

8. The method according to claim 5 wherein the target electrical component is or includes a circuit breaker buss.

9. The method according to claim 1 wherein the actions of determining, obtaining, assembling and transmitting are periodically repeated.

10. An automated system for providing electrical system status information to a mobile interface device in a dynamic structural environment in the form of a flexible structure having an associated environment coordinate system, the system comprising:

at least one mobile interface device configured for variable disposition within the flexible structure, capturing information about a target environment within the flexible structure, and transmitting the target area information over a network;

a domain coordinate management system comprising one or more data processors configured for receiving information on a current conformation of the flexible structure and resolving spatial differences in the environment coordinate system between the current conformation of the flexible structure and a stored model of the flexible structure dynamic structural environment;

a local positioning system disposed at least partially within the flexible structure, the local positioning system being in communication with the at least one mobile interface device via the network and being configured to provide location information usable to determine a mobile interface device pose, said mobile interface device pose comprising a position and orientation of the mobile interface device relative to the target area in the environment coordinate system; and

a central processor comprising at least one data processing machine in communication with the at least one mobile interface device and the local positioning system via the network, the central processor being configured for

receiving from a requesting one of the at least one mobile interface device a request for target area electrical system information, the request including information usable to determine the pose of the requesting mobile interface device relative to the target area,

determining the pose of the requesting mobile interface device relative to the target area accounting for spatial changes in the environment coordinate system due to flexing of the flexible structure,

obtaining target area electrical status information for a target electrical components at least partially disposed within the target area, the target electrical component being a part of an electrical circuit,

assembling augmented reality (AR) electrical system status information for transmission to and display on the requesting mobile interface device, the AR electrical system status information being assembled using the target area electrical status information and being configured for viewing in conjunction with a real-time view of the target area captured by the requesting mobile interface device, and

transmitting the AR electrical system status information to the requesting mobile interface device.

11. The system according to claim 10 further comprising:

at least one electrical status network comprising one or more monitoring devices associated with the electrical circuit and being at least partially disposed within the target area, the monitoring devices being configured for determining an electrical parameter status for one or more electrical system components.

12. The system according to claim 10 wherein the target electrical component is or includes at least one protective relay.