Enhanced reality system for visualizing, evaluating, diagnosing, optimizing and servicing smart grids and incorporated components

• US 10,055,869 B2
• Filed: 08/11/2016
• Issued: 08/21/2018
• Est. Priority Date: 08/11/2015
• Status: Active Grant

• Current Assignee: Delta Energy & Communications, LLC
• Original Assignee: Delta Energy & Communications, LLC
• Inventors: Borrelli, Angelo, Teichmann, Keith
• Primary Examiner(s): McDowell, Jr., Maurice L.
• Application Number:
  US15/234,293
• Publication Number:
  US 20170098320A1
• Time in Patent Office: 740 Days
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06Q 50/06 Energy or water supply
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04Q 2209/40 using a wireless architecture
• CPC Class Codes: H04Q 2209/60 for transmitting utility meters data, i.e. transmission of data from the reader of the utility meter
• CPC Class Codes: H04Q 9/00 Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom

Abstract

A head-mounted user device is provided for use in a smart grid network. The head-mounted user device includes a signal processor configured to receive signaling containing information about one or more assets in a distributed power grid network from a data collection device configured to receive data from the assets in the distributed power grid network; and determine, based at least partly on the signaling received from the data collection device, signaling containing asset display information about the one or more assets. The head-mounted user device also includes an augmented or mixed reality display configured to display an actual field of view of the user and the asset display information by overlaying the asset display information over the actual field of view.

Claims

1. A head-mounted user device comprising:

a signal processor configured to;

receive signaling containing information about one or more assets in a distributed power grid network from a data collection device configured to receive data from the assets in the distributed power grid network; and

determine, based at least partly on the signaling received from the data collection device, signaling containing asset display information about the one or more assets;

an augmented or mixed reality display configured to display an actual field of view of the user and the asset display information by overlaying the asset display information over the actual field of view; and

means for mounting the device to the head of the user such that the display is in the user'"'"'s field of view;

wherein the data collection device is a transformer mounted data collection device configured to receive signaling containing information about collected data, including some combination of electrical signaling data related to electrical signaling being processed by the transformer located and arranged in the distributed smart grid network and to which the data collection device is mounted, metered data related to associated electrical signaling being provided from the transformer to a building or structure in the distributed smart grid network, and other wireless network data related to other wireless network communication devices/nodes/end points deployed in the distributed smart grid network.

2. The head-mounted user device according to claim 1, further comprising means for providing user inputs to the head-mounted user device.

3. The head-mounted user device according to claim 1, wherein the asset display information includes a real-time review of asset performance.

4. The head-mounted user device according to claim 1, wherein the received signaling containing information about one or more assets includes information about the geographic position of the one or more assets;

and

wherein the signal processor of the head-mounted user device is further configured to determine the location of the one or more assets relative to the head-mounted user device based on the received information, and is configured to update the location of the one or more assets relative to the head-mounted user device as the user wearing the head-mounted user device moves.

5. The head-mounted user device according to claim 4, wherein the asset display information includes identification and flagging of health indicators of the one or more assets together with the location of the one or more assets.

6. The head-mounted user device according to claim 4, wherein the asset display information includes routing information directing the user to the asset overlaid on the display.

7. The head-mounted user device according to claim 1, further comprising at least one forward facing camera mounted in front for receiving images and one or more additional cameras mounted around the device periphery.

8. The head-mounted user device according to claim 7, wherein the at least one forward facing camera is configured to capture real-time images of the user'"'"'s environment in the user'"'"'s field of view, and the display is configured to display the real-time images of the user'"'"'s environment in the user'"'"'s field of view, onto which the information about said assets is overlaid.

9. The head-mounted user device according to claim 1, wherein the means for mounting comprises an adjustable head strap.

10. The head-mounted user device according to claim 1, further comprising a microphone configured to receive voice commands from the user.

11. The head-mounted user device according to claim 1, wherein the asset display information includes information about an asset routing identification comprising a map directing the user of the head-mounted device to the asset on a recommended route determined by the processor.

12. The head-mounted user device according to claim 1, wherein the asset display information includes information about geo-spatial asset overlay that identifies assets by type overlaid on the field of view, including where relative size of the asset display information varies in proximity to the user.

13. The head-mounted user device according to claim 1, wherein the asset display information includes information about geo-spatial asset selected that provides a complete overview on performance data throughput, health and location.

14. The head-mounted user device according to claim 1, wherein the asset display information includes information about asset installation, set-up and visual verification, including where a targeted asset is visualized through the augmented or mixed reality display.

15. The head-mounted user device according to claim 1, wherein the augmented or mixed reality display comprises a transparent display screen configured to allow the user to see the actual field of view through the transparent display screen and to display the asset display information.

16. The head-mounted user device according to claim 1, further comprising a hand-held controller device configured to permit user interaction with the head-mounted user device.

17. A head-mounted user device comprising:

a signal processor configured to;

receive signaling containing information about one or more assets in a distributed power grid network from a data collection device configured to receive data from the assets in the distributed power grid network; and

determine, based at least partly on the signaling received from the data collection device, signaling containing asset display information about the one or more assets;

an augmented or mixed reality display configured to display an actual field of view of the user and the asset display information by overlaying the asset display information over the actual field of view; and

means for mounting the device to the head of the user such that the display is in the user'"'"'s field of view,

wherein the asset display information includes overlaid instructions for asset installation on the transformer and residential/commercial metering locations, including interactive and virtual cues to be overlaid over the field of view so as to provide a virtual keyboard for asset set-up.

18. A head-mounted user device comprising:

a signal processor configured to;

receive signaling containing information about one or more assets in a distributed power grid network from a data collection device configured to receive data from the assets in the distributed power grid network; and

determine, based at least partly on the signaling received from the data collection device, signaling containing asset display information about the one or more assets;

an augmented or mixed reality display configured to display an actual field of view of the user and the asset display information by overlaying the asset display information over the actual field of view; and

means for mounting the device to the head of the user such that the display is in the user'"'"'s field of view,

wherein the asset display information includes an asset radar that provides a summary of locations of a plurality of assets, within specified distance increments from the head-mounted user device, which is displayed in the center of the asset radar.