System for conducting a service call with orienteering

• US 10,762,251 B2
• Filed: 03/08/2019
• Issued: 09/01/2020
• Est. Priority Date: 02/22/2017
• Status: Active Grant

• Current Assignee: Middle Chart, LLC, Veeva Systems Incorporated
• Original Assignee: Middle Chart, LLC
• Inventors: Santarone, Michael S., Duff, Jason E., Wodrich, Michael
• Primary Examiner(s): Hartman, Jr., Ronald D
• Application Number:
  US16/297,383
• Publication Number:
  US 20190205486A1
• Time in Patent Office: 543 Days
• CPC Class Codes: G01C 15/00 Surveying instruments or accessories not provided for in groups G01C1/00 - G01C13/00
• CPC Class Codes: G01C 21/206 specially adapted for indoor navigation
• CPC Class Codes: G01S 19/07 providing data for correcting measured positioning data, e.g. DGPS [differential GPS] or ionosphere corrections
• CPC Class Codes: G01S 19/13 Receivers
• CPC Class Codes: G01S 19/14 specially adapted for specific applications
• CPC Class Codes: G01S 5/02585 at least one of the measurements being a non-radio measurement
• CPC Class Codes: G01S 5/14 Determining absolute distances from a plurality of spaced points of known location
• CPC Class Codes: G05B 15/02 electric
• CPC Class Codes: G05D 3/12 using feedback
• CPC Class Codes: G06F 30/13 Architectural design, e.g. computer-aided architectural design [CAAD] related to design of buildings, bridges, landscapes, production plants or roads
• CPC Class Codes: G06N 5/04 Inference or reasoning models
• CPC Class Codes: G06Q 10/06 Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
• CPC Class Codes: G06Q 50/165 Land development
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: H04W 4/027 using movement velocity, acceleration information
• CPC Class Codes: H04W 4/029 Location-based management or tracking services
• CPC Class Codes: Y02P 90/84 Greenhouse gas [GHG] management systems

Abstract

Method and apparatus for conducting a Service Call using orienteering methods. The AVM may assist in determining whether or when equipment needs repair and can automatically call a service technician. By referencing the AVM on a smart device, the technician can quickly and easily locate the equipment to be repaired. Additionally, the data contained within the AVM may provide valuable clues to solving any service-related problem. Technical walkthroughs may also be displayed on the service technician'"'"'s smart device.

Claims

1. A method of conducting a service call conducted by an agent at a structure based on orienteering, the method comprising:

a. identifying a digital virtual model of the structure based upon an orienteering process performed via a smart device, wherein the digital model comprises virtual representation of one or more of;

structural components, equipment, or areas of interest within the structure;

b. receiving data generated by a sensor located within the structure into the digital virtual model;

c. generate a pending action to be taken at the structure by an agent, the pending action based upon the data generated by the sensor located within the structure;

d. referencing the virtual model of the structure, generating a first user interface on the smart device, the first user interface comprising directions for movement of the agent within the structure to a first geospatial location, the first geospatial location based on a purpose of the service call;

e. tracking movement of the smart device within the structure; and

f. subsequent to reaching the first geospatial location, displaying a second user interface on the smart device, the second user interface comprising information supporting the pending action at the structure to be taken by the agent.

2. The method of claim 1 additionally comprising generation of a virtual representation of an equipment item involved in the action to be taken by the agent.

3. The process of claim 2 wherein said identifying a digital virtual model of the structure orienteering process comprises the additional method steps of:

a. determining a distance of a first location sensor at a first position to at least three reference point transceivers;

b. determining a distance of a second location sensor at a second position to the at least three reference point transceivers;

c. generating a vector originating from the first position and extending through the second position; and

d. determining an equipment item intersecting the vector.

4. The method of claim 3, further comprising the step of:

upon entry of the agent in to the structure, computing a geolocation of the agent based upon a distance of a smart device supported by the agent, said smart device comprising at least one or the first location sensor and the second location sensor.

5. The method of claim 4, further comprising the step of:

determining a floor within the structure on which the agent is located, wherein the structure comprises multiple floors, and wherein each floor comprises a plurality of reference point transceivers.

6. The method of claim 4, wherein the sensor located within the structure generates data based upon an amount of vibration experienced by the sensor.

7. The method of claim 4, wherein the sensor located within the structure generates data based upon an amount of electrical power supplied to the item of equipment.

8. The method of claim 4, wherein the sensor located within the structure generates data comprising a vibration and moisture presence and the method further includes the step of determining a presence of a wood destroying organism based upon a sensor detecting a vibration and presence of moisture within a locale in the structure.

9. The method of claim 8, further comprising:

accessing from the digital model and generating on the smart device a virtual representation of the service apparatus, wherein the service apparatus is identified based upon the distance between the agent and a service apparatus and the direction of interest indicated by the vector.

10. The method of claim 9, wherein the virtual representation of the service apparatus comprises one or more of:

service records, visual representation of components of interest of the service apparatus, user notes about the service apparatus, or product manuals relating to the service apparatus.

11. The method of claim 4 additionally comprising the step of:

recording, using an orienteering process, changes in a location of the agent while the agent is located within the structure.

12. The method of claim 4, wherein the virtual model comprises as built data and experiential data, and wherein the method further comprises:

updating, the experiential data of the virtual model to reflect an action executed during the service call.

13. The method of claim 4, wherein at least one transceiver comprises a wireless transmitter.

14. The method of claim 4, wherein the Agent comprises an unmanned vehicle.

15. The method of claim 3, wherein the smart device further comprises an accelerometer, and a direction of interest is computed, at least in part, based upon data generated by the accelerometer.

16. The method of claim 3, wherein the virtual model is displayed on the smart device using augmented reality.

17. The method of claim 3 additionally comprising the steps of aggregating the data generated by a sensor located within the structure with data generated by sensors located external to the structure and generating an analysis of the equipment item based upon the aggregated data.

18. The method of claim 17 wherein the analysis is based, at least in part upon an unstructured query.

19. The method of claim 3 wherein the sensor generates data based upon an amount of infrared energy captured.

20. The method of claim 3 wherein the sensor generates data indicative of a faulty operation of the equipment item.