Schematic and database linking system

• US 9,984,133 B2
• Filed: 10/14/2015
• Issued: 05/29/2018
• Est. Priority Date: 10/16/2014
• Status: Active Grant

• Current Assignee: Palantir Technologies Incorporated
• Original Assignee: Palantir Technologies Incorporated
• Inventors: Cervelli, Daniel, Tobin, David, Kara, Feridun Arda, Sontag, Trevor, Skiff, David, Carrino, John, Chang, Allen, Garrod, John, Yu, Agatha
• Primary Examiner(s): Le, Miranda
• Application Number:
  US14/883,498
• Publication Number:
  US 20160110369A1
• Time in Patent Office: 958 Days
• Field of Search: 707722, 707723
• CPC Class Codes: G06F 16/24575 using context
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 16/252 between a Database Management System and a front-end application
• CPC Class Codes: G06F 16/94 Hypermedia Hyperlinking G06F40/134
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation

Abstract

Various systems and methods are provided that display schematics and data associated with the various physical components in the schematics in an interactive user interface. For example, a computing device links data stored in one or more databases with schematics displayed in one or more interactive user interfaces. The computing device parses a digital image that depicts a schematic and identifies text visible in the digital image. Based on the identified text, the computing device recognizes representations of one or more physical components in the schematic and links the representations to data regarding the physical component in one or more databases, such as specification data, historical sensor data of the component, etc. The computing device modifies the digital image such that it becomes interactive and visible in a user interface in a manner that allows the user to select a physical component and view data associated with the selection.

Claims

1. A computing system configured to access one or more databases in substantially real-time to identify and link data associated with particular physical components with representations of the particular physical components illustrated in a schematic layout of the physical components in an interactive user interface, the computing system comprising:

a computer processor; and

one or more parts databases storing entries that each include an identity of a physical component and data associated with the respective physical component;

a computer readable storage medium storing program instructions configured for execution by the computer processor in order to cause the computing system to;

access a digital image, wherein the digital image includes a schematic layout of a plurality of physical components;

parse the digital image to identify first text in the digital image;

compare the first text with identities of physical components that are included in the entries stored in the one or more parts databases;

identify a first identity stored in the one or more parts databases that matches the first text;

retrieve, from the one or more parts databases, data associated with a first physical component in the plurality of physical components identified by the first identity in the one or more parts databases;

create a link in a linkage database between the data associated with the first physical component and one or more of the first text in the digital image or an area in the digital image covered by the first physical component;

generate user interface data such that the interactive user interface displays the digital image in a first window and an interactive link at one or more of a location of the first text in the digital image or the area in the digital image covered by the first physical component, wherein the interactive link, when selected, causes the interactive user interface to display the data associated with the first physical component;

in response to selection of the first physical component in the interactive user interface, update the user interface data such that the interactive user interface concurrently displays the first window and a second window, wherein the second window overlaps the first window, and wherein the second window includes first data measured by the first physical component; and

in response to selection of a second physical component in the plurality of physical components in the interactive user interface, update the user interface data such that the interactive user interface concurrently displays the first window, the second window, and a third window, wherein the third window is different than the first and second windows and is linked to the second window, wherein the third window overlaps the first window, wherein the third window includes second data measured by the second physical component, and wherein a change to a zoom level of a graph depicting the second data in the third window causes a matching change to a zoom level of a graph depicting the first data in the second window,

wherein the second window is displayed near the first physical component and the third window is displayed near the second physical component, each of the second window and the third window obscuring respective portions of the digital image in the interactive user interface.

2. The computing system of claim 1, wherein the computer readable storage medium further stores program instructions that cause the computing system to associate, in the linkage database, one or more data series associated with the first physical component, the one or more data series including historical data regarding input values, and output values associated with the first physical component.

3. The computing system of claim 1, wherein the data associated with the first physical component comprises sensor data measured by the first physical component.

4. The computing system of claim 1, wherein the data associated with the first physical component comprises a graph depicting a relationship between the first physical component and other physical components illustrated in the schematic layout.

5. The computing system of claim 1, wherein the second data comprises sensor data measured by the second physical component.

6. The computing system of claim 1, wherein the computer readable storage medium further stores program instructions that cause the computing system to, in response to a selection of first data measured by the first physical component corresponding to a first time, update the user interface data such that the interactive user interface includes a marker in the third window at a location of second data measured by the second physical component that corresponds with the first time.

7. The computing system of claim 1, wherein the computer readable storage medium further stores program instructions that cause the computing system to, in response to a command to zoom in on the second window to a first zoom level corresponding to a first data range along a y-axis, update the user interface data such that the interactive user interface zooms in on the third window to the first zoom level so that the first data measured by the first physical component is displayed for the first data range along the y-axis and the second data measured by the second physical component is displayed for the first data range along the y-axis.

8. The computing system of claim 1, wherein the interactive user interface includes an index window that lists identities for each of the plurality of physical components illustrated in the schematic layout, and wherein the computer readable storage medium further stores program instructions that cause the computing system to, in response to a selection of an identity of the first physical component, update the user interface data to adjust a location of the digital image in the interactive user interface such that a representation of the first physical component in the schematic layout is centered in the interactive user interface.

9. The computing system of claim 1, wherein the interactive user interface includes a notes window that identifies previous changes to the schematic layout, and wherein the computer readable storage medium further stores program instructions that cause the computing system to, in response to a selection of a first note listed in the notes window, update the user interface data such that the interactive user interface identifies a third physical component illustrated in the schematic layout that is associated with the first note.

10. The computing system of claim 1, wherein the computer readable storage medium further stores program instructions that cause the computing system to, in response to the selection of the first physical component in the interactive user interface, update the user interface data such that the interactive user interface displays a note associated with the first physical component.

11. The computing system of claim 1, wherein the computer readable storage medium further stores program instructions that cause the computing system to, in response to a request to animate a flow of data through one or more of the physical components in the plurality of physical components, update the user interface data such that the interactive user interface includes an animation that indicates a sensor value as oil passes through the first physical component at a first time and the sensor value as the oil passes through a second physical component at a second time after the first time.

12. The computing system of claim 1, wherein the computer readable storage medium further stores program instructions that cause the computing system to, in response to an input providing model sensor data for the first physical component, update the user interface data such that the interactive user interface includes a prediction of a sensor value for a third physical component that is coupled to the first physical component.

13. The computing system of claim 1, wherein the first physical component is an injector on an oil platform.

14. A computer-implemented method of accessing one or more databases in substantially real-time to identify and link data associated with particular physical components with representations of the particular physical components illustrated in a schematic layout of the physical components in an interactive user interface, the computer-implemented method comprising:

accessing a digital image, wherein the digital image includes a schematic layout of a plurality of physical components;

parsing the digital image to identify first text in the digital image;

comparing the first text with identities of physical components that are included in entries stored in a parts database;

identifying a first identity stored in the parts database that matches the first text;

retrieving, from the parts database, data associated with a first physical component in the plurality of physical components identified by the first identity in the parts database;

creating a link in the parts database between the data associated with the first physical component and one or more of the first text in the digital image or an area in the digital image covered by the first physical component;

generating user interface data such that the interactive user interface displays the digital image in a first window and an interactive link at one or more of a location of the first text in the digital image or the area in the digital image covered by the first physical component, wherein the interactive link, when selected, causes the interactive user interface to display the data associated with the first physical component;

in response to selection of the first physical component in the interactive user interface, updating the user interface data such that the interactive user interface concurrently displays the first window and a second window, wherein the second window overlaps the first window, and wherein the second window includes first data measured by the first physical component; and

in response to selection of a second physical component in the plurality of physical components in the interactive user interface, updating the user interface data such that the interactive user interface concurrently displays the first window, the second window, and a third window, wherein the third window is different than the first and second windows and is linked to the second window, wherein the third window overlaps the first window, wherein the third window includes second data measured by the second physical component, and wherein a change to a zoom level of a graph depicting the second data in the third window causes a matching change to a zoom level of a graph depicting the first data in the second window,

wherein the second window is displayed near the first physical component and the third window is displayed near the second physical component, each of the second window and the third window obscuring respective portions of the digital image in the interactive user interface.

15. The computer-implemented method of claim 14, wherein the data associated with the first physical component comprises sensor data measured by the first physical component and a graph depicting a relationship between the first physical component and other physical components illustrated in the schematic layout.

16. The computer-implemented method of claim 15, wherein the second data comprises sensor data measured by the second physical component.

17. The computer-implemented method of claim 14, further comprising, in response to a selection of the first data measured by the first physical component corresponding to a first time, updating the user interface data such that the interactive user interface includes a marker in the third window at a location of the second data measured by the second physical component that corresponds with the first time.

18. The computer-implemented method of claim 14, further comprising, in response to a command to zoom in on the second window to a first zoom level corresponding to a first data range along a y-axis, updating the user interface data such that the interactive user interface zooms in on the third window to the first zoom level so that the first data measured by the first physical component is displayed for the first data range along the y-axis and the second data measured by the second physical component is displayed for the first data range along the y-axis.