Object modeling for exploring large data sets

• US 9,229,966 B2
• Filed: 04/04/2011
• Issued: 01/05/2016
• Est. Priority Date: 09/15/2008
• Status: Active Grant

• Current Assignee: Palantir Technologies Incorporated
• Original Assignee: Palantir Technologies Incorporated
• Inventors: Aymeloglu, Andrew, Simler, Kevin, Poirier, Eric, Tan, Garry, Burr, Brandon
• Primary Examiner(s): Wong, Eric T
• Application Number:
  US13/079,690
• Publication Number:
  US 20110179042A1
• Time in Patent Office: 1,737 Days
• Field of Search: 705/36.R, 707/776
• US Class Current: 1/1
• CPC Class Codes: G06F 16/2228 Indexing structures
• CPC Class Codes: G06F 16/283 Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
• CPC Class Codes: G06Q 10/06 Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
• CPC Class Codes: G06Q 30/0201 Market modelling; Market analysis; Collecting market data
• CPC Class Codes: G06Q 40/06 Asset management; Financial planning or analysis

Abstract

Techniques are described for facilitating performing computer-implemented financial analysis. A metric that transforms one or more time series into an output object is identified. The one or more time series are determined based on one or more input objects. The metric is applied using the one or more time series, thereby generating a particular value for the output object. One of the metric and the particular value for the output object is stored in a physical storage device.

Claims

1. A computer-implemented method comprising:

accessing, by a data analysis system computer under program control of a data exploring logic, an object model stored on one or more computer-readable storage media, the object model comprising;

a plurality of zero-order building block objects comprising a plurality of instruments corresponding to raw data that dynamically increases over time, wherein the zero-order building block objects are not decomposable into other objects;

a plurality of higher-order objects that are decomposable into two or more of the zero-order building block objects; and

a plurality of metrics that transform one or more input objects into an output object;

providing, to a user for execution on a client computing device, a data analysis application that includes an interface for dynamically creating a custom metric object;

receiving from the client computing device, by the data analysis system computer, user input comprising an expression that defines a new custom metric, the expression identifying a first metric configured to group two or more input objects, selected from the plurality of zero-order building block objects and the plurality of higher-order objects, into an output collection object;

adding, by the data analysis system computer, the new custom metric to the object model stored on the one or more computer-readable storage media;

dynamically loading the new custom metric into the data analysis system computer as a part of the data exploring logic;

after loading the new custom metric, dynamically providing access to the new custom metric in the application executing on the client computing device;

receiving from the client computing device, by the data analysis system computer, user input identifying the new custom metric and one or more input collection objects of the plurality of higher-order objects of the object model stored on the one or more computer-readable storage media;

decomposing, by the data analysis system computer, the one or more input collection objects into two or more child objects based on the object model;

applying, by the data analysis system computer, the new custom metric to the one or more input collection objects by generating an output object based on the raw data corresponding to the two or more child objects.

2. The method of claim 1, wherein at least one of the output collection object and the one or more input collection objects is an instrument group that comprises one or more instruments selected from a universe of instruments using a filter chain.

3. The method of claim 1, wherein the object model is specified in a document that specifies a tree, wherein the plurality of instruments are represented by leaf nodes of the tree, wherein the plurality of higher-order objects are represented by non-leaf nodes of the tree, wherein an object represented by a non-leaf node in the tree is decomposable into objects represented by nodes descending from the non-leaf node.

4. The method of claim 1, wherein the new custom metric is a specified as a token by a user after a data analysis system is deployed, and wherein the new custom metric can be immediately accessed by referring to the token after the new custom metric is dynamically loaded into the data analysis system as a part of computing logic of the data analysis system.

5. The method of claim 1, wherein the two or more child objects include at least one time series whose value is not associated with an instrument.

6. The method of claim 1, wherein the plurality of instruments comprises one or more ontological relationships among all instruments in the plurality of instruments.

7. The method of claim 1, wherein the metric includes one or more input arguments whose runtime values influence runtime behaviors of the metric.

8. The method of claim 1, wherein at least one of the output collection object and the input collection object is an index that indicates a collective value of one or more instruments.

9. The method of claim 1, wherein at least one of the output collection object and the input collection object is a portfolio that comprises at least one instrument, at least one date set, and one or more trades that refer to times represented in the at least one date set.

10. A non-transitory machine-readable storage medium comprising one or more program instructions recorded thereon, which instructions, when executed by one or more processors, cause the one or more processors to perform the steps of:

accessing, by a data analysis system computer under program control of a data exploring logic, an object model stored on one or more computer-readable storage media, the object model comprising;

a plurality of zero-order building block objects comprising a plurality of instruments corresponding to raw data that dynamically increases over time, wherein the zero-order building block objects are not decomposable into other objects;

a plurality of higher-order objects that are decomposable into two or more of the zero-order building block objects; and

a plurality of metrics that transform one or more input objects into an output object;

providing, to a user for execution on a client computing device, a data analysis application that includes an interface for dynamically creating a custom metric object;

receiving from the client computing device, by the data analysis system computer, user input comprising an expression that defines a new custom metric, the expression identifying a first metric configured to group two or more input objects, selected from the plurality of zero-order building block objects and the plurality of higher-order objects, into an output collection object;

adding, by the data analysis system computer, the new custom metric to the object model stored on the one or more computer-readable storage media;

dynamically loading the new custom metric into the data analysis system computer as a part of the data exploring logic;

after loading the new custom metric, dynamically providing access to the new custom metric in the application executing on the client computing device;

receiving from the client computing device, by the data analysis system computer, user input identifying the new custom metric and one or more input collection objects of the object model stored on the one or more computer-readable storage media;

decomposing, by the data analysis system computer, the one or more input collection objects into two or more child objects based on the object model;

applying, by the data analysis system computer, the new custom metric to the one or more input collection objects by generating an output object based on the raw data corresponding to the two or more child objects.

11. The medium of claim 10, wherein at least one of the output collection object and the one or more input collection objects is an instrument group that comprises one or more instruments selected from a universe of instruments using a filter chain.

12. The medium of claim 10, wherein the object model is specified in a document that specifies a tree, wherein the plurality of instruments are represented by leaf nodes of the tree, wherein the plurality of higher-order objects are represented by non-leaf nodes of the tree, wherein an object represented by a non-leaf node in the tree is decomposable into objects represented by nodes descending from the non-leaf node.

13. The medium of claim 10, wherein the new custom metric is specified as a token by a user after a data analysis system is deployed, and wherein the new custom metric can be immediately accessed by referring to the token after the new custom metric is dynamically loaded into the data analysis system as a part of computing logic of the data analysis system.

14. The medium of claim 10, wherein the two or more child objects include at least one time series whose value is not associated with an instrument.

15. The medium of claim 10, wherein the plurality of instruments comprises one or more ontological relationships among all instruments in the plurality of instruments.

16. The medium of claim 10, wherein the metric include one or more input arguments whose runtime values influence runtime behaviors of the metric.

17. The medium of claim 10, wherein at least one of the output collection object and the input collection object is an index that indicates a collective value of one or more instruments.

18. The medium of claim 10, wherein at least one of the output collection object and the input collection object is a portfolio that comprises at least one instrument, at least one date set, and one or more trades that refer to times represented in the at least one date set.

19. An application server comprising:

a network interface that is coupled to a data network for receiving one or more packet flows therefrom;

a processor; and

one or more stored program instructions for data exploration logic which, when executed by the processor, cause the processor to carry out the steps of;

accessing an object model stored on one or more computer-readable storage media, the object model comprising;

a plurality of zero-order building block objects comprising a plurality of instruments corresponding to raw data that dynamically increases over time, wherein the zero-order building block objects are not decomposable into other objects;

a plurality of higher-order objects that are decomposable into two or more of the zero-order building block objects; and

a plurality of metrics that transform one or more input objects into an output object;

providing, to a user for execution on a client computing device, a data analysis application that includes an interface for dynamically creating a custom metric object;

receiving user input comprising an expression that defines a new custom metric, the expression identifying a first metric configured to group two or more input objects, selected from the plurality of zero-order building block objects and the plurality of higher-order objects, into an output collection object;

adding the new custom metric to the object model stored on the one or more computer-readable storage media;

dynamically loading the new custom metric as a part of the data exploring logic;

after loading the new custom metric, dynamically providing access to the new custom metric in the application executing on the client computing device;

receiving user input identifying the new custom metric and one or more input collection objects of the object model stored on the one or more computer-readable storage media;

decomposing the one or more input collection objects into two or more child objects based on the object model;

applying the new custom metric to the one or more input collection objects by generating an output object based on the raw data corresponding to the two or more child objects.

20. The application server of claim 19, wherein at least one of the output collection object and the one or more input collection objects is an instrument group that comprises one or more instruments selected from a universe of instruments using a filter chain.

21. The application server of claim 19, wherein the object model is specified in a document that specifies a tree, wherein the plurality of instruments are represented by leaf nodes of the tree, wherein the plurality of higher-order objects are represented by non-leaf nodes of the tree, wherein an object represented by a non-leaf node in the tree is decomposable into objects represented by nodes descending from the non-leaf node.

22. The application server of claim 19, wherein the new custom metric is specified as a token by a user after a data analysis system is deployed, and wherein the new custom metric can be immediately accessed by referring to the token after the new custom metric is dynamically loaded into the data analysis system as a part of computing logic of the data analysis system.

23. The application server of claim 19, wherein the two or more child objects include at least one time series whose value is not associated with an instrument.

24. The application server of claim 19, wherein the plurality of instruments comprises one or more ontological relationships among all instruments in the plurality of instruments.

25. The application server of claim 19, wherein the metric include one or more input arguments whose runtime values influence runtime behaviors of the metric.

26. The application server of claim 19, wherein at least one of the output collection object and the input collection object is an index that indicates a collective value of one or more instruments.

27. The application server of claim 19, wherein at least one of the output collection object and the input collection object is a portfolio that comprises at least one instrument, at least one date set, and one or more trades that refer to times represented in the at least one date set.