Systems and methods for aggregating, filtering, and presenting streaming data

• US 10,657,137 B2
• Filed: 12/14/2016
• Issued: 05/19/2020
• Est. Priority Date: 12/14/2016
• Status: Active Grant

• Current Assignee: JP Morgan Chase Bank, N.A. (JP Morgan Chase & Co)
• Original Assignee: JP Morgan Chase Bank, N.A. (JP Morgan Chase & Co)
• Inventors: Slavin, Ilya, Legge, Mathew Alistair, Alpert, Reed
• Primary Examiner(s): Bibbee, Jared M
• Application Number:
  US15/378,501
• Publication Number:
  US 20180165334A1
• Time in Patent Office: 1,252 Days
• CPC Class Codes: G06F 16/24552 Database cache management
• CPC Class Codes: G06F 16/24568 Data stream processing; Continuous queries
• CPC Class Codes: G06F 21/6218 to a system of files or objects, e.g. local or distributed file system or database
• CPC Class Codes: G06Q 30/0201 Market modelling; Market analysis; Collecting market data
• CPC Class Codes: G06Q 40/04 Trading; Exchange, e.g. stocks, commodities, derivatives or currency exchange
• CPC Class Codes: G06Q 40/06 Asset management; Financial planning or analysis
• CPC Class Codes: H04L 63/08 for authentication of entities cryptographic mechanisms or cryptographic arrangements for entity authentication H04L9/32
• CPC Class Codes: H04L 67/568 Storing data temporarily at an intermediate stage, e.g. caching

Abstract

Systems and methods for aggregating, filtering, and presenting streaming data are disclosed. In one embodiment, a method for presenting streaming data may include (1) receiving, at web services layer for a server comprising at least one computer processor, a query from a client, wherein the query comprises a plurality of parameters; (2) a data caching layer for the server receiving streaming data from at least one predefined streaming data source; (3) the data caching layer conflating the streaming data for each of the plurality of parameters; (4) the data caching layer aggregating the conflated data; (5) the data caching layer generating a snapshot of the conflated data by simultaneously running the query against the conflated data; and (6) outputting the snapshot to the client.

Claims

1. A method for presenting streaming data, comprising:

receiving, at web services layer for a server comprising at least one computer processor, a query from a client, wherein the query comprises a plurality of parameters, and wherein the web services layer further comprises;

a control plane service;

an entitlement service;

a monitoring service; and

a configuration management service;

a data caching layer for the server receiving streaming data from at least one predefined streaming data source via corresponding data loaders, wherein;

the control plane service is configured to provide instructions to the data loaders, wherein the instructions comprise one or more of create a new subscription and move a data source that has failed to stream data;

the configuration management service provides configuration data for the data loaders, wherein the configuration data comprises one or more of information regarding a data source to connect to and how to connect to that specified data source;

the monitoring service monitoring the status of the at least one predefined streaming data source and re-routing the client query if the data source becomes unavailable; and

the entitlement service verifying that client is allowed to access the streaming data corresponding to the query;

the data caching layer conflating the streaming data for each of the plurality of parameters;

the data caching layer aggregating the conflated data;

the data caching layer generating a snapshot of the conflated data by simultaneously running the query against the conflated data; and

outputting the snapshot to the client.

2. The method of claim 1, wherein the parameters comprise a specific descriptor for at least one of a security and an investment.

3. The method of claim 1, wherein the query further comprises an identification of a streaming data source.

4. The method of claim 1, wherein the streaming data comprises market data.

5. The method of claim 1, wherein the web services layer outputs the snapshot that is delayed by a predetermined amount of time, wherein the period of time is based on one or more rule associated with the streaming data.

6. The method of claim 1, further comprising:

an entitlement services layer for the server verifying that the client is authorized to access information responsive to the query.

7. The method of claim 1, further comprising:

authenticating the client based on at least one client credential that is received from the client.

8. The method of claim 2, wherein the snapshot is accurate for the at least one of the security and the investment for a certain time.

9. The method of claim 2, wherein the snapshot comprises a proper state for the at least one of the security and the investment for a certain time.

10. A system for presenting streaming data, comprising:

a plurality of streaming data sources;

a data loader for each streaming data source, the data loader receiving streaming data from the streaming data source;

a data caching layer the receives the streaming data from the data loaders; and

a web services layer comprising at least one computer processor in communication with the data caching layer and further comprising;

a control plane service in communication with the data loaders;

an entitlement service;

a monitoring service; and

a configuration management service;

wherein;

the web services layer receiving a query from a client, wherein the query comprises a plurality of parameters;

the data caching layer conflates the streaming data for each of the plurality of parameters;

the data caching layer aggregating the conflated data;

the data caching layer generating a snapshot of the conflated data by simultaneously running the query against the conflated data;

the snapshot is output to the client;

the control plane service provides instructions to the data loaders, wherein the instructions comprise one or more of create a new subscription and move a data source that has failed to stream data;

the configuration management service provides configuration data for the data loaders, wherein the configuration data comprises one or more of information regarding a data source to connect to and how to connect to that specified data source;

the monitoring service monitors the status of the at least one predefined streaming data source and re-routing the client query if the data source becomes unavailable; and

the entitlement service verifies that client is allowed to access the streaming data corresponding to the query.

11. The system of claim 10, wherein the parameters comprise a specific descriptor for at least one of a security and an investment.

12. The system of claim 10, wherein the query further comprises an identification of a streaming data source.

13. The system claim 10, wherein the streaming data comprises market data.

14. The system of claim 10, wherein the web services layer outputs the snapshot that is delayed by a predetermined amount of time.

15. The system of claim 14, wherein the period of time is based on one or more rule associated with the streaming data.

16. The system of claim 10, wherein the query is received from at least one of a cloud application and a local application.

17. The system of claim 10, further comprising:

an entitlement services layer for the server verifying that the client is authorized to access information responsive to the query.

18. The system of claim 17, wherein the entitlement services layer further authenticates the client based on at least one client credential that is received from the client.

19. The system of claim 11, wherein the snapshot is accurate for the at least one of the security and the investment for a certain time.

20. The system of claim 11, wherein the snapshot comprises a proper state for the at least one of the security and the investment for a certain time.