Cloud-based streaming data receiver and persister
First Claim
Patent Images
1. A method for streaming and storing data, comprising:
- automatically generating a context for each application from amongst a plurality of applications that transmitted an initiation message, wherein each context for a particular application is distinct from other context associated with other applications;
receiving raw streaming data from the one or more applications;
associating a corresponding context data to a batch of the raw data sent from a particular application, wherein the associating includes;
creating a batch table, andupdating the batch table with the context data associated with the batch of raw data sent from the particular application; and
transmitting the batch of raw data and corresponding associated context data to a remote server, wherein the remote server stores the batch of raw data in memory based on the associated context data without further processing of the raw data.
14 Assignments
0 Petitions
Accused Products
Abstract
The present system receives streaming raw data and inserts context into the raw data. The context raw data may be partitioned into sub-batches and transmitted to a data receiver and persister. The raw data may include context information as well as child-parent information to assist with persisting data. The context may be used to place the data in buckets without analysis of the data, thereby saving time and resources while storing the data batches.
116 Citations
21 Claims
-
1. A method for streaming and storing data, comprising:
-
automatically generating a context for each application from amongst a plurality of applications that transmitted an initiation message, wherein each context for a particular application is distinct from other context associated with other applications; receiving raw streaming data from the one or more applications; associating a corresponding context data to a batch of the raw data sent from a particular application, wherein the associating includes; creating a batch table, and updating the batch table with the context data associated with the batch of raw data sent from the particular application; and transmitting the batch of raw data and corresponding associated context data to a remote server, wherein the remote server stores the batch of raw data in memory based on the associated context data without further processing of the raw data. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A computer readable non-transitory storage medium having embodied thereon a program, the program being executable by a processor to perform a method for streaming and storing data, the method comprising:
-
automatically generating a context for each application from amongst a plurality of applications that transmitted an initiation message, wherein each context for a particular application is distinct from other context associated with other applications; receiving raw streaming data from the one or more applications; associating a corresponding context data to a batch of the raw data sent from a particular application, wherein the associating includes; creating a batch table, and updating the batch table with the context data associated with the batch of raw data sent from the particular application; and transmitting the batch of raw data and corresponding associated context data to a remote server, wherein the remote server stores the batch of raw data in memory based on the associated context data without further processing of the raw data. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. A system for streaming and storing data, comprising:
-
a memory; a processor; and one or more modules stored in memory and executable by the processor to; automatically generate a context for each application from amongst a plurality of applications that transmitted an initiation message, wherein each context for a particular application is distinct from other context associated with other applications; receive raw streaming data from the one or more applications; associate a corresponding context data to a batch of the raw data sent from a particular application, wherein the associating includes; creating a batch table, and updating the batch table with the context data associated with the batch of raw data sent from the particular application; and the batch of raw data and corresponding associated context data to a remote server, wherein the remote server stores the batch of raw data in memory based on the associated context data without further processing of the raw data. - View Dependent Claims (16, 17, 18, 19, 20, 21)
-
Specification