Batching data requests and responses

• US 10,412,187 B2
• Filed: 10/12/2016
• Issued: 09/10/2019
• Est. Priority Date: 10/13/2015
• Status: Active Grant

• Current Assignee: Home Box Office Incorporated (Warner Bros. Discovery, Inc.)
• Original Assignee: Home Box Office Incorporated (Warner Bros. Discovery, Inc.)
• Inventors: Busayarat, Sata, Furtwangler, Brandon C., Furtwangler, Steven N.
• Primary Examiner(s): Chacko, Joe
• Application Number:
  US15/291,810
• Publication Number:
  US 20170104838A1
• Time in Patent Office: 1,063 Days
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G06T 1/60 Memory management
• CPC Class Codes: G06T 11/206 Drawing of charts or graphs
• CPC Class Codes: H04L 41/5054 Automatic deployment of services triggered by the service manager, e.g. service implementation by automatic configuration of network components
• CPC Class Codes: H04L 43/045 for graphical visualisation of monitoring data
• CPC Class Codes: H04L 43/10 Active monitoring, e.g. heartbeat, ping or trace-route
• CPC Class Codes: H04L 43/55 Testing of service level quality, e.g. simulating service usage
• CPC Class Codes: H04L 65/1045 Proxies, e.g. for session initiation protocol [SIP]
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/34 involving the movement of software or configuration parameters network booting or remote initial program loading [RIPL] G06F9/4416
• CPC Class Codes: H04L 67/51 Discovery or management thereof, e.g. service location protocol [SLP] or web services
• CPC Class Codes: H04L 67/56 Provisioning of proxy services store-and-forward switching systems in data switching networks H04L12/54
• CPC Class Codes: H04L 67/566 Grouping or aggregating service requests, e.g. for unified processing
• CPC Class Codes: H04L 67/568 Storing data temporarily at an intermediate stage, e.g. caching
• CPC Class Codes: H04L 67/5682 Policies or rules for updating, deleting or replacing the stored data
• CPC Class Codes: H04L 67/60 Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources admission control or resource allocation H04L47/70
• CPC Class Codes: H04N 21/251 Learning process for intelligent management, e.g. learning user preferences for recommending movies details of learning user preferences for the retrieval of video data in a video database G06F16/739; computer systems using learning methods G06N3/08
• CPC Class Codes: H04N 21/43 : Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware real-time communication protocols in data switching networks H04L65/00
• CPC Class Codes: H04N 21/4332 : by placing content in organized collections, e.g. local EPG data repository interfaces, Database management systems or updating for information retrieval G06F16/23; details of retrieval of video data and associated meta data in video database G06F16/739
• CPC Class Codes: H04N 21/4821 : using a grid, e.g. sorted out by channel and broadcast time
• CPC Class Codes: H04N 21/4826 : using recommendation lists, e.g. of programs or channels sorted out according to their score

Abstract

The described technology is generally directed towards batching two or more data requests into a batch request that is sent to a data-providing entity such as a client data access layer coupled to a data service. Described is maintaining a mapping of the requests to requesting entities so that the responses to a batched request, which may be separately streamed, may be assembled into a batch response to the requesting entity. Also described is multiplexing a plurality of requests for the same data item into a single request, which may be added to a batch request, and de-multiplexing the single response into separate responses to each requesting entity.

Claims

1. One or more non-transitory machine-readable storage media having machine-executable instructions, which when executed perform operations, the operations comprising:

receiving a first request for a first data item from a first requestor;

maintaining first mapping data including associating the first requestor with the first data item;

receiving a second request for a second data item from a second requestor;

maintaining second mapping data including associating the second requestor with the second data item;

sending a batch request that includes a plurality of requests to a data-providing entity, the batch request including requests corresponding to the first request and the second request;

receiving response information from the data-providing entity in response to the batch request, including first response information corresponding to the first data item and second response information corresponding to the second data item;

accessing the first mapping data to return a first response corresponding to the first response information to the first requestor;

accessing the second mapping data to return a second response corresponding to the second response information to the second requester; and

wherein the first request for the first data item is part of a multiple data item request that further includes a request for another data item, and wherein the accessing the first mapping data to return the first response corresponding to the first response information to the first requestor comprises including the first response as part of a batch response to the first requestor.

2. The one or more non-transitory machine-readable storage media of claim 1, wherein the multiple data item request is a first multiple data item request and wherein the second request for the second data item comprises a second multiple data item request that includes a request for the second data item and a request for the first data item, wherein maintaining the second mapping data further includes associating the second requestor with the first data item, wherein sending the batch request includes having only one request for the first data item in the batch request, and wherein the accessing the second mapping data to return the second response comprises returning a response to the second multiple data item request that includes at least part of the first response information and the second response information to the second requestor.

3. The one or more non-transitory machine-readable storage media of claim 1, wherein the operations further comprise determining whether another request for the first data item is already pending, and in response to determining that another request for the first data item is not already pending, adding an identifier of the first data item to a batch buffer, and in response to determining that another request for the first data item is already pending, not adding an identifier of the first data item to a batch buffer.

4. A method, comprising:

receiving a first request for a first data item from a first requestor;

maintaining first mapping data, including associating the first requestor with the first data item;

receiving a second request for a second data item from a second requestor, wherein the second request comprises a multiple data item request that includes a request for the second data item and a request for the first data item;

maintaining second mapping data including associating the second requestor with the second data item and associating the second requestor with the first data item;

sending a batch request comprising a plurality of requests to a data-providing entity, the batch request comprising requests corresponding to the first request and the second request, and wherein the batch request comprises only one request for the first data item;

receiving response information from the data-providing entity in response to the batch request, including first response information corresponding to the first data item and second response information corresponding to the second data item;

accessing the first mapping data to return a first response corresponding to the first response information to the first requestor; and

accessing the second mapping data to return a second response to the multiple data item request that corresponds to the second response information to the second requestor, comprising returning the second response that includes the first response information and the second response information to the second requestor.

5. The method of claim 4, wherein the first request for the first data item is part of another multiple data item request that further includes a request for another data item, and wherein accessing the first mapping data to return the first response corresponding to the first response information to the first requestor comprises including the first response as part of a batch response to the first requestor.

6. The method of claim 4, further comprising determining that another request for the first data item is not already pending, and in response to the determining, adding an identifier of the first data item to a batch buffer.

7. The method of claim 6, further comprising determining a sending time for sending the batch buffer based on determining when a time frame is reached.

8. The method of claim 6, further comprising, determining that the batch buffer is full, and starting a new batch buffer.

9. The method of claim 8, further comprising, adding an identifier of another identified data item to the new batch buffer.

10. The method of claim 4, further comprising adding an identifier of the first data item to a pending set.

11. The method of claim 4, further comprising determining that another request for the first data item is already pending, and in response to the determining, not adding an identifier of the first data item to a batch buffer.

12. A system, comprising:

a processor; and

a memory that stores executable instructions that, when executed by the processor, facilitate performance of operations, the operations comprising;

receiving a first request from a first requestor, the first request comprising a multiple data item request requesting at least one data item and another data item;

maintaining first mapping data, comprising associating the first requestor with the at least one data item and the other data item;

receiving a second request for a second data item from a second requestor;

maintaining second mapping data, comprising associating the second requestor with the second data item;

sending a batch request comprising a plurality of requests to a data-providing entity, the batch request comprising requests corresponding to the first request and the second request;

receiving response information from the data-providing entity in response to the batch request, including first response information corresponding to the first request and second response information corresponding to the second request;

accessing the first mapping data to return a first response as a batch response corresponding to the first response information to the first requestor; and

accessing the second mapping data to return a second response to the multiple data item request corresponding to the second response information to the second requestor.

13. The system of claim 12, wherein the operations further comprise combining a plurality of requests for a same data item from the first requestor and the second requestor into a single request to the data-providing entity.

14. The system of claim 12, wherein the first request for the first data item is part of another multiple data item request that further includes a request for another data item, and wherein accessing the first mapping data to return the first response corresponding to the first response information to the first requestor comprises including the first response as part of a batch response to the first requestor.

15. The system of claim 12, wherein the operations further comprise determining that another request for the first data item is not already pending, and in response to the determining, adding an identifier of the first data item to a batch buffer.

16. The system of claim 12, wherein the operations further comprise determining a sending time for sending the batch buffer based on determining when a time frame is reached.

17. The system of claim 12, wherein the operations further comprise determining that the batch buffer is full, and starting a new batch buffer.

18. The system of claim 12, wherein the operations further comprise adding an identifier of another identified data item to the new batch buffer.

19. The system of claim 12, wherein the operations further comprise adding an identifier of the first data item to a pending set.

20. The system of claim 12, wherein the operations further comprise determining that another request for the first data item is already pending, and in response to the determining, not adding an identifier of the first data item to a batch buffer.