VEHICLE DOMAIN MULTI-LEVEL PARALLEL BUFFERING AND CONTEXT-BASED STREAMING DATA PRE-PROCESSING SYSTEM

• US 20170155696A1
• Filed: 11/15/2016
• Published: 06/01/2017
• Est. Priority Date: 12/01/2015
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Li, Chang Sheng, Ma, Chun Yang, Dong, Wei Shan, Gao, Peng, Duan, Ning, Zhang, Xin, Zhu, Jun
• Granted Patent: US 9,723,041 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 9/4881 Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
• CPC Class Codes: G08G 1/0112 from the vehicle, e.g. floating car data [FCD]
• CPC Class Codes: H04L 65/61 for supporting one-way streaming services, e.g. Internet radio
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks

Abstract

A vehicle domain multi-level parallel buffering and context-based streaming data pre-processing system includes a first data processing level and a second data processing level. The first data processing level includes a first-level buffer configured to buffer data provided from a plurality of raw data streams output from a plurality of vehicles. The second data processing level includes an electronic task-queue-dictionary (TQD) module and a plurality of second-level data processing buffers. The TQD module is configured to create a plurality of tasks in response to receiving a serial data stream output from the first-level buffer. The TQD module is further configured to assign each task to a corresponding second-level buffer, and separate the serial data stream into individual data values that are delivered to a specific second-level buffer based on the task so as to generate a multi-level parallel context-based buffering operation.

Claims

1. A vehicle domain multi-level parallel buffering and context-based streaming data pre-processing system comprising:

a first data processing level including a first-level buffer configured to store high volume data received from a plurality of different vehicles; and

a second data processing level in signal communication with the first data processing level, the second data processing level including an electronic task-queue-dictionary (TQD) module and a plurality of second-level data processing buffers, the TQD module configured to create a plurality of process operating tasks based on the high volume data output from the first-level buffer, the process operating tasks corresponding to available processing operations performed by a local vehicle operating in the vehicle domain multi-level parallel buffering and context-based streaming and data pre-processing system, each process operating task corresponding to a request from a respective vehicle among the plurality of vehicles,

wherein the TQD module separates the high volume data into individual data values having a data volume less than the high-volume data, the individual data values indicative of a given processing task among the created processing tasks based on a comparison between the requested tasks and the available processing operations, and wherein the TQD module stores each individual data value in a respective second-level buffer assigned to store given individual data values corresponding to the processing operation task of the individual data value.

2. The system of claim 1, wherein the TQD module delivers the individual data values in parallel to the corresponding second-level buffers.

3. The system of claim 2, wherein the individual data values include vehicle identification information, and the TQD module assigns a buffer identification value to each second-level buffer such that the individual data values are loaded into a corresponding second-level buffer having a buffer identification value that matches the vehicle identification information.

4. The system of claim 2, wherein the TQD module limits each vehicle to a single working task created in the second data processing level.

5. The system of claim 2, wherein the TQD module loads each second-level buffer based on a timestamp indicated by a respective individual data value.

6. A method of processing data streams in a vehicle domain, the method comprising:

storing, in a first data processing level including a first-level buffer, high volume data received from a plurality of different vehicles;

creating, via an electronic task-queue-dictionary (TQD) module installed in a second data processing level in signal communication with the first data processing level, a plurality of process operating tasks based on the high volume data output from the first-level buffer, the process operating tasks corresponding to available processing operations performed by a local vehicle operating in the vehicle domain multi-level parallel buffering and context-based streaming and data pre-processing system, each process operating task corresponding to a request from a respective vehicle among the plurality of vehicles;

separating, via the TQD module, the high volume data into individual data values having a data volume less than the high-volume data, the individual data values indicative of a given processing task among the created processing tasks based on a comparison between the requested tasks and the available processing operations; and

storing each individual data value in a respective second-level buffer installed in the second data processing level, the second-level buffer assigned to store data values corresponding to the processing operation task of the individual data value.

7. The method of claim 6, wherein the TQD module delivers the individual data values in parallel to the corresponding second-level buffers.

8. The method of claim 7, further comprising embedding vehicle identification information in the individual data values, wherein the TQD module assigns a buffer identification value to each second-level buffer such that the individual data values are loaded into a corresponding second-level buffer having a buffer identification value that matches the vehicle identification information.

9. The method of claim 7, wherein the TQD module limits each vehicle to a single working task created in the second data processing level.

10. The method of claim 7, wherein the TQD module loads each second-level buffer based on a timestamp indicated by a respective individual data value.

11. A computer program product to control a vehicle domain multi-level parallel buffering and context-based streaming data pre-processing system, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by an electronic computer processor such that the system performs operations comprising:

storing, in a first data processing level including a first-level buffer, high volume data received from a plurality of different vehicles;

creating, via an electronic task-queue-dictionary (TQD) module installed in a second data processing level in signal communication with the first data processing level, a plurality of process operating tasks based on the high volume data output from the first-level buffer, the process operating tasks corresponding to available processing operations performed by a local vehicle operating in the vehicle domain multi-level parallel buffering and context-based streaming and data pre-processing system, each process operating task corresponding to a request from a respective vehicle among the plurality of vehicles;

separating, via the TQD module, the high volume data into individual data values having a data volume less than the high-volume data, the individual data values indicative of a given processing task among the created processing tasks based on a comparison between the requested tasks and the available processing operations; and

storing each individual data value in a respective second-level buffer installed in the second data processing level, the second-level buffer assigned to store given individual data values corresponding to the processing operation task of the individual data value.

12. The computer program product of claim 11, wherein the operations further comprise delivering the individual data values in parallel to the corresponding second-level buffers.

13. The computer program product of claim 12, wherein the operations further comprise embedding vehicle identification information in the individual data values, and assigning a buffer identification value to each second-level buffer such that the individual data values are loaded into a corresponding second-level buffer having a buffer identification value that matches the vehicle identification information.

14. The computer program product of claim 12, wherein the operations further comprise limiting each vehicle to a single working task created in the second data processing level.

15. The computer program product of claim 12, wherein the operations further comprise loading each second-level buffer based on a timestamp indicated by a respective individual data value.