Data processing apparatus, data processing method, and program

• US 9,146,927 B2
• Filed: 06/18/2010
• Issued: 09/29/2015
• Est. Priority Date: 06/18/2010
• Status: Active Grant

• Current Assignee: Mitsubishi Electric Corporation
• Original Assignee: Mitsubishi Electric Corporation
• Inventors: Hirai, Norio, Kori, Mitsunori
• Primary Examiner(s): Corrielus, Jean M
• Assistant Examiner(s): Sultana, Nargis
• Application Number:
  US13/805,123
• Publication Number:
  US 20130103643A1
• Time in Patent Office: 1,929 Days
• Field of Search: 707/609, 707/737
• US Class Current: 1/1
• CPC Class Codes: G06F 16/11 File system administration, e.g. details of archiving or snapshots file system backup G06F11/14
• CPC Class Codes: G06F 16/116 Details of conversion of file system types or formats
• CPC Class Codes: G06F 16/20 of structured data, e.g. relational data
• CPC Class Codes: G06F 16/285 Clustering or classification

Abstract

A data receiving part receives data transmitted from a plurality of measuring devices. A time determining part distinguishes management time from date and time of the data. The record generating part stores data of the same management time which are received during a predetermined acceptance time, in the same record. When un-arrived data belonging to the same management time exists at the end of the acceptance time, arrival of the un-arrived data is waited for during a predetermined wait time. Even if the data is arrived with some delay, arrival-delayed data can be stored in the same record. Thus, the missing data occurrence frequency can be suppressed.

Claims

1. A data processing apparatus which manages a record based on a plurality of management time periods each having a predetermined width, comprising:

a data receiver that receives a plurality of pieces of data from a plurality of data transmission apparatuses, the pieces of data having been transmitted by the plurality of data transmission apparatuses periodically according to a predetermined period, the pieces of received data each including a time stamp indicating time;

a time determining part which, each time the data receiver receives a piece of data, determines the management time period in the plurality of management time periods that corresponds to the time of the time stamp in the received piece of data based on the predetermined width of the management time period, and classifies the received piece of data under the determined management time period;

a record generating part that generates a record by arranging a first piece of data, which is classified by the time determining part under the determined management time period and which is inputted from the time determining part during a predetermined acceptance time since a start of input of data classified under the determined management time period, adds to the record a second piece of data classified under the determined management time period and inputted from the time determining part after an end of an acceptance time period and before an end of a wait time, and if a piece of data from one or more of the plurality of data transmission apparatuses has not been inputted yet at the end of the wait time, determines that an un-arrived data exists, and adds a value representing the existence of the un-arrived data to the record, and completes generation of the record; and

a table adding part that receives the record completely generated from the record generation part, and adds the record completely generated by the record generation part, to a predetermined table, wherein

the record generating part, when the un-arrived data exists, determines whether or not to wait for input of the un-arrived data at the end of the acceptance time based on predetermined configuration data,

if input of the un-arrived data is determined to be waited for, the record generating part waits for input of the un-arrived data during the wait time, and if input of the un-arrived data is determined not to be waited for, the record generating part adds the value representing the existence of the un-arrived data to the record at the end of the acceptance time,

the data receiver receives data transmitted from the plurality of data transmission apparatuses at every predetermined period,

the data processing apparatus further comprises a delay status monitoring part which monitors a delay status of data reception based on the data that the data receiver receives from the plurality of data transmission apparatuses for each of the data transmission apparatuses, and

the record generation part, if the un-arrived data exists, determines whether or not to wait for input of the un-arrived data based on a monitoring result of the delay status monitoring part for a data transmission apparatus which is a sender of the un-arrived data.

2. The data processing apparatus according to claim 1,

wherein the record generating part, if data classified under a previous management time period is inputted, with a delay, from the time determining part, generates a record of delay data inputted with the delay, and completes generation of the record, and

the table adding part adds the record that describes the delay data and that is completely generated by the record generating part, to the table.

3. The data processing apparatus according to claim 1,

wherein the delay status monitoring part counts the number of times data is received behind an appropriate reception timing consecutively, as a number of times of consecutive delay, for each of the data transmission apparatuses, and

wherein the record generating part, if the number of times of consecutive delay of a data transmission apparatus, being the sender of the un-arrived data, is equal to or smaller than a predetermined threshold, waits for input of the un-arrived data, and if the number of times of consecutive delay of the data transmission apparatus, being the sender of the un-arrived data, exceeds the threshold, does not wait for input of the un-arrived data.

4. The data processing apparatus according to claim 1,

wherein the delay status monitoring part counts a number of times data is received behind an appropriate reception timing within a predetermined monitor period, as a number of times of delay occurrence, for each of the data transmission apparatuses, and

wherein the record generating part, if the number of times of delay occurrence of a data transmission apparatus, being the sender of the un-arrived data, is equal to or smaller than a predetermined threshold, waits for input of the un-arrived data, and if the number of times of delay occurrence of the data transmission apparatus, being the sender of the un-arrived data, exceeds the threshold, does not wait for input of the un-arrived data.

5. The data processing apparatus according to claim 1,

wherein the delay status monitoring part, each time data is received behind an appropriate reception timing, measures a delay time behind the appropriate reception timing, and calculates an average value of the measured delay time within a predetermined monitoring period for each of the data transmission apparatuses, and

wherein the record generating part, if the average value of the delay time of a data transmission apparatus, being the sender of the un-arrived data, is equal to or smaller than a predetermined threshold, waits for input of the un-arrived data, and if the average value of the delay time of the data transmission apparatus, being the sender of the un-arrived data, exceeds the threshold, does not wait for input of the un-arrived data.

6. The data processing apparatus according to claim 1,

wherein the record generating part, if a plurality of un-arrived data exist, determines whether or not to wait for input of each of the un-arrived data.

7. The data processing apparatus according to claim 1,

wherein the record generating part, if all data classified under a current record target management time are stored in the record by the end of the acceptance time, completes generation of the record without waiting for the end of the acceptance time.

8. The data processing apparatus according to claim 1,

wherein the table adding part, if generation of a record by the record generating part is completed before the end of the wait time, adds the completely generated record to the table without waiting for the end of the wait time.

9. The data processing apparatus according to claim 1,

wherein the time determining part, each time data is received by the data receiver, determines management time corresponding to time of a time stamp added to the received data, by executing any one operation of round-up, round-off, and round-down of the time of the time stamp.

10. The data processing apparatus according to claim 1,

wherein the data receiver receives data indicating a measurement value measured by each of a plurality of measuring devices, to be related to device ID (Identification) of a measuring device,

wherein the data processing apparatus further includes a configuration information storing part which stores configuration information that designates a position of data in a record, for each device ID, and

wherein the record generating part generates a record by arranging data classified under a current record target management time, at positions designated by the configuration information, based on the device ID related to the data inputted from the time determining part.

11. The data processing apparatus according to claim 10,

wherein the data receiver receives data indicating a measurement value measured by each of a plurality of measuring devices installed at a plurality of locations, and

wherein the configuration information storing part stores configuration information representing at least one of:

an installation location of a measuring device;

an attribute of the measurement value; and

a precision of the measurement value, for each device ID.

12. The data processing apparatus according to claim 1, wherein the data receiver receives the plurality of pieces of data from the plurality of data transmission apparatuses via a communication network that is subject to congestion so that a reception of one or more of the pieces of data is delayed more than a reception of another one or more pieces of data.

13. The data processing apparatus according to claim 1, wherein a duration of the acceptance time period is equal to half of the predetermined width of each management time period.

14. A data processing method executed by a computer that manages a record based on a plurality of management time periods each having a predetermined width, the method comprising:

receiving, by the computer, pieces of data from a plurality of data transmission apparatuses, the pieces of data having been transmitted by the plurality of data transmission apparatuses periodically according to a predetermined period, the received pieces of data each including a time stamp indicating time;

each time a piece of data is received, determining, by the computer, the management time period in the plurality of management time periods that corresponds to the time of the time stamp in the received piece of data, and classifying the received piece of data under the determined management time;

generating a record by arranging a first piece of data, which is classified under the determined management time period and which is received during a predetermined acceptance time since a start of reception of data classified under the determined management time period;

adding to the record a second piece of data classified under the determined management time period and received after an end of the predetermined acceptance time;

and before an end of a predetermined wait time;

if a piece of data from one or more of the plurality of data transmission apparatuses has not been received yet at the end of the wait time, determining that an un-arrived data exists, and adding a value representing the existence of the un-arrived data to the record, and completing generation of the record;

adding the record completely generated, to a predetermined table, wherein

when the un-arrived data exists, determining whether or not to wait for input of the un-arrived data at the end of the acceptance time based on predetermined configuration data,

if input of the un-arrived data is determined to be waited for, waiting for input of the un-arrived data during the wait time, and if input of the un-arrived data is determined not to be waited for, adding the value representing the existence of the un-arrived data to the record at the end of the acceptance time;

receiving data transmitted from the plurality of data transmission apparatuses at every predetermined period; and

monitoring a delay status of data reception based on the data received from the plurality of data transmission apparatuses for each of the data transmission apparatuses, wherein

if the un-arrived data exists, determining whether or not to wait for input of the un-arrived data based on a monitoring result of the delay status for a data transmission apparatus which is a sender of the un-arrived data.

15. The method according to claim 14, further comprising:

receiving the plurality of pieces of data from the plurality of data transmission apparatuses via a communication network that is subject to congestion so that a reception of one or more of the pieces of data is delayed more than a reception of another one or more pieces of data.

16. The method according to claim 14, wherein a duration of the acceptance time period is equal to half of the predetermined width of each management time period.

17. A non-transitory computer readable medium which causes a computer that manages a record based on management time of a predetermined width, to execute:

a data reception process of receiving pieces of data from a plurality of data transmission apparatuses, the pieces of data having been transmitted by the plurality of data transmission apparatuses periodically according to a predetermined period, the received pieces of data each including a time stamp indicating time;

a time determining process of determining, each time a piece of data is received, the management time period in the plurality of management time periods that corresponds to the time of the time stamp in the received piece of data, and classifying the received piece of data under the determined management time;

a record generating process of generating a record by arranging a first piece of data, which is classified under the determined management time period and which is received during a predetermined acceptance time since a start of reception of data classified under the determined management time period;

adding to the record a second piece of data classified under the determined management time period and received after an end of the predetermined acceptance time; and

before an end of a predetermined wait time, and if a piece of data from one or more of the plurality of data transmission apparatuses has not been received yet at the end of the wait time, determining that an un-arrived data exists, and adding a value representing the existence of the un-arrived data to the record, and completing generation of the record;

a table adding process of adding the record completely generated by the record generation process, to a predetermined table, wherein

the record generating process includes, when the un-arrived data exists, determining whether or not to wait for input of the un-arrived data at the end of the acceptance time based on predetermined configuration data,

if input of the un-arrived data is determined to be waited for, the record generating process includes waiting for input of the un-arrived data during the wait time, and if input of the un-arrived data is determined not to be waited for, the record generating process includes adding the value representing the existence of the un-arrived data to the record at the end of the acceptance time,

the data reception process includes receiving data transmitted from the plurality of data transmission apparatuses at every predetermined period; and

a delay status monitoring process of monitoring a delay status of data reception based on the data received from the plurality of data transmission apparatuses for each of the data transmission apparatuses, wherein

the record generation process includes, if the un-arrived data exists, determining whether or not to wait for input of the un-arrived data based on a monitoring result of the delay status monitoring process for a data transmission apparatus which is a sender of the un-arrived data.

18. The medium according to claim 17, further causes the computer to execute the data reception process of receiving the plurality of pieces of data from the plurality of data transmission apparatuses via a communication network that is subject to congestion so that a reception of one or more of the pieces of data is delayed more than a reception of another one or more pieces of data.

19. The medium according to claim 17, wherein a duration of the acceptance time period is equal to half of the predetermined width of each management time period.