SYSTEM AND METHOD OF SORTING AND CALCULATING STATISTICS ON LARGE DATA SETS WITH A KNOWN VALUE RANGE

• US 20110010509A1
• Filed: 07/07/2009
• Published: 01/13/2011
• Est. Priority Date: 07/07/2009
• Status: Abandoned Application

• Current Assignee: L-3 Communications Integrated Systems LP (L3Harris Technologies, Inc.)
• Original Assignee: L-3 Communications Integrated Systems LP (L3Harris Technologies, Inc.)
• Inventors: Allen, Jim D., Fox, Michael O'Neal, Flores, Juan Esteban
• Application Number:
  US12/498,824
• Publication Number:
  US 20110010509A1
• Time in Patent Office: Days
• US Class Current: 711/154
• CPC Class Codes: G06F 7/24 Sorting, i.e. extracting data from one or more carriers, rearranging the data in numerical or other ordered sequence, and rerecording the sorted data on the original carrier or on a different carrier or set of carriers sorting methods in generalG06F7/36 takes precedence

Abstract

A system for sorting data and calculating statistics on large data sets with a known value range includes a memory element and a processing element configured to execute steps of the methods. Methods for sorting data include establishing an array of counters such that each counter corresponds to a value in the data set, reading the numbers and incrementing the counter corresponding to the value of each number, and listing the values in sequential order wherein each value occurs in the list according to the count of the corresponding counter. Methods for calculating statistics utilize the count stored in each counter from the sorted data and the value that corresponds thereto.

Claims

1. A system comprising:

a memory element configured to store processing element executable instructions; and

a processing element configured to—

establish an array of counters such that each counter corresponds to each value in a data set of numbers, and

read the numbers and increment the counter corresponding to the value of each number.

2. The system of claim 1, wherein the data set of numbers includes a range of values and the processing element is configured to establish a counter for every value in the range.

3. The system of claim 1, wherein the processing element is further configured to list the values in sequential order wherein each value occurs in the list according to the count of the corresponding counter.

4. The system of claim 1, wherein the processing element is further configured to accumulate the count of each counter in sequential order.

5. The system of claim 4, wherein the processing element is further configured to compare the accumulated count with a first quantity after each counter.

6. The system of claim 5, wherein the processing element is further configured to determine the value corresponding to the counter when the accumulated count equals or exceeds the first quantity.

7. The system of claim 1, wherein the processing element is further configured to compare the count of all counters to determine the counter with the maximum count.

8. The system of claim 7, wherein the processing element is further configured to determine the value corresponding to the single counter with the maximum count.

9. The system of claim 7, wherein the processing element is further configured to determine the value corresponding to the counter in the middle position of multiple counters with the same maximum count.

10. The system of claim 1, wherein the processing element is further configured to accumulate the product of the count of each counter times the value corresponding to the counter.

11. The system of claim 10, wherein the processing element is further configured to divide the accumulated products by the total amount of numbers in the data set to calculate the mean.

12. The system of claim 11, wherein the processing element is further configured to determine the difference between each value and the mean.

13. The system of claim 12, wherein the processing element is further configured to accumulate the product of the difference squared and the count corresponding to each value.

14. The system of claim 13, wherein the processing element is further configured to divide the accumulated sum by the total amount of numbers in the data set to calculate the variance.

15. The system of claim 14, wherein the processing element is further configured to compute the square root of the variance.

16. A physical computer readable medium comprising a set of code segments to be executed by a processing element for sorting numbers of a data set, the physical computer readable medium comprising:

a code segment configured to establish an array of counters such that each counter corresponds to each value in the data set;

a code segment configured to read the numbers and increment the counter corresponding to the value of each number; and

a code segment configured to list the values in sequential order wherein each value occurs in the list according to the count of the corresponding counter.

17. A physical computer readable medium comprising a set of code segments to be executed by a processing element for determining a Kth element of a data set of numbers, the physical computer readable medium comprising:

a code segment configured to establish an array of counters such that each counter corresponds to a value in the data set;

a code segment configured to read the numbers and increment the counter corresponding to the value of each number;

a code segment configured to accumulate the count of each counter in sequential order;

a code segment configured to compare the accumulated count with a first quantity that corresponds to the Kth element after each counter; and

a code segment configured to determine the value corresponding to the counter when the accumulated count equals or exceeds the first quantity.

18. A physical computer readable medium comprising a set of code segments to be executed by a processing element for determining the Mode of a data set of numbers, the physical computer readable medium comprising:

a code segment configured to establish an array of counters such that each counter corresponds to a value in the data set;

a code segment configured to read the numbers and increment the counter corresponding to the value of each number;

a code segment configured to compare the count of all counters to determine the counter with the maximum count;

a code segment configured to determine the value corresponding to the single counter with the maximum count; and

a code segment configured to determine the value corresponding to the counter in the middle position of multiple counters with the same maximum count.

19. A physical computer readable medium comprising a set of code segments to be executed by a processing element for determining the Mean of a data set of numbers, the physical computer readable medium comprising:

a code segment configured to establish an array of counters such that each counter corresponds to a value in the data set;

a code segment configured to read the numbers and increment the counter corresponding to the value of each number;

a code segment configured to accumulate the product of the count of each counter times the value corresponding to the counter; and

a code segment configured to divide the accumulated products by the total amount of numbers in the data set.

20. A physical computer readable medium comprising a set of code segments to be executed by a processing element for determining the Variance and the Standard Deviation of a data set of numbers, the physical computer readable medium comprising:

a code segment configured to establish an array of counters such that each counter corresponds to a value in the data set;

a code segment configured to read the numbers and increment the counter corresponding to the value of each number;

a code segment configured to accumulate the product of the count of each counter times the value corresponding to the counter;

a code segment configured to divide the accumulated products by the total amount of numbers in the data set to calculate the mean;

a code segment configured to determine the difference between each value and the mean;

a code segment configured to accumulate the product of the difference squared and the count corresponding to each value;

a code segment configured to divide the accumulated sum by the total amount of numbers in the data set to calculate the variance; and

a code segment configured to compute the square root of the variance.