Generating anonymous data from web data

• US 9,866,454 B2
• Filed: 03/25/2014
• Issued: 01/09/2018
• Est. Priority Date: 03/25/2014
• Status: Active Grant

• Current Assignee: Verizon Patent and Licensing Incorporated (Verizon Communications Inc.)
• Original Assignee: Verizon Patent and Licensing Incorporated (Verizon Communications Inc.)
• Inventors: Srivastava, Ashok N.
• Primary Examiner(s): Rivas, Omar Fernandez
• Assistant Examiner(s): Mikowski, Justin C
• Application Number:
  US14/224,482
• Publication Number:
  US 20150278157A1
• Time in Patent Office: 1,386 Days
• CPC Class Codes: H04L 43/04 Processing captured monitoring data, e.g. for logfile generation
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34

Abstract

A device receives web data, associated with user devices, that is generated based on interactions of the user devices with a network and one or more content provider devices. The device removes erroneous or objectionable web data from the web data to generate a subset of the web data, and categorizes the subset of the web data by assigning categories to the subset of the web data. The device performs an empirical estimation of the categorized subset of the web data to generate empirical estimations. The device performs a simulation of the empirical estimations to generate synthetic data that corresponds to the web data and removes private information relating to the user devices and users of the user devices, and stores the synthetic data in a storage device.

Claims

1. A method to provide synthetic data, when statistical properties and privacy information, associated with web data, are preserved in the synthetic data, comprising:

receiving, by a device and from user devices, the web data,

the web data being associated with the user devices,

the web data being generated based on interactions of the user devices with one or more content provider devices via a network, and

the web data including one or more of;

clickstream data that includes information associated with portions of content, provided by the one or more content provider devices, that are selected via the user devices,

location data that includes information associated with locations of the user devices when the content is accessed by the user devices,

time data that includes information associated with times when the user devices access the content, or

network data that includes information associated with network resources utilized by the user devices to access the content;

removing, by the device, erroneous or objectionable web data from the web data to generate a subset of the web data;

categorizing, by the device, the subset of the web data by assigning categories to the subset of the web data;

performing, by the device, an empirical estimation of the categorized subset of the web data to generate empirical estimations that include information that provides a representation of behaviors associated with users of the user devices;

receiving, by the device, a selection of an anonymity level associated with generating the synthetic data;

performing, by the device, a simulation of the empirical estimations to generate the synthetic data,

the synthetic data including information associated with the empirical estimations, and

the synthetic data removing private information, relating to the user devices and the users of the user devices, in accordance to the anonymity level;

determining, by the device, whether the statistical properties and the privacy information, associated with the web data, are preserved in the synthetic data; and

selectively;

storing, by the device, the synthetic data in a storage device and providing the synthetic data when the statistical properties and the privacy information, associated with the web data, are preserved in the synthetic data, or

re-performing, by the device, the simulation of the empirical estimations to generate other synthetic data when the statistical properties or the privacy information, associated with the web data, is not preserved in the synthetic data.

2. The method of claim 1, further comprising:

presenting, for display, the synthetic data to a device associated with at least one of the one or more content provider devices.

3. The method of claim 1, where the synthetic data includes the statistical properties, associated with the web data, without the private information from the web data.

4. The method of claim 1, where the simulation of the empirical estimations includes a Monte Carlo simulation of the empirical estimations.

5. The method of claim 1, where the empirical estimation of the categorized subset of the web data includes an empirical estimation of joint distributions of the categorized subset of the web data.

16. The method of claim 1, where the empirical estimations include an indication that a particular number of users access particular websites in a particular order.

19. The method of claim 1, where categorizing the subset of the web data by assigning categories to the subset of the web data comprises:

utilizing web taxonomy techniques to assign parallel categories to a same record in the web data.

6. A device for providing synthetic data, when statistical properties and privacy information, associated with web data, are preserved in the synthetic data, comprising:

one or more processors to;

receive, from user devices, the web data,

the web data being generated based on interactions of the user devices with a plurality of content provider devices via a network, and

the web data including one or more of;

clickstream data that includes information associated with portions of content, provided by the plurality of content provider devices, that are selected via the user devices,

location data that includes information associated with locations of the user devices when the content is accessed by the user devices,

time data that includes information associated with times when the user devices access the content, or

network data that includes information associated with network resources utilized by the user devices to access the content;

remove erroneous or objectionable web data from the web data to generate a subset of the web data;

categorize the subset of the web data by assigning categories to the subset of the web data;

perform an empirical estimation of the categorized subset of the web data to generate empirical estimations that include information that provides a representation of behaviors associated with users of the user devices;

receive preference information for an anonymity level associated with generating synthetic data;

perform a simulation of the empirical estimations to generate the synthetic data,

the synthetic data including properties of the empirical estimations, and

the synthetic data removing private information, relating to the user devices and the users of the user devices, in accordance with the preference information;

determine whether the statistical properties and the privacy information, associated with the web data, are preserved in the synthetic data; and

selectively;

store the synthetic data in a storage device, and provide the synthetic data when the statistical properties and the privacy information, associated with the web data, are preserved in the synthetic data, or

re-perform the simulation of the empirical estimations to generate other synthetic data when the statistical properties or the privacy information, associated with the web data, is not preserved in the synthetic data.

7. The device of claim 6, where, when providing the synthetic data, the one or more processors are to:

present, for display, the synthetic data to a user of the device or to a particular device associated with the plurality of content provider devices.

8. The device of claim 6, where the synthetic data includes statistical properties, associated with the web data, without the private information from the web data.

9. The device of claim 6, where the simulation of the empirical estimations includes a Monte Carlo simulation of the empirical estimations.

10. The device of claim 6, where the empirical estimation of the categorized subset of the web data includes an empirical estimation of joint distributions of the categorized subset of the web data.

17. The device of claim 6, where the one or more processors are further to:

determine a probability that a particular user will access a particular website based on the empirical estimations.

20. The device of claim 6, where the synthetic data defines a synthetic user.

11. A computer-readable medium for storing instructions, the instructions comprising:

one or more instructions that, when executed by one or more processors of a device for providing synthetic data, when statistical properties and privacy information, associated with web data, are preserved in the synthetic data, cause the one or more processors to;

receive, from user devices, the web data,

the web data being generated based on interactions of the user devices with one or more content provider devices via a network,

the web data including private information regarding at least one of the user devices or one or more users of the user devices, and

the web data including at least one of;

clickstream data that includes information associated with portions of content, provided by the one or more content provider devices, that are selected via the user devices,

location data that includes information associated with locations of the user devices when the content is accessed by the user devices,

time data that includes information associated with times when the user devices access the content, or

network data that includes information associated with network resources utilized by the user devices to access the content;

remove erroneous or objectionable web data from the web data to generate a subset of the web data;

categorize the subset of the web data by assigning categories to the subset of the web data;

perform an empirical estimation of the categorized subset of the web data to generate empirical estimations that include information that provides a representation of behaviors associated with the one or more users of the user devices;

receive a selection of an anonymity preference associated with generating synthetic data;

perform a simulation of the empirical estimations to generate the synthetic data,

the synthetic data including information associated with the empirical estimations, and

the synthetic data removing the private information from the web data in accordance with the anonymity preference;

determine whether the statistical properties and the privacy information, associated with the web data, are preserved in the synthetic data; and

selectively store the synthetic data in a storage device and provide the synthetic data when the statistical properties and the privacy information, associated with the web data, are preserved in the synthetic data.

12. The computer-readable medium of claim 11, where the one or more instructions, when executed by the one or more processors, further cause the one or more processors to:

present, for display, the synthetic data to a user of the device or to a particular device associated with the one or more content provider devices.

13. The computer-readable medium of claim 11, where the one or more instructions, when executed by the one or more processors, further cause the one or more processors to:

selectively re-perform the simulation of the empirical estimations to generate other synthetic data when the statistical properties or the privacy information, associated with the web data, is not preserved in the synthetic data.

14. The computer-readable medium of claim 11, where the synthetic data includes the statistical properties, associated with the web data, without the private information from the web data.

15. The computer-readable medium of claim 11, where the simulation of the empirical estimations includes a Monte Carlo simulation of the empirical estimations.

18. The computer-readable medium of claim 11, where the private information includes at least one of:

a mobile identification number,

a mobile directory number,

an internet protocol address,

a name,

location information, or

time information.