Event-triggered data quality verification

• US 10,089,409 B2
• Filed: 06/17/2014
• Issued: 10/02/2018
• Est. Priority Date: 04/29/2014
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Derstadt, Jeffrey Michael
• Primary Examiner(s): Nguyen, Thu Nga
• Application Number:
  US14/306,999
• Publication Number:
  US 20150310132A1
• Time in Patent Office: 1,568 Days
• Field of Search: None
• CPC Class Codes: G06F 16/90 Details of database functions independent of the retrieved data types
• CPC Class Codes: G06Q 10/00 Administration; Management
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06Q 50/01 Social networking

Abstract

A method is directed to associating quality metadata with underlying data. The method includes, for one or more data items, a computing system identifying one or more threshold conditions related to the data items. The computing system determines that the one or more threshold conditions related to the data items have been met. As a result of determining that the one or more threshold conditions related to the data items have been met, the computing system associates quality metadata with the data items.

Claims

1. A computer-implemented method of determining when quality metadata, which indicates a measure of the quality of underlying data corresponding to the quality metadata, should be associated with the underlying data and indicated to a user to provide assurance of the quality of the underlying data provided to the user, the computer-implemented method being performed by one or more processors when executing computer-executable instructions, and comprising:

receiving one or more data items from one or more sources of data;

identifying one or more threshold conditions related to the one or more data items, wherein the one or more threshold conditions comprise one or more threshold rules for social networking interactions with the one or more data items, the one or more threshold conditions comprising at least one of a threshold number of times the one or more data items have been accessed on a social media platform, a threshold number of times the one or more data items have been liked on a social media platform, a threshold number of times the one or more data items have been commented on on a social media platform, or a threshold number of times the one or more data items have been shared on a social media platform, wherein the threshold one or more threshold conditions are indicative of when underlying data should have quality metadata associated with the underlying data, wherein the quality metadata comprises an indication of the veracity of the one or more data items;

for the received one or more data items, the one or more processors determining that the one or more threshold conditions have been met;

as a result of determining that the one or more threshold conditions have been met, obtaining externally generated quality metadata that indicates a certain quality, including an indication of the veracity of the one or more data items;

as a result of determining that the one or more threshold conditions have been met, the one or more processors associating the quality metadata with the one or more data items for which the one or more threshold conditions was determined prior to presentation to a user;

storing the quality metadata, including the indication of the veracity of the one or more data items, in a data store containing a plurality of data items; and

as a result of determining that the one or more threshold conditions have been met, displaying to a user an indicator indicating the veracity of the one or more data items together with the one or more data items.

2. The computer-implemented method of claim 1, wherein the one or more threshold conditions further comprises a condition that the one or more data items are being provided for a particular user or group of users.

3. The computer-implemented method of claim 1, wherein the one or more threshold conditions comprises a condition that the one or more data items have been shared a threshold number of times on a social media platform.

4. The computer-implemented method of claim 1, wherein the one or more threshold conditions comprises a condition that the one or more data items have been liked a threshold number of times on a social media platform.

5. The computer-implemented method of claim 1, wherein the one or more threshold conditions comprises a condition that the one or more data items have been commented on a threshold number of times on a social media platform.

6. The computer-implemented method of claim 1, wherein the one or more threshold conditions further comprises a condition that the one or more data items are to be distributed to at least some threshold number of users.

7. The computer-implemented method of claim 1, wherein the quality metadata is based on an inference as to quality of data provided from one or more sources of the one or more data items.

8. The computer-implemented method of claim 7, wherein the quality metadata is generated as a result of applying a data cleanser to the one or more data items that removes incorrect or corrupted data from the one or more data items and generates the quality metadata indicating that the one or more data items are accurate.

9. The computer-implemented method of claim 1, wherein the quality metadata is based on the lineage of data, including how the data has moved through a system of connected data stores from which the one or more data items was obtained.

10. A computer program product comprising a computer storage device containing computer-executable instructions which, when executed by one or more processors, cause the one or more processors to implement a computer-implemented method of determining when quality metadata, which indicates a measure of the quality of underlying data corresponding to the quality metadata, should be associated with the underlying data and indicated to a user to provide assurance of the quality of the underlying data provided to the user, and wherein the computer-implemented method comprises:

receiving one or more data items from one or more sources of data;

identifying one or more threshold conditions related to the one or more data items, wherein the one or more threshold conditions comprise one or more threshold rules for social networking interactions with the one or more data items, the one or more threshold conditions comprising at least one of a threshold number of times the one or more data items have been accessed on a social media platform, a threshold number of times the one or more data items have been liked on a social media platform, a threshold number of times the one or more data items have been commented on on a social media platform, or a threshold number of times the one or more data items have been shared on a social media platform, wherein the one or more threshold conditions are indicative of when underlying data should have quality metadata associated with the underlying data, wherein the quality metadata comprises an indication of the veracity of the one or more data items;

for the received one or more data items, the one or more processors determining that the one or more threshold conditions have been met;

as a result of determining that one or more threshold conditions have been met, obtaining externally generated quality metadata that indicates a certain quality, including an indication of the veracity of the one or more data items;

as a result of determining that the one or more threshold conditions have been met, the one or more processors associating the quality metadata with the one or more data items for which the one or more threshold conditions was determined prior to presentation to a user;

storing the quality metadata, including the indication of the veracity of the one or more data items, in a data store containing a plurality of data items; and

as a result of determining that the one or more threshold conditions have been met, displaying to a user an indicator indicating the veracity the one or more data items together with the one or more data items.

11. The computer program product of claim 10, wherein the one or more threshold conditions further comprises a condition that the one or more data items are being provided for a particular user or group of users.

12. The computer program product of claim 10, wherein the one or more threshold conditions comprises a condition that the one or more data items have been shared a threshold number of times on a social media platform.

13. The computer program product of claim 10, wherein the one or more threshold conditions comprises a condition that the one or more data items have been liked a threshold number of times on a social media platform.

14. The computer program product of claim 10, wherein the one or more threshold conditions comprises a condition that the one or more data items have been commented on a threshold number of times on a social media platform.

15. The computer program product of claim 10, wherein the one or more threshold conditions further comprises a condition that the one or more data items are to be distributed to at least some threshold number of users.

16. The computer program product of claim 10, wherein the quality metadata is based on an inference as to quality of data provided from one or more sources of the one or more data items.

17. The computer program product of claim 16, wherein the quality metadata is generated as a result of applying a data cleanser to the one or more data items that removes incorrect or corrupted data from the one or more data items and generates the quality metadata indicating that the one or more data items are accurate.

18. A system comprising:

one or more processors;

a data store containing a plurality of data items;

a computer storage device containing computer-executable instructions which, when executed by the one or more processors, cause the one or more processors to implement a computer-implemented method of determining when quality metadata, which indicates a measure of the quality of underlying data corresponding to the quality metadata, should be associated with the underlying data and indicated to a user to provide assurance of the quality of the underlying data provided to the user, and wherein the computer-implemented method comprises;

receiving one or more data items from one or more sources of data;

identifying one or more threshold conditions related to the one or more data items, wherein the one or more threshold conditions comprise one or more threshold rules for social networking interactions with the one or more data items, the one or more threshold conditions comprising at least one of a threshold number of times the one or more data items have been accessed on a social media platform, a threshold number of times the one or more data items have been liked on a social media platform, a threshold number of times the one or more data items have been commented on on a social media platform, or a threshold number of times the one or more data items have been shared on a social media platform, wherein the one or more threshold conditions are indicative of when underlying data should have quality metadata associated with the underlying data, wherein the quality metadata comprises an indication of the veracity of the one or more data items;

for the received one or more data items, the one or more processors determining that the one or more threshold conditions have been met;

as a result of determining that the one or more threshold conditions have been met, obtaining externally generated quality metadata that indicates a certain quality, including an indication of the veracity of the one or more data items

as a result of determining that the one or more threshold conditions have been met, the one or more processors associating the quality metadata with the one or more data items for which the one or more threshold conditions was determined prior to presentation to a user;

storing the quality metadata, including the indication of the veracity of the one or more data items, in a data store containing a plurality of data items; and

as a result of determining that the one or more threshold conditions have been met, displaying to a user an indicator indicating the veracity the one or more data items together with the one or more data items.

19. The system of claim 18, wherein the one or more threshold conditions comprises a condition that the one or more data items have been shared a threshold number of times on a social media platform.

20. The system of claim 18, wherein the one or more threshold conditions comprises a condition that the one or more data items have been liked a threshold number of times on a social media platform.