Generating and applying data extraction templates
First Claim
1. A computer-implemented method for generating and applying data extraction templates to extract transient content from structured communications created automatically using templates, comprising:
- grouping a corpus of structured communications into a plurality of clusters based on metadata associated with each structured communication;
identifying, from structured communications of a particular cluster, a set of structural paths;
classifying a first structural path of the set of structural paths, associated with a first segment of text, as transient in response to a determination that a count of occurrences of the first segment of text across the particular cluster satisfies a criterion;
classifying a second structural path of the set of structural paths, associated with a second segment of text, as fixed in response to a determination that a frequency of occurrences of the second segment of text across the particular cluster does not satisfy the criterion;
generating a data extraction template to extract, from one or more structured communications, one or more segments of text associated with the transient structural path;
configuring the data extraction template so that one or more segments of text associated with the fixed structural path are ignored in one or more subsequent structured communications;
associating a subsequent structured communication with the particular cluster based on metadata associated with the subsequent structured communication; and
applying the data extraction template associated with the particular cluster to the subsequent structured communication to extract one or more segments of text associated with the transient structural path.
2 Assignments
0 Petitions
Accused Products
Abstract
Methods, apparatus, and computer-readable media are provided for generating and applying data extraction templates. In various implementations, a corpus of structured communications such as emails may be grouped into clusters based on one or more similarities between the structured communications. A set of structural paths may be identified from structured communications of a particular cluster. One or more structural paths of the set may be classified as transient wherein a count of occurrences of one or more associated segments of text across the particular cluster satisfies a criterion. One or more transient paths may be assigned a semantic data type and/or a confidentiality designation based on various signals. A data extraction template may be generated to extract, from subsequent structured communications, segments of text associated with transient (and in some cases, non-confidential) structural paths.
-
Citations
18 Claims
-
1. A computer-implemented method for generating and applying data extraction templates to extract transient content from structured communications created automatically using templates, comprising:
-
grouping a corpus of structured communications into a plurality of clusters based on metadata associated with each structured communication; identifying, from structured communications of a particular cluster, a set of structural paths; classifying a first structural path of the set of structural paths, associated with a first segment of text, as transient in response to a determination that a count of occurrences of the first segment of text across the particular cluster satisfies a criterion; classifying a second structural path of the set of structural paths, associated with a second segment of text, as fixed in response to a determination that a frequency of occurrences of the second segment of text across the particular cluster does not satisfy the criterion; generating a data extraction template to extract, from one or more structured communications, one or more segments of text associated with the transient structural path; configuring the data extraction template so that one or more segments of text associated with the fixed structural path are ignored in one or more subsequent structured communications; associating a subsequent structured communication with the particular cluster based on metadata associated with the subsequent structured communication; and applying the data extraction template associated with the particular cluster to the subsequent structured communication to extract one or more segments of text associated with the transient structural path. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A system that generates and applies data extraction templates to extract transient content from structured communications created automatically using templates, the system including memory and one or more processors operable to execute instructions stored in the memory, and comprising instructions to:
-
group a corpus of structured communications into a plurality of clusters based on one or more similarities between structured communications of the corpus; identify, from structured communications of a particular cluster, a set of structural paths, wherein to identify the set of structural paths, a bipartite graph is generated, with the set of structural paths forming a first set of structural path nodes and corresponding textual segments forming a second set of textual segment nodes, and edges connecting structural path nodes to corresponding textual segment nodes; classify a first structural path of the set of structural paths, associated with a first segment of text, as transient in response to a determination that a count of occurrences of the first segment of text across the particular cluster satisfies a criterion; determine a semantic data type of the transient structural path based on one or more signals related to the structured communications of the particular cluster; and generate a data extraction template to extract, from one or more structured communications, one or more segments of text associated with the transient structural path; associate a subsequent structured communication with the particular cluster based on one or more similarities between the subsequent structured communication and structured communications of the particular cluster; and apply the data extraction template associated with the particular cluster to the subsequent structured communication to extract one or more segments of text associated with the transient structural path. - View Dependent Claims (13, 14, 15, 16, 17)
-
-
18. A non-transitory computer-readable medium comprising instructions that, in response to execution of the instructions by a computing system, cause the computing system to generate and apply data extraction templates to extract transient content from structured communications created automatically using templates, including performing the following operations:
-
identifying, from a corpus of structured communications, a set of structural paths; classifying a first structural path of the set of structural paths, associated with a first segment of text, as transient in response to a determination that a count of occurrences of the first segment of text across the corpus satisfies a criterion; determining a semantic data type of the transient structural path based on one or more signals related to the structured communications of the corpus; generating a data extraction template to extract, from one or more structured communications, one or more segments of text associated with the transient structural path where the semantic data type of the transient structural path is non-confidential, wherein generating the data extraction template further comprises generating the data extraction template to ignore, in one or more subsequent structured communications, one or more segments of text associated with the transient structural path in response to a determination, based on one or more signals related to structured communications of the particular cluster, that a semantic data type of the transient structural path is confidential; and associating a subsequent structured communication with the data extraction template based on metadata associated with the subsequent structured communication; and applying the data extraction template to the subsequent structured communication to extract one or more segments of text associated with the transient structural path.
-
Specification