Generating and applying data extraction templates
First Claim
1. A computer-implemented method for generating and applying data extraction templates to extract transient content from structured communications created automatically using templates, comprising:
- grouping a corpus of structured communications into a plurality of clusters based on one or more patterns shared among one or more structured communications within the corpus;
identifying, from structured communications of a particular cluster, a set of structural paths;
classifying a first structural path of the set of structural paths, associated with a first segment of text, as a first transient structural path in response to a determination that a count of occurrences of the first segment of text across the particular cluster satisfies a criterion;
classifying the first transient structural path as a first semantic data type based on one or more signals related to the structured communications of the particular cluster;
classifying a second structural path of the set of structural paths, associated with a second segment of text, as a second transient structural path in response to a determination that a count of occurrences of the second segment of text across the particular cluster satisfies the same criterion or a different criterion;
classifying the second transient structural path as a second semantic data type based at least in part on the first semantic data type;
generating a data extraction template to extract, from one or more subsequent structured communications, one or more segments of text associated with the first transient structural path;
associating a subsequent structured communication with the particular cluster based on one or more patterns shared between the subsequent structured communication and one or more structured communications of the corpus; and
applying the data extraction template associated with the particular cluster to the subsequent structured communication to extract one or more segments of text associated with the first transient structural path.
2 Assignments
0 Petitions
Accused Products
Abstract
Methods, apparatus, and computer-readable media are provided for generating and applying data extraction templates. In various implementations, a corpus of structured communications such as emails may be grouped into clusters based on one or more similarities between the structured communications. A set of structural paths may be identified from structured communications of a particular cluster. One or more structural paths of the set may be classified as transient wherein a count of occurrences of one or more associated segments of text across the particular cluster satisfies a criterion. One or more transient paths may be assigned a semantic data type and/or a confidentiality designation based on various signals. A data extraction template may be generated to extract, from subsequent structured communications, segments of text associated with transient (and in some cases, non-confidential) structural paths.
-
Citations
20 Claims
-
1. A computer-implemented method for generating and applying data extraction templates to extract transient content from structured communications created automatically using templates, comprising:
-
grouping a corpus of structured communications into a plurality of clusters based on one or more patterns shared among one or more structured communications within the corpus; identifying, from structured communications of a particular cluster, a set of structural paths; classifying a first structural path of the set of structural paths, associated with a first segment of text, as a first transient structural path in response to a determination that a count of occurrences of the first segment of text across the particular cluster satisfies a criterion; classifying the first transient structural path as a first semantic data type based on one or more signals related to the structured communications of the particular cluster; classifying a second structural path of the set of structural paths, associated with a second segment of text, as a second transient structural path in response to a determination that a count of occurrences of the second segment of text across the particular cluster satisfies the same criterion or a different criterion; classifying the second transient structural path as a second semantic data type based at least in part on the first semantic data type; generating a data extraction template to extract, from one or more subsequent structured communications, one or more segments of text associated with the first transient structural path; associating a subsequent structured communication with the particular cluster based on one or more patterns shared between the subsequent structured communication and one or more structured communications of the corpus; and applying the data extraction template associated with the particular cluster to the subsequent structured communication to extract one or more segments of text associated with the first transient structural path. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A computer-implemented method for generating and applying data extraction templates to extract transient content from structured communications created automatically using templates, comprising:
-
identifying, from a corpus of structured communications, a set of structural paths; classifying a first structural path of the set of structural paths, associated with a first segment of text, as a transient structural path in response to a determination that a count of occurrences of the first segment of text across the corpus satisfies a criterion; determining a semantic data type of the transient structural path based on one or more patterns detected in the first segment of text; generating a data extraction template to; extract, from one or more structured communications, one or more segments of text associated with the transient structural path where the semantic data type of the transient structural path is non-confidential, or ignore, in one or more subsequent structured communications, one or more segments of text associated with the transient structural path where the semantic data type of the transient structural path is confidential; associating a subsequent structured communication with the data extraction template based on content of the subsequent structured communication; and applying the data extraction template to the subsequent structured communication to extract one or more segments of text associated with the transient structural path. - View Dependent Claims (9, 10, 11, 12, 13, 14, 15, 16)
-
-
17. A computer-implemented method for generating and applying data extraction templates to extract transient content from structured communications created automatically using templates, comprising:
-
identifying, from a corpus of structured communications, a set of structural paths; classifying a first structural path of the set of structural paths, associated with a first segment of text, as a first transient structural path in response to a determination that a count of occurrences of the first segment of text across the corpus of structured communications satisfies a criterion; classifying the first transient structural path as a first semantic data type based on one or more signals related to the corpus of structured communications; classifying a second structural path of the set of structural paths, associated with a second segment of text, as a second transient structural path in response to a determination that a count of occurrences of the second segment of text across the corpus of structured communications satisfies the same criterion or a different criterion; classifying the second transient structural path as a second semantic data type based at least in part on the first semantic data type; generating a data extraction template to extract, from one or more subsequent structured communications, one or more segments of text associated with the first transient structural path; associating a subsequent structured communication with the data extraction template based on content of the subsequent structured communication; and applying the data extraction template to the subsequent structured communication to extract one or more segments of text associated with the first transient structural path. - View Dependent Claims (18, 19, 20)
-
Specification