System for determining and optimizing for relevance in match-making systems
First Claim
1. A method comprising:
- receiving, from a mobile device associated with a dating profile of a dating website, a query identifying constraints on attributes of a target dating profile;
retrieving, from the dating website, unlabeled matches based on the query, wherein each of the unlabeled matches comprises a pairing between the dating profile and a candidate dating profile that satisfies the constraints on the attributes, wherein each of the unlabeled matches lacks behavioral features, which indicate whether a match is relevant, wherein the behavioral features comprise;
click feedback from either of the dating profile and the candidate dating profile,a first duration of profile views initiated by the dating profile toward the candidate dating profile, anda second duration of profile views initiated by the candidate dating profile toward the dating profile; and
identifying relevant ones of the unlabeled matches utilizing ranking features of each of the unlabeled matches as a proxy for the behavioral features by;
retrieving labeled matches from the dating website, wherein each of the labeled matches comprises a pairing between two dating profiles from the dating website, wherein each of the labeled matches is labeled with a probability of relevance based on the behavioral features of the two dating profiles, wherein;
the probability of relevance identifies a relevant match as ones of the labeled matches in which the two dating profiles have exchanged contact info, andthe probability of relevance identifies a non-relevant match as;
ones of the labeled matches in which a first dating profile of the two dating profiles accessed a second dating profile of the two dating profiles but did not send a message to the second dating profile, orones of the labeled matches in which the first dating profile sent a message to the second dating profile but the second dating profile did not send a message to the first dating profile;
generating, from the labeled matches, a ranking model that correlates the probability of relevance to ranking features of each of the labeled matches;
wherein the ranking model is configured to receive, as input, the ranking features of each of the labeled matches and generate, as output, the probability of relevance;
calculating the probability of relevance of each of the unlabeled matches by inputting, into the ranking model, ranking features of each of the unlabeled matches and retrieving, from the ranking model, the probability of relevance of each of the unlabeled matches, wherein the probability of relevance of each of the unlabeled matches is calculated due at least in part to the each of the unlabeled matches lacking the behavioral features;
calculating a rank for each of the unlabeled matches based on the probability of relevance of each of the unlabeled matches to generate a set of ranked matches; and
identifying, to the dating profile, the relevant ones of the unlabeled matches by transmitting at least a portion of the set of ranked matches to the mobile device associated with the dating profile.
1 Assignment
0 Petitions
Accused Products
Abstract
Disclosed are methods and apparatus for automatically determining the relevance of matches between entities. A set of one or more indicators of relevance for each of a plurality of matches may be detected, where each of the plurality of matches exists between a first entity and a different one of a plurality of entities. Each set of one or more indicators of relevance indicates a degree of two-way interest for a corresponding one of the plurality of matches, the degree of two-way interest indicating both a degree of interest of the first entity in the corresponding one of the plurality of entities and a degree of interest of the corresponding one of the plurality of entities in the first entity. A probability of relevance of each of the plurality of matches may be determined based at least in part upon a corresponding set of one or more indicators of relevance. Each of the plurality of matches may be ranked based at least in part on the corresponding probability of relevance. A ranking function may be trained based upon the probability of relevance of each of the plurality of matches. The ranking function may subsequently be applied to identify and rank matches (e.g., in the absence of indicators of relevance).
-
Citations
14 Claims
-
1. A method comprising:
-
receiving, from a mobile device associated with a dating profile of a dating website, a query identifying constraints on attributes of a target dating profile; retrieving, from the dating website, unlabeled matches based on the query, wherein each of the unlabeled matches comprises a pairing between the dating profile and a candidate dating profile that satisfies the constraints on the attributes, wherein each of the unlabeled matches lacks behavioral features, which indicate whether a match is relevant, wherein the behavioral features comprise; click feedback from either of the dating profile and the candidate dating profile, a first duration of profile views initiated by the dating profile toward the candidate dating profile, and a second duration of profile views initiated by the candidate dating profile toward the dating profile; and identifying relevant ones of the unlabeled matches utilizing ranking features of each of the unlabeled matches as a proxy for the behavioral features by; retrieving labeled matches from the dating website, wherein each of the labeled matches comprises a pairing between two dating profiles from the dating website, wherein each of the labeled matches is labeled with a probability of relevance based on the behavioral features of the two dating profiles, wherein; the probability of relevance identifies a relevant match as ones of the labeled matches in which the two dating profiles have exchanged contact info, and the probability of relevance identifies a non-relevant match as; ones of the labeled matches in which a first dating profile of the two dating profiles accessed a second dating profile of the two dating profiles but did not send a message to the second dating profile, or ones of the labeled matches in which the first dating profile sent a message to the second dating profile but the second dating profile did not send a message to the first dating profile; generating, from the labeled matches, a ranking model that correlates the probability of relevance to ranking features of each of the labeled matches;
wherein the ranking model is configured to receive, as input, the ranking features of each of the labeled matches and generate, as output, the probability of relevance;calculating the probability of relevance of each of the unlabeled matches by inputting, into the ranking model, ranking features of each of the unlabeled matches and retrieving, from the ranking model, the probability of relevance of each of the unlabeled matches, wherein the probability of relevance of each of the unlabeled matches is calculated due at least in part to the each of the unlabeled matches lacking the behavioral features; calculating a rank for each of the unlabeled matches based on the probability of relevance of each of the unlabeled matches to generate a set of ranked matches; and identifying, to the dating profile, the relevant ones of the unlabeled matches by transmitting at least a portion of the set of ranked matches to the mobile device associated with the dating profile. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A server comprising:
-
a memory storing data associated with a dating website; and at least one of processor that performs operations comprising; receiving, from a mobile device associated with a dating profile of a dating website, a query identifying constraints on attributes of a target dating profile; retrieving, from the memory, unlabeled matches based on the query, wherein each of the unlabeled matches comprises a pairing between the dating profile and a candidate dating profile that satisfies the constraints on the attributes, wherein each of the unlabeled matches lacks behavioral features, which indicate whether a match is relevant, wherein the behavioral features comprise; click feedback from either of the dating profile and a candidate dating profile, a first duration of profile views initiated by the dating profile toward the candidate dating profile, and a second duration of profile views initiated by the candidate dating profile toward the dating profile; and identifying relevant ones of the unlabeled matches utilizing ranking features of each of the unlabeled matches as a proxy for the behavioral features by; retrieving labeled matches from the memory, wherein each of the labeled matches comprises a pairing between two dating profiles from the dating website, wherein each of the labeled matches is labeled with a probability of relevance based on the behavioral features of the two dating profiles, wherein; the probability of relevance identifies a relevant match as ones of the labeled matches in which the two dating profiles have exchanged contact info, and the probability of relevance identifies a non-relevant match as;
ones of the labeled matches in which a first dating profile of the two dating profiles accessed a second dating profile of the two dating profiles but did not send a message to the second dating profile, or
ones of the labeled matches in which the first dating profile sent a message to the second dating profile but the second dating profile did not send a message to the first dating profile;generating, from the labeled matches, a ranking model that correlates the probability of relevance to ranking features of each of the labeled matches;
wherein the ranking model is configured to receive, as input, the ranking features of each of the labeled matches and generate, as output, the probability of relevance;calculating the probability of relevance of each of the unlabeled matches by inputting, into the ranking model, ranking features of each of the unlabeled matches and retrieving, from the ranking model, the probability of relevance of each of the unlabeled matches, wherein the probability of relevance of each of the unlabeled matches is calculated due at least in part to the each of the unlabeled matches lacking the behavioral features; calculating a rank for each of the unlabeled matches based on the probability of relevance of each of the unlabeled matches to generate a set of ranked matches; and identifying, to the dating profile, the relevant ones of the unlabeled matches by transmitting at least a portion of the set of ranked matches to the mobile device associated with the dating profile. - View Dependent Claims (7, 8, 9, 10)
-
-
11. A non-transitory computer-readable medium comprising instructions, that when executed by at least one processor, configure the at least one processor to perform operations comprising:
-
receiving, from a mobile device associated with a dating profile of a dating website, a query identifying constraints on attributes of a target dating profile; retrieving, from the dating website, unlabeled matches based on the query, wherein each of the unlabeled matches comprises a pairing between the dating profile and a candidate dating profile that satisfies the constraints on the attributes, wherein each of the unlabeled matches lacks behavioral features, which indicate whether a match is relevant, wherein the behavioral features comprise; click feedback from either of the dating profile and a candidate dating profile, a first duration of profile views initiated by the dating profile toward the candidate dating profile, and a second duration of profile views initiated by the candidate dating profile toward the dating profile; and identifying relevant ones of the unlabeled matches utilizing ranking features of each of the unlabeled matches as a proxy for the behavioral features by; retrieving labeled matches from the dating website, wherein each of the labeled matches comprises a pairing between two dating profiles from the dating website, wherein each of the labeled matches is labeled with a probability of relevance based on the behavioral features of the two dating profiles, wherein; the probability of relevance identifies a relevant match as ones of the labeled matches in which the two dating profiles have exchanged contact info, and the probability of relevance identifies a non-relevant match as; ones of the labeled matches in which a first dating profile of the two dating profiles accessed a second dating profile of the two dating profiles but did not send a message to the second dating profile, or ones of the labeled matches in which the first dating profile sent a message to the second dating profile but the second dating profile did not send a message to the first dating profile; generating, from the labeled matches, a ranking model that correlates the probability of relevance to ranking features of each of the labeled matches;
wherein the ranking model is configured to receive, as input, the ranking features of each of the labeled matches and generate, as output, the probability of relevance;calculating the probability of relevance of each of the unlabeled matches by inputting, into the ranking model, ranking features of each of the unlabeled matches and retrieving, from the ranking model, the probability of relevance of each of the unlabeled matches, wherein the probability of relevance of each of the unlabeled matches is calculated due at least in part to the each of the unlabeled matches lacking the behavioral features; calculating a rank for each of the unlabeled matches based on the probability of relevance of each of the unlabeled matches to generate a set of ranked matches; and identifying, to the dating profile, the relevant ones of the unlabeled matches by transmitting at least a portion of the set of ranked matches to the mobile device associated with the dating profile. - View Dependent Claims (12, 13, 14)
-
Specification