Predicting household demographics based on image data
First Claim
1. A method comprising:
- receiving one or more photos associated with a user of an online system, each of the received photos including a plurality of visual features associated with each individual in the received photo;
receiving textual information describing the user and the one or more photos associated with the user;
applying a trained image analysis model to the received one or more photos to identify the plurality of visual features associated with each individual in the received photos;
applying a trained text analysis model to the textual information describing the user and the one or more photos to generate a plurality of textual features related to household features of the user;
generating one or more predictions of the household features of the user based on the plurality of visual features associated with each individual in the received one or more photos and the textual features related to the household features of the user;
evaluating a prediction of a number of members associated with a household of the user based on information describing a plurality of household devices and corresponding household device users associated with the user; and
storing the generated predictions associated with a profile of the user within the online system, the stored predictions used in targeting content to the user and to other members of the user'"'"'s household.
2 Assignments
0 Petitions
Accused Products
Abstract
An online system predicts household features of a user, e.g., household size and demographic composition, based on image data of the user, e.g., profile photos, photos posted by the user and photos posted by other users socially connected with the user, and textual data in the user'"'"'s profile that suggests relationships among individuals shown in the image data of the user. The online system applies one or more models trained using deep learning techniques to generate the predictions. For example, a trained image analysis model identifies each individual depicted in the photos of the user; a trained text analysis model derive household member relationship information from the user'"'"'s profile data and tags associated with the photos. The online system uses the predictions to build more information about the user and his/her household in the online system, and provide improved and targeted content delivery to the user and the user'"'"'s household.
-
Citations
20 Claims
-
1. A method comprising:
-
receiving one or more photos associated with a user of an online system, each of the received photos including a plurality of visual features associated with each individual in the received photo; receiving textual information describing the user and the one or more photos associated with the user; applying a trained image analysis model to the received one or more photos to identify the plurality of visual features associated with each individual in the received photos; applying a trained text analysis model to the textual information describing the user and the one or more photos to generate a plurality of textual features related to household features of the user; generating one or more predictions of the household features of the user based on the plurality of visual features associated with each individual in the received one or more photos and the textual features related to the household features of the user; evaluating a prediction of a number of members associated with a household of the user based on information describing a plurality of household devices and corresponding household device users associated with the user; and storing the generated predictions associated with a profile of the user within the online system, the stored predictions used in targeting content to the user and to other members of the user'"'"'s household. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A non-transitory computer-readable medium comprising computer program instructions, the computer program instructions when executed by a processor of a computer device causes the processor to perform the steps including:
-
receiving one or more photos associated with a user of an online system, each of the received photos including a plurality of visual features associated with each individual in the received photo; receiving textual information describing the user and the one or more photos associated with the user; applying a trained image analysis model to the received one or more photos to identify the plurality of visual features associated with each individual in the received photos; applying a trained text analysis model to the textual information describing the user and the one or more photos to generate a plurality of textual features related to household features of the user; generating one or more predictions of the household features of the user based on the plurality of visual features associated with each individual in the received one or more photos and the textual features related to the household features of the user; evaluating a prediction of a number of members associated with a household of the user based on information describing a plurality of household devices and corresponding household device users associated with the user; and storing the generated predictions associated with a profile of the user within the online system, the stored predictions used in targeting content to the user and to other members of the user'"'"'s household. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19, 20)
-
Specification