UTILIZING DEEP LEARNING FOR RATING AESTHETICS OF DIGITAL IMAGES
First Claim
1. In a digital medium environment for analyzing digital images, a method of estimating aesthetic quality of digital images using deep learning, the method comprising:
- receiving a plurality of training images with user provided ratings;
sampling the plurality of training images to identify pairs of training images with a predetermined characteristic relationship;
training a neural network to output aesthetic quality scores for identified pairs of training images that maintain a relative difference of the user provided ratings for the identified pairs of training images; and
utilizing the trained neural network to generate an aesthetic quality score for an input digital image.
2 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods are disclosed for estimating aesthetic quality of digital images using deep learning. In particular, the disclosed systems and methods describe training a neural network to generate an aesthetic quality score digital images. In particular, the neural network includes a training structure that compares relative rankings of pairs of training images to accurately predict a relative ranking of a digital image. Additionally, in training the neural network, an image rating system can utilize content-aware and user-aware sampling techniques to identify pairs of training images that have similar content and/or that have been rated by the same or different users. Using content-aware and user-aware sampling techniques, the neural network can be trained to accurately predict aesthetic quality ratings that reflect subjective opinions of most users as well as provide aesthetic scores for digital images that represent the wide spectrum of aesthetic preferences of various users.
85 Citations
20 Claims
-
1. In a digital medium environment for analyzing digital images, a method of estimating aesthetic quality of digital images using deep learning, the method comprising:
-
receiving a plurality of training images with user provided ratings; sampling the plurality of training images to identify pairs of training images with a predetermined characteristic relationship; training a neural network to output aesthetic quality scores for identified pairs of training images that maintain a relative difference of the user provided ratings for the identified pairs of training images; and utilizing the trained neural network to generate an aesthetic quality score for an input digital image. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. In a digital medium environment for analyzing digital images, a method of estimating aesthetic quality of digital images using deep learning, the method comprising:
-
receiving a digital image; and generating, by at least one processor, an aesthetic quality score for the digital image and an attribute quality score for each of a plurality of attributes of the digital image using a neural network having a training structure that jointly learns low level parameters of a plurality of training images and includes an attribute model for each of the plurality of attributes that utilizes the jointly learned low level parameters and outputs an attribute quality score for a given attribute. - View Dependent Claims (14, 15, 16, 17, 18)
-
-
19. A system for analyzing digital images to estimate aesthetic quality of the digital images using deep learning, the system comprising:
-
at least one processor; a non-transitory storage medium comprising instructions that, when executed by the at least one processor, cause the system to; receive a plurality of training images with user provided ratings; sample the plurality of training images to identify pairs of images that are rated by one or more common users, pairs of images having a common type of content, or pairs of images that are rated by different users; training the neural network to output aesthetic quality scores for identified pairs of training images that maintain a relative difference in the user provided ratings for the identified pairs of training images; and utilize the trained neural network to generate an aesthetic quality score for an input digital image. - View Dependent Claims (20)
-
Specification