Rare instance classifiers
First Claim
1. A method, comprising:
- receiving an input image;
processing the input image using a common instance neural network, wherein the common instance neural network is configured to process the input image to generate a common instance output comprising a respective first object score corresponding to each of one or more first object categories, each first object score representing a likelihood that the input image includes an image of an object belonging to the corresponding first object category;
processing the input image using a rare instance neural network, wherein the rare instance neural network is configured to process the input image to generate a rare instance output comprising a rarity score that represents a likelihood that the input image will be incorrectly classified by the common instance neural network;
determining a weight to be assigned to the one or more respective first object scores in classifying the input image using the rarity score; and
classifying the input image in accordance with the determined weight.
1 Assignment
0 Petitions
Accused Products
Abstract
In some implementations, an image classification system of an autonomous or semi-autonomous vehicle is capable of improving multi-object classification by reducing repeated incorrect classification of objects that are considered rarely occurring objects. The system can include a common instance classifier that is trained to identify and recognize general objects (e.g., commonly occurring objects and rarely occurring objects) as belonging to specified object categories, and a rare instance classifier that is trained to compute one or more rarity scores representing likelihoods that an input image is correctly classified by the common instance classifier. The output of the rare instance classifier can be used to adjust the classification output of the common instance classifier such that the likelihood of input images being incorrectly classified is reduced.
-
Citations
20 Claims
-
1. A method, comprising:
-
receiving an input image; processing the input image using a common instance neural network, wherein the common instance neural network is configured to process the input image to generate a common instance output comprising a respective first object score corresponding to each of one or more first object categories, each first object score representing a likelihood that the input image includes an image of an object belonging to the corresponding first object category; processing the input image using a rare instance neural network, wherein the rare instance neural network is configured to process the input image to generate a rare instance output comprising a rarity score that represents a likelihood that the input image will be incorrectly classified by the common instance neural network; determining a weight to be assigned to the one or more respective first object scores in classifying the input image using the rarity score; and classifying the input image in accordance with the determined weight. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A system comprising:
-
one or more computers; and one or more storage devices storing instructions that, when executed by the one or more computers, cause the one or more computers to perform operations comprising; receiving an input image; processing the input image using a common instance neural network, wherein the common instance neural network is configured to process the input image to generate a common instance output comprising a respective first object score corresponding to each of one or more first object categories, each first object score representing a likelihood that the input image includes an image of an object belonging to the corresponding first object category; processing the input image using a rare instance neural network, wherein the rare instance neural network is configured to process the input image to generate a rare instance output comprising a rarity score that represents a likelihood that the input image will be incorrectly classified by the common instance neural network; determining a weight to be assigned to the one or more respective first object scores in classifying the input image using the rarity score; and classifying the input image in accordance with the determined weight. - View Dependent Claims (14, 15)
-
-
16. A non-transitory computer-readable storage device encoded with computer program instructions that, when executed by one or more computers, cause the one or more computers to perform operations comprising:
-
receiving an input image; processing the input image using a common instance neural network, wherein the common instance neural network is configured to process the input image to generate a common instance output comprising a respective first object score corresponding to each of one or more first object categories, each first object score representing a likelihood that the input image includes an image of an object belonging to the corresponding first object category; processing the input image using a rare instance neural network, wherein the rare instance neural network is configured to process the input image to generate a rare instance output comprising a rarity score that represents a likelihood that the input image will be incorrectly classified by the common instance neural network; determining a weight to be assigned to the one or more respective first object scores in classifying the input image using the rarity score; and classifying the input image in accordance with the determined weight. - View Dependent Claims (17, 18, 19, 20)
-
Specification