Deep reinforcement learning-based captioning with embedding reward
First Claim
Patent Images
1. A method comprising:
- extracting, by an image captioning system, an image feature from an image; and
analyzing the image feature to generate a caption describing the image feature by performing the following operations until the caption describing the image feature is complete;
analyzing, by a policy network of the image captioning system, the image feature to generate a list of possible options for a word for the caption and compute a policy network score for each possible option in the list of options;
ranking, by the policy network of the image captioning system, the list of possible options for the word of the caption based on the policy network score for each possible option in the list of options;
analyzing, by a value network of the image captioning system, the image feature and the list of possible options generated by the policy network to generate a value network score for each possible option in the list of options;
ranking, by the value network, the list of options for the word of the caption based on the value network score; and
selecting, by the image captioning system a word for the caption based on the ranking of the list of options by the policy network and the ranking of the list of options by the value network.
1 Assignment
0 Petitions
Accused Products
Abstract
An image captioning system and method is provided for generating a caption for an image. The image captioning system utilizes a policy network and a value network to generate the caption. The policy network serves as a local guidance and the value network serves as a global and lookahead guidance.
41 Citations
20 Claims
-
1. A method comprising:
-
extracting, by an image captioning system, an image feature from an image; and analyzing the image feature to generate a caption describing the image feature by performing the following operations until the caption describing the image feature is complete; analyzing, by a policy network of the image captioning system, the image feature to generate a list of possible options for a word for the caption and compute a policy network score for each possible option in the list of options; ranking, by the policy network of the image captioning system, the list of possible options for the word of the caption based on the policy network score for each possible option in the list of options; analyzing, by a value network of the image captioning system, the image feature and the list of possible options generated by the policy network to generate a value network score for each possible option in the list of options; ranking, by the value network, the list of options for the word of the caption based on the value network score; and selecting, by the image captioning system a word for the caption based on the ranking of the list of options by the policy network and the ranking of the list of options by the value network. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. An image captioning system comprising:
-
a memory that stores instructions; and one or more processors configured by the instructions to perform operations comprising; extracting, by an image captioning system, an image feature from an image; and analyzing the image feature to generate a caption describing the image feature by performing the following operations until the caption describing the image feature is complete; analyzing, by a policy network of the image captioning system, the image feature to generate a list of possible options for a word for the caption and compute a policy network score for each possible option in the list of options; ranking, by the policy network of the image captioning system, the list of possible options for the word of the caption based on the policy network score for each possible option in the list of options; analyzing, by a value network of the image captioning system, the image feature and the list of possible options generated by the policy network to generate a value network score for each possible option in the list of options; ranking, by the value network, the list of options for the word of the caption based on the value network score; and selecting, by the image captioning system, a word for the caption based on the ranking of the list of options by the policy network and the ranking of the list of options by the value network. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19)
-
-
20. A non-transitory computer-readable medium comprising instructions stored thereon that are executable by at least one processor to cause a computing device to perform operations comprising:
-
extracting, by an image captioning system, an image feature from an image; and analyzing the image feature to generate a caption describing the image feature by performing the following operations until the caption describing the image feature is complete; analyzing, by a policy network of the image captioning system, the image feature to generate a list of possible options for a word for the caption and compute a policy network score for each possible option in the list of options; ranking, by the policy network of the image captioning system, the list of possible options for the word of the caption based on the policy network score for each possible option in the list of options; analyzing, by a value network of the image captioning system, the image feature and the list of possible options generated by the policy network to generate a value network score for each possible option in the list of options; ranking, by the value network, the list of options for the word of the caption based on the value network score; and selecting, by the image captioning system, a word for the caption based on the ranking of the list of options by the policy network and the ranking of the list of options by the value network.
-
Specification