Please download the dossier by clicking on the dossier button x
×

Embedding Space for Images with Multiple Text Labels

  • US 20170206435A1
  • Filed: 01/15/2016
  • Published: 07/20/2017
  • Est. Priority Date: 01/15/2016
  • Status: Active Grant
First Claim
Patent Images

1. A method implemented by a computing device to annotate individual images with multiple text labels to describe content of the images, the method comprising:

  • processing a training image having multiple text labels to generate a set of image regions that correspond to the respective multiple text labels;

    embedding, within an embedding space that is configured to embed both text labels and image regions mapped to the text labels, the set of image regions based, in part, on positions at which the multiple text labels that correspond to the image regions of the training image are embedded in the embedding space;

    learning a mapping function that maps image regions to the text labels embedded in the embedding space, said learning based, in part, on said embedding the set of image regions within the embedding space;

    discovering text labels that correspond to image regions of a query image by mapping the image regions of the query image to the embedding space using the learned mapping function; and

    annotating the query image with at least two of the discovered text labels.

View all claims
  • 2 Assignments
Timeline View
Assignment View
    ×
    ×