×

Automatic Classification of User Interface Elements

  • US 20200133644A1
  • Filed: 10/31/2018
  • Published: 04/30/2020
  • Est. Priority Date: 10/31/2018
  • Status: Active Grant
First Claim
Patent Images

1. A method comprising:

  • storing information specifying known metadata values for a plurality of metadata fields and predetermined indications of relationships between ones of the known metadata values and a plurality of types of visible user interface elements, wherein the relationships include a relationship between a first known metadata value and a text type, and a relationship between a second known metadata value and an image type;

    determining respective metadata values for a plurality of visible elements of a graphical user interface, wherein the metadata values are included in user interface code that specifies the plurality of visible elements;

    scoring ones of the plurality of visible elements, based on the stored predetermined indications of relationships and the determined metadata values, to generate score values for each of the plurality of types of visible elements;

    classifying, based on the score values for each of the plurality of types of visible elements, the plurality of visible elements according to the plurality of types of visible elements, including classifying at least one element as a text type, and at least one element as an image type; and

    storing information specifying the classified elements.

View all claims
  • 1 Assignment
Timeline View
Assignment View
    ×
    ×