Metadata generation systems and methods

• US 8,977,971 B2
• Filed: 03/08/2011
• Issued: 03/10/2015
• Est. Priority Date: 12/24/2010
• Status: Active Grant

• Current Assignee: General Electric Company
• Original Assignee: General Electric Company
• Inventors: Singh, Gurpreet, Phaniraj, Nagesh
• Primary Examiner(s): HAILU, TADESSE
• Application Number:
  US13/043,007
• Publication Number:
  US 20120166978A1
• Time in Patent Office: 1,463 Days
• Field of Search: 715221-226, 715/780, 715762-764
• US Class Current: 715/762
• CPC Class Codes: G06F 8/38 for implementing user interfaces
• CPC Class Codes: G06F 8/51 Source to source
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces

Abstract

Metadata generation systems and methods are described. An example computer-implemented method of automatically generating metadata used to develop graphical user interfaces includes scanning an image of a user interface to detect a candidate region on the image, the candidate region being potentially associated with a user interface component. The example method includes analyzing the candidate region to identify a user interface component contained therein by comparing a potential user interface component to user interface definitions stored in a database to identify one of the user interface definitions associated therewith. The example method includes extracting one or more properties of the identified user interface component and generating metadata based on the user interface definition associated with the identified user interface component and the extracted properties.

Claims

1. A computer-implemented method of automatically generating metadata used to develop graphical user interfaces, comprising:

scanning a hand-drawn image of a user interface to detect a candidate region on the image, the candidate region being potentially associated with a user interface component;

analyzing the candidate region to identify a user interface component contained therein by comparing a potential user interface component to user interface definitions stored in a database to identify one of the user interface definitions associated therewith;

extracting one or more properties of the identified user interface component;

generating metadata based on the user interface definition associated with the identified user interface component and the extracted properties; and

computer generating a second user interface based on the metadata and the scanned image.

2. The method of claim 1, wherein at least analyzing the candidate region to identify the user interface component contained therein further comprises performing an image recognition on the candidate region.

3. The method of claim 1, wherein one or more of the extracted properties comprise static properties.

4. The method of claim 3, wherein the static properties comprise at least one of a location of the identified user interface component, a font associated with the identified user interface component, a background color associated with the identified user interface component, or a size associated with the identified user interface component.

5. The method of claim 1, further comprising storing the generated metadata in a database.

6. The method of claim 1, wherein the image comprises one of a digital image, a gif image, a tiff image, or a jpeg image.

7. The method of claim 1, wherein the image comprises a digital image.

8. The method of claim 1, wherein the image comprises a screenshot of a user interface.

9. A computer-implemented method of automatically generating metadata used to develop graphical user interfaces, comprising:

scanning a drawn image of a user interface to detect a candidate region on the image, the candidate region being potentially associated with a user interface control;

performing an image recognition on the candidate region to identify a user interface control;

generating metadata based on the identified user interface control; and

computer-generating a second user interface based on the metadata and the scanned image.

10. The method of claim 9, wherein performing the image recognition is to further extract properties associated with the identified user interface control.

11. The method of claim 10, wherein one or more of the extracted properties comprise static properties.

12. The method of claim 11, wherein the static properties include at least one of a location of the identified user interface control, a font associated with the identified user interface control, a background color associated with the identified user interface control, or a size associated with the identified user interface control.

13. The method of claim 11, wherein performing an image recognition comprises identifying a potential user interface control and comparing the potential user interface control to user interface definitions stored in a database to identify one of the user interface definitions associated therewith.

14. The method of claim 13, wherein generating metadata based on the identified user interface control comprises generating the metadata based on the one of the user interface definitions associated with the identified user interface control.

15. A tangible computer-readable storage medium including executable instructions for execution using a processor, wherein the instructions, when executed, provide a system to generate metadata, the system comprising:

a detector to detect a candidate region on a drawn image of a user interface, the candidate region being potentially associated with a user interface control;

an analyzer to analyze the candidate region to identify a user interface control contained therein; and

a generator to generate metadata based on the identified user interface control, the generator to computer generate a second user interface based on the metadata and the image.

16. The tangible computer-readable storage medium of claim 15, wherein the analyzer is to compare a potential user interface control to user interface definitions stored in a database to identify one of the user interface definitions associated therewith.

17. The tangible computer-readable storage medium of claim 15, wherein the generator is to generate metadata further based on the user interface definition associated with the identified user interface control.

18. The tangible computer-readable storage medium of claim 15, wherein the analyzer is to further extract one or more properties of the detected user interface control.

19. The tangible computer-readable storage medium of claim 18, wherein the generator is to generate metadata further based on the extracted one or more properties.

20. The tangible computer-readable storage medium of claim 18, wherein the properties comprise static properties including at least one of a location of the identified user interface control, a font associated with the identified user interface control, a background color associated with the identified user interface control, or a size associated with the identified user interface control.