Auditing icons via image recognition to provide individualized assets to software project teams

• US 10,613,707 B2
• Filed: 12/10/2015
• Issued: 04/07/2020
• Est. Priority Date: 12/10/2015
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Calder, Cameron E., Helman, Blake M., Seo, Hyun K.
• Primary Examiner(s): Tran, Tan H
• Application Number:
  US14/965,376
• Publication Number:
  US 20170168676A1
• Time in Patent Office: 1,580 Days
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 8/20 Software design
• CPC Class Codes: G06F 8/34 Graphical or visual programming
• CPC Class Codes: G06F 8/38 for implementing user interfaces
• CPC Class Codes: G06F 8/77 Software metrics
• CPC Class Codes: G06V 10/50 by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
• CPC Class Codes: G06V 10/56 relating to colour
• CPC Class Codes: G06V 10/751 Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
• CPC Class Codes: G06V 30/413 Classification of content, e.g. text, photographs or tables

Abstract

Individualized icon elements are provided to a development team implementing a user interface or other image content for a new software application. A computer system receives an electronic document representing an image mockup from a designer, and scans the electronic document to identify mock icons. The mock icons are matched to corresponding icons in a digital icon repository. Each icon in the repository has associated metadata such as file name, description, file format, location, etc. Icons may be available with different file formats. The corresponding icons are provided with associated metadata in a form which is selectable by a developer. Corresponding icons may be provided by displaying icon images with respective confidence values representing an estimated likelihood of matching. A desired icon can be selected for inclusion in an icon package, and thereafter be removed from the list of available icons in the icon repository for the current project.

Claims

1. A method of providing individualized icon elements comprising:

receiving an electronic document in a computer system, the electronic document containing an image mockup, the image mockup being a nonfunctional visual representation of a graphical user interface for a proposed new software program, by executing first instructions in the computer system;

scanning the image mockup to identify at least one mock icon therein, the mock icon having an intended functionality relating to initiation of a computer program routine as part of the new software program, by executing second instructions in the computer system;

matching the mock icon to a plurality of corresponding icons which are available in a digital icon repository, the repository including a plurality of computer program icons each having an associated functionality, each computer program icon in the repository having associated metadata, by executing third instructions in the computer system;

in response to said matching, displaying images for each of the plurality of corresponding icons with the associated metadata on a display device of the computer system in a form which is selectable by a user, by executing fourth instructions in the computer system, wherein the plurality of corresponding icons are displayed with respective confidence values representing an estimated likelihood of matching the mock icon;

receiving a user selection of a desired one of the plurality of corresponding icons for inclusion in an icon package, by executing fifth instructions in the computer system; and

using the icon package to construct appropriate code to implement the desired icon with the intended functionality in the new software program, by executing sixth instructions in the computer system.

2. The method of claim 1 wherein the associated metadata includes at least a file name, a description, a file format, and a location.

3. The method of claim 1 wherein at least one of the plurality of corresponding icons is available with different file formats in the icon repository.

4. The method of claim 1, further comprising removing the desired icon from icons which are available in the icon repository in response to said selecting, by executing sixth instructions in the computer system.

5. A computer system comprising:

a display device;

one or more processors which process program instructions;

a memory device connected to said one or more processors; and

program instructions residing in said memory device for providing individualized icon elements by receiving an electronic document containing an image mockup wherein the image mockup is a nonfunctional visual representation of a graphical user interface for a proposed new software program, scanning the image mockup to identify at least one mock icon therein wherein the mock icon has an intended functionality relating to initiation of a computer program routine as part of the new software program, matching the mock icon to a plurality of corresponding icons which are available in a digital icon repository wherein the repository includes a plurality of computer program icons each having an associated functionality and each computer program icon in the repository has associated metadata, responsive to the matching, displaying images for each of the plurality of corresponding icons with the associated metadata on said display device in a form which is selectable by a user, wherein the plurality of corresponding icons are displayed with respective confidence values representing an estimated likelihood of matching the mock icon, receiving a user selection of a desired one of the plurality of corresponding icons for inclusion in an icon package, and using the icon package to construct appropriate code to implement the desired icon with the intended functionality in the new software program.

6. The computer system of claim 5 wherein the associated metadata includes at least a file name, a description, a file format, and a location.

7. The computer system of claim 5 wherein at least one of the plurality of corresponding icons is available with different file formats in the icon repository.

8. The computer system of claim 5 wherein said program instructions further include removing the desired icon from icons which are available in the icon repository in response to said selecting.

9. A computer program product comprising:

a computer readable storage medium; and

program instructions residing in said storage medium for providing individualized icon elements by receiving an electronic document in a computer system wherein the electronic document contains an image mockup wherein the image mockup is a nonfunctional visual representation of a graphical user interface for a proposed new software program, scanning the image mockup to identify at least one mock icon therein wherein the mock icon has an intended functionality relating to initiation of a computer program routine as part of the new software program, matching the mock icon to a plurality of corresponding icons which are available in a digital icon repository wherein the repository includes a plurality of computer program icons each having an associated functionality and each computer program icon in the repository has associated metadata, responsive to the matching, displaying images for each of the plurality of corresponding icons with the associated metadata on a display device of the computer system in a form which is selectable by a user, wherein the plurality of corresponding icons are displayed with respective confidence values representing an estimated likelihood of matching the mock icon, receiving a user selection of a desired one of the plurality of corresponding icons for inclusion in an icon package, and using the icon package to construct appropriate code to implement the desired icon with the intended functionality in the new software program.

10. The computer program product of claim 9 wherein the associated metadata includes at least a file name, a description, a file format, and a location.

11. The computer program product of claim 9 wherein at least one of the plurality of corresponding icons is available with different file formats in the icon repository.

12. The computer program product of claim 9 wherein said program instructions further include removing the desired icon from icons which are available in the icon repository in response to said selecting.