IMAGE RECOGNITION SYSTEM THAT DISPLAYS A USER-FRIENDLY GRAPHICAL USER INTERFACE

• US 20170076698A1
• Filed: 08/02/2016
• Published: 03/16/2017
• Est. Priority Date: 09/16/2015
• Status: Abandoned Application

• Current Assignee: Toshiba Tec Corporation (Toshiba Corporation)
• Original Assignee: Toshiba Tec Corporation (Toshiba Corporation)
• Inventors: NAITO, Hidehiro
• Application Number:
  US15/226,704
• Publication Number:
  US 20170076698A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 18/00 Pattern recognition
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06Q 20/20 Point-of-sale [POS] network systems
• CPC Class Codes: G06Q 30/0643 Graphical representation of items or shoppers
• CPC Class Codes: G06V 10/70 using pattern recognition or machine learning optical pattern recognition or electronic computations therefor G06V10/88
• CPC Class Codes: G06V 20/68 Food, e.g. fruit or vegetables
• CPC Class Codes: G09G 2320/0666 for control of colour parameters, e.g. colour temperature
• CPC Class Codes: G09G 2320/0686 with two or more screen areas displaying information with different brightness or colours
• CPC Class Codes: G09G 2320/08 Arrangements within a display terminal for setting, manually or automatically, display parameters of the display terminal
• CPC Class Codes: G09G 2340/0464 Positioning
• CPC Class Codes: G09G 2340/14 Solving problems related to the presentation of information to be displayed
• CPC Class Codes: G09G 5/02 characterised by the way in which colour is displayed details of colour display specific for CRTs G09G1/28; specific for flat matrix panels other than liquid crystal displays G09G3/2003; specific for liquid crystal displays G09G3/3607
• CPC Class Codes: G09G 5/38 with means for controlling the display position

Abstract

An image recognition system includes a data storage, a camera configured to capture an image of an article to be identified, a display, and a processor configured to calculate a feature value of the article to be identified, based on the captured image, determine one or more high-ranked candidates based on a similarity level between the feature value of the article to be identified and each of the feature values of reference articles stored in the data storage, and control the display to display a graphical user interface. The graphical user interface includes a plurality of objects arranged in a predetermined region thereof, each of one or more objects that corresponds to one of said one or more high-ranked candidates being displayed at a fixed display position that is associated with the corresponding high-ranked candidate.

Claims

1. An image recognition system, comprising:

a data storage that stores, in association with each of a plurality of reference articles, a feature value calculated from an image of the reference article;

a camera configured to capture an image of an article to be identified;

a display; and

a processor configured to

calculate a feature value of the article to be identified, based on the captured image,

determine one or more high-ranked candidates based on a similarity level between the feature value of the article to be identified and each of the feature values of the reference articles, and

control the display to display a graphical user interface that includes a plurality of objects arranged in a predetermined region thereof, wherein one or more objects corresponding to one of said one or more high-ranked candidates are displayed at a pre-selected fixed display position that is associated with the corresponding high-ranked candidate.

2. The image recognition system according to claim 1, wherein

in the graphical user interface, the display format of said one or more objects that correspond to said one or more high-ranked candidates is different from the display format of the rest of the plurality of objects which do not correspond to any of said one or more high-ranked candidates.

3. The image recognition system according to claim 2, wherein

said one or more objects that correspond to said one or more high-ranked candidates are not grayed out, and

said rest of the plurality of objects are grayed out.

4. The image recognition system according to claim 2, wherein

said one or more objects that correspond to said one or more high-ranked candidates are selectable, and

said rest of the plurality of objects are not selectable.

5. The image recognition system according to claim 1, wherein

the plurality of objects arranged in the predetermined region of the graphical user interface includes only said one or more objects that corresponds to said one or more high-ranked candidates.

6. The image recognition system according to claim 5, wherein

a display position is associated with at least two high-ranked candidates, and

an object corresponding to one of said at least two high-ranked candidates that has a highest similarity level is displayed at the pre-selected fixed display position.

7. The image recognition system according to claim 1, wherein

the processor is further configured to control the display to display, before determination of the high-ranked candidates, an initial graphical user interface that includes the plurality of objects, each of which corresponds to one of the reference articles and is displayed at a fixed display position that is associated with the corresponding reference article, and

in response to determination of the high-ranked candidates, the graphical user interface is displayed in place of the initial graphical user interface.

8. A method for displaying one or more graphical user interfaces for a computing environment, the method comprising:

storing, in association with each of a plurality of reference articles, a feature value calculated from an image of the reference article;

calculating a feature value of an article to be identified, based on a captured image thereof;

determining one or more high-ranked candidates based on a similarity level between the feature value of the article to be identified and each of the feature values of the reference articles; and

displaying a graphical user interface that includes a plurality of objects arranged in a predetermined region thereof, wherein one or more objects that corresponds to one of said one or more high-ranked candidates are displayed at a pre-selected fixed display position that is associated with the corresponding high-ranked candidate.

9. The method according to claim 8, wherein

in the graphical user interface, the display format of said one or more objects that correspond to said one or more high-ranked candidates is different from the display format of the rest of the plurality of objects which do not corresponds to any of said one or more high-ranked candidates.

10. The method according to claim 9, wherein

said one or more objects that correspond to said one or more high-ranked candidates are not grayed out, and

said rest of the plurality of objects are grayed out.

11. The method according to claim 9, wherein

said one or more objects that correspond to said one or more high-ranked candidates are selectable, and

said rest of the plurality of objects are not selectable.

12. The method according to claim 8, wherein

the plurality of objects arranged in the predetermined region of the graphical user interface includes only said one or more objects that corresponds to said one or more high-ranked candidates.

13. The method according to claim 8, wherein

when a display position is associated with at least two high-ranked candidates, an object corresponding to one of said at least two high-ranked candidates that has a highest similarity level is displayed at the pre-selected fixed display position.

14. The method according to claim 8, further comprising:

display, before determination of the high-ranked candidates, an initial graphical user interface that includes the plurality of objects, each of which corresponds to one of the reference articles and is displayed at a fixed display position that is associated with the corresponding reference article, wherein

in response to the determination of the high-ranked candidates, the graphical user interface is displayed in place of the initial graphical user interface.

15. A non-transitory computer readable medium comprising a program that is executable in a computing device to cause the computing device to perform a method for displaying one or more graphical user interfaces for a computing environment, the method comprising:

storing, in association with each of a plurality of reference articles, a feature value calculated from an image of the reference article;

calculating a feature value of an article to be identified, based on a captured image thereof;

determining one or more high-ranked candidates based on a similarity level between the feature value of the article to be identified and each of the feature values of the reference articles; and

displaying a graphical user interface that includes a plurality of objects arranged in a predetermined region thereof, wherein one or more objects that corresponds to one of said one or more high-ranked candidates are displayed at a fixed display position that is associated with the corresponding high-ranked candidate.

16. The non-transitory computer readable medium according to claim 15, wherein

in the graphical user interface, the display format of said one or more objects that correspond to said one or more high-ranked candidates is different from the display format of the rest of the plurality of objects which do not corresponds to any of said one or more high-ranked candidates.

17. The non-transitory computer readable medium according to claim 16, wherein

said one or more objects that correspond to said one or more high-ranked candidates are not grayed out, and

said rest of the plurality of objects are grayed out.

18. The non-transitory computer readable medium according to claim 16, wherein

said one or more objects that correspond to said one or more high-ranked candidates are selectable, and

said rest of the plurality of objects are not selectable.

19. The non-transitory computer readable medium according to claim 15, wherein

the plurality of objects arranged in the predetermined region of the graphical user interface includes only said one or more objects that corresponds to said one or more high-ranked candidates.

20. The non-transitory computer readable medium according to claim 15, wherein

when a display position is associated with at least two high-ranked candidates, an object corresponding to one of said at least two high-ranked candidates that has a highest similarity level is displayed at the display position.