Image Recognition Scoring Visualization

• US 20170177195A1
• Filed: 12/18/2015
• Published: 06/22/2017
• Est. Priority Date: 12/18/2015
• Status: Active Grant

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Graham, Jamey, Romain, Tiffany, Findlay, Roland, Griffin, Michael
• Granted Patent: US 10,339,690 B2
• Time in Patent Office: Days
• CPC Class Codes: G06Q 10/087 Inventory or stock management, e.g. order filling, procurement or balancing against orders
• CPC Class Codes: G06Q 30/0623 Item investigation
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06V 10/16 using multiple overlapping images; Image stitching
• CPC Class Codes: G06V 10/17 using hand-held instruments
• CPC Class Codes: G06V 20/20 in augmented reality scenes

Abstract

A system and method for image processing result visualization. The method includes receiving a job, wherein the job includes a panoramic image and image recognition information, and creating a visualization based on the job, wherein the visualization includes the panoramic image with the image recognition information layered over the panoramic image.

Claims

1. A method comprising:

requesting, using one or more processors, a job related to a token;

receiving, using the one or more processors, the job related to the token, wherein the job includes a panoramic image and metadata;

processing, using the one or more processors, the metadata to extract image recognition information; and

creating, using the one or more processors, a visualization of the job, wherein the visualization includes the panoramic image with the image recognition information layered over the panoramic image.

2. The method of claim 1 wherein the visualization comprises:

highlighting, using the one or more processors, a recognized product in the panoramic image using the image recognition information; and

displaying, using the one or more processors, a product recognition list in response to a user selecting the recognized product.

3. The method of claim 2, comprising, creating the product recognition list by:

extracting, using the one or more processors, a listing of potential candidates that share similar features with the recognized product from the image recognition information; and

displaying, using the one or more processors, the listing of potential candidates.

4. The method of claim 2, wherein an entry in the product recognition list includes a recognition score for a corresponding potential candidate, the recognition score indicating similarity of a feature shared between the recognized product and the corresponding potential candidate.

5. The method of claim 2, further comprising:

displaying, using the one or more processors, a highlighted boundary overlaid on the recognized product in the panoramic image in response to the user indicating a correctness of a candidate in the product recognition list.

6. The method of claim 1, further comprising:

highlighting, using the one or more processors, a portion of the panoramic image based on recognized products sharing a characteristic.

7. The method of claim 1, further comprising:

displaying, using the one or more processors, a boundary around recognized products in the panoramic image; and

removing, using the one or more processors, portions of the panoramic image not associated with the recognized products.

8. The method of claim 1, wherein the visualization is a first visualization of a first job, the method further comprising:

creating, using the one or more processors, a second visualization of a second job;

comparing, using the one or more processors, the first visualization with the second visualization in a single display screen of a user interface; and

highlighting, using the one or more processors, differences between the visualization and the second visualization.

9. The method of claim 8, wherein comparing the first visualization with the second visualization further comprises displaying the first visualization and the second visualization in an animation, wherein the animation toggles between the first visualization and the second visualization.

10. A computer program product comprising a computer usable medium including a computer readable program, wherein the computer readable program when executed on a computer causes the computer to:

request, using one or more processors, a job related to a token;

receive, using the one or more processors, the job related to the token, wherein the job includes a panoramic image and metadata;

process, using the one or more processors, the metadata to extract image recognition information; and

create, using the one or more processors, a visualization of the job, wherein the visualization includes the panoramic image with the image recognition information layered over the panoramic image.

11. The computer program product of claim 10 wherein the visualization comprises:

highlighting, using the one or more processors, a recognized product in the panoramic image using the image recognition information; and

displaying, using the one or more processors, a product recognition list in response to a user selecting the recognized product.

12. The computer program product of claim 11, wherein the computer readable program when executed on a computer further causes the computer to create the product recognition list to:

extract, using the one or more processors, a listing of potential candidates that share similar features with the recognized product from the image recognition information; and

display, using the one or more processors, the listing of potential candidates.

13. The computer program product of claim 11, wherein the computer readable program when executed on a computer further causes the computer to:

display, using the one or more processors, a highlighted boundary overlaid on the recognized product in the panoramic image in response to the user indicating a correctness of a candidate in the product recognition list.

14. The computer program product of claim 10, wherein the visualization is a first visualization of a first job, wherein the computer readable program when executed on a computer further causes the computer to:

creating, using the one or more processors, a second visualization of a second job;

compare, using the one or more processors, the first visualization with the second visualization in a single display screen of a user interface; and

highlight, using the one or more processors, differences between the visualization and the second visualization.

15. A system comprising:

a processor; and

a memory storing instructions that, when executed, cause the system to;

request, using one or more processors, a job related to a token;

receive, using the one or more processors, the job related to the token, wherein the job includes a panoramic image and metadata;

process, using the one or more processors, the metadata to extract image recognition information; and

create, using the one or more processors, a visualization of the job, wherein the visualization includes the panoramic image with the image recognition information layered over the panoramic image.

16. The system of claim 15 wherein the memory also stores instructions that, when executed cause the system to:

highlighting, using the one or more processors, a recognized product in the panoramic image using the image recognition information; and

displaying, using the one or more processors, a product recognition list in response to a user selecting the recognized product.

17. The system of claim 16, the memory also stores instructions that, when executed cause the system to create the product recognition list by:

extracting, using the one or more processors, a listing of potential candidates that share similar features with the recognized product from the image recognition information; and

displaying, using the one or more processors, the listing of potential candidates.

18. The system of claim 16, wherein an entry in the product recognition list includes a recognition score for a corresponding potential candidate, the recognition score indicating similarity of a feature shared between the recognized product and the corresponding potential candidate.

19. The system of claim 16, wherein the memory also stores instructions that, when executed cause the system to:

display, using the one or more processors, a highlighted boundary overlaid on the recognized product in the panoramic image in response to the user indicating a correctness of a candidate in the product recognition list.

20. The system of claim 15, wherein the visualization is a first visualization of a first job, and wherein the memory also stores instructions that, when executed cause the system to:

creating, using the one or more processors, a second visualization of a second job;

comparing, using the one or more processors, the first visualization with the second visualization in a single display screen of a user interface; and

highlighting, using the one or more processors, differences between the visualization and the second visualization.