IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD, AND PROGRAM

• US 20140193038A1
• Filed: 08/15/2012
• Published: 07/10/2014
• Est. Priority Date: 10/03/2011
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Kasahara, Shunichi
• Granted Patent: US 9,355,496 B2
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments

Abstract

An information processing system that acquires an image captured by an image pickup unit; acquires one or a plurality of templates each including one or a plurality of fields; compares the image to the one or plurality of templates; and outputs a result based on the comparison, the result indicating whether recognition of each of the one or plurality of fields of the one or plurality of templates was successful.

Claims

1. An information processing system comprising:

one or more processing units that;

acquire an image captured by an image pickup unit;

acquire one or a plurality of templates each including one or a plurality of fields;

compare the image to the one or plurality of templates; and

output a result based on the comparison, the result indicating whether recognition of each of the one or plurality of fields of the one or plurality of templates was successful.

2. The information processing system of claim 1, wherein

the image includes an object and the one or more processing units recognize a structure of the object.

3. The information processing system of claim 2, wherein

the one or more processing units recognize a structure of the object by detecting one or more fields included in the object.

4. The information processing system of claim 1, wherein

the one or more processing units extract edges from the image.

5. The information processing system of claim 4, wherein

the one or more processing units compare the image to the one or plurality of templates by determining a degree of matching between the edges extracted from the image and frames of fields included in the one or plurality of templates.

6. The information processing system of claim 4, wherein

the one or more processing units compare the image to the one or plurality of templates by determining a degree of matching between the edges extracted from the image and frames of fields included in the one or plurality of templates while changing a position of the one or plurality of templates.

7. The information processing system of claim 4, wherein

the one or more processing units compare the image to the one or plurality of templates by determining a degree of matching between the edges extracted from the image and frames of fields included in the one or plurality of templates while changing a posture of the one or plurality of templates.

8. The information processing system of claim 1, wherein

the one or more processing units recognize information associated with at least one field included in a matching template from the image.

9. The information processing system of claim 8, wherein

the at least one field is a field selected based on recognizing the matching template.

10. The information processing system of claim 1, wherein

the one or more processing units recognize information associated with at least one field included in a matching template from the image by performing optical character recognition (OCR) on a portion of the image associated with the at least one field.

11. The information processing system of claim 1, wherein

the one or more processing units recognize information associated with at least one field included in a matching template from the image by matching portions of the image associated with the at least one field with stored image information.

12. The information processing system of claim 1, wherein

the image associated with the at least one field is an image of a face, and

the image of the face is matched with stored face image information.

13. The information processing system of claim 8, wherein

the one or more processing units control a display to superimpose the recognized information on the image.

14. The information processing system of claim 1, wherein

the one or more processing units generate assistance information for guiding a user of the image pickup unit to adjust the image pickup unit based on a result of the comparing.

15. The information processing system of claim 14, wherein

the assistance information instructs the user to change an orientation of the image pickup unit.

16. The information processing system of claim 14, wherein

the assistance information instructs the user to change at least one of a position and setting of the image pickup unit to change a size of the image captured by the image pickup unit.

17. The information processing system of claim 1, wherein

the result that is output based on the comparison includes controlling a display to display one or a plurality of fields for which recognition was successful differently from one or a plurality of fields for which recognition was not successful.

18. The information processing system of claim 1, wherein

the captured image and the one or plurality of templates correspond to a web page.

19. The information processing system of claim 18, wherein

the one or more processing units recognize information associated with at least one field included in a matching template corresponding to the web page from the image.

20. The information processing system of claim 19, wherein

the one or more processing units controls a process of accessing the web page based on the recognized information.

21. The information processing system of claim 19, wherein

the recognized information corresponds to login information for the web page.

22. The information processing system of claim 1, wherein

the information processing system is a mobile phone and the one or more processing units are a processor at the mobile phone.

23. The information processing system of claim 1, wherein

the information processing system includes a client and a server.

24. The information processing system of claim 23, wherein

the client includes

the image pickup unit;

and

a first communication interface that sends the image to the server; and

the server includes

a second communication interface that receives the image from the client;

at least one of the one or more processing units that acquires the one or a plurality of templates from a memory, compares the image to the one or plurality of templates, and controls the second communication interface to output the result based on the comparison to the client.

25. An information processing method performed by an information processing system, the method comprising:

acquiring an image captured by an image pickup unit;

acquiring one or a plurality of templates each including one or a plurality of fields;

comparing the image to the one or plurality of templates; and

outputting a result based on the comparison, the result indicating whether recognition of each of the one or plurality of fields of the one or plurality of templates was successful.

26. A non-transitory computer-readable medium including computer program instructions, which when executed by an information processing system, cause the information processing system to perform a method, the method comprising:

acquiring an image captured by an image pickup unit;

acquiring one or a plurality of templates each including one or a plurality of fields;

comparing the image to the one or plurality of templates; and

outputting a result based on the comparison, the result indicating whether recognition of each of the one or plurality of fields of the one or plurality of templates was successful.