Character and Object Recognition with a Mobile Photographic Device

• US 20080317346A1
• Filed: 06/21/2007
• Published: 12/25/2008
• Est. Priority Date: 06/21/2007
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Taub, Jonathan A.
• Application Number:
  US11/766,195
• Publication Number:
  US 20080317346A1
• Time in Patent Office: Days
• US Class Current: 382/182
• CPC Class Codes: G06V 20/20 in augmented reality scenes

Abstract

Character and object recognition are provided from digital photography followed by digitization and integration of recognized textual and non-textual content into a variety of software applications for enabling use of data associated with the photographed content. A digital photograph may be processed by an optical character recognizer or optical object recognizer for generating data associated with a photographed object. A user of the photographed content may tag the photographed content with descriptive or analytical information that may be used for improving recognition of the photographed content and that may be used by subsequent users of the photographed content. Data generated for the photographed object may then be passed to a variety of software applications for use in accordance with respective application functionalities.

Claims

1. A method of utilizing a photographed image in one or more software applications, comprising:

receiving a photograph of an image;

reading the photographed image and determining an identification of the photographed image;

passing the identification of the photographed image to one or more software applications; and

utilizing the identification of the photographed image via a programming associated with each of the one or more software applications.

2. The method of claim 1, wherein

wherein receiving a photograph of an image includes receiving a photograph of a text string;

and

wherein reading the photographed image and determining an identification of the photographed image includes reading the photographed text string and comparing the photographed text string against one or more stored test strings for identifying the photographed text string.

3. The method of claim 2, wherein passing the identification of the photographed image to one or more software applications includes passing the identified text string to the one or more software applications.

4. The method of claim 1, wherein

wherein receiving a photograph of an image includes receiving a photograph of a non-textual object;

and

wherein reading the photographed image and determining an identification of the photographed image includes reading the photographed non-textual object and comparing the photographed non-textual object against one or more stored non-textual objects for identifying the photographed non-textual object.

5. The method of claim 4, wherein passing the identification of the photographed image to one or more software applications includes passing the identified non-textual object to the one or more software applications.

6. The method of claim 1, prior to reading the photographed image and determining an identification of the photographed image, receiving an annotation to the photographed image, the annotation providing information about the photographed image.

7. The method of claim 6, wherein reading the photographed image and determining an identification of the photographed image further comprises reading any prior or new annotation to the photographed image and determining the identification of the photographed image from the annotation.

8. The method of claim 7, wherein receiving an annotation to the photographed image includes receiving descriptive information tagged to the photographed image.

9. The method of claim 7, wherein receiving an annotation to the photographed image includes receiving analytical inclination tagged to the photographed image.

10. The method of claim 2, wherein reading the photographed text string and comparing the photographed text string against one or more stored text strings for identifying the photographed text string includes reading the photographed text string and comparing the photographed text string against one or more stored test strings for identifying the photographed text string via an optical character recognizer application.

11. The method of claim 4, wherein reading the photographed non-textual object and comparing the photographed non-textual object against one or more stored non-textual objects for identifying the photographed non-textual object includes reading the photographed non-textual object and comparing the photographed non-textual object against one or more stored non-textual objects for identifying the photographed non-textual object via an optical object recognizer application.

12. The method of claim 6, further comprising storing the annotation to the photographed image and providing the annotation to the photographed image for providing information to a reviewer of the photographed image.

13. A computer readable medium containing computer executable instructions which when executed perform a method of utilizing a photographed image in one or more software applications, comprising:

receiving a photograph of an image;

receiving an annotation to the photographed image, the annotation providing information about the photographed image;

reading the photographed image and the annotation to the photographed image;

determining an identification of the photographed image;

passing the identification of the photographed image to one or more software applications; and

utilizing the photographed image via a programming associated with each of the one or more software applications.

14. The computer readable medium of claim 13, wherein

wherein receiving a photograph of an image includes receiving a photograph of a text string;

and

wherein determining an identification of the photographed image includes reading the photographed text string and comparing the photographed text string against one or more stored text strings for identifying the photographed text string.

15. The computer readable medium of claim 14, wherein passing the identification of the photographed image to one or more software applications includes passing the identified text string to the one or more software applications.

16. The computer readable medium of claim 13, wherein

wherein receiving a photograph of an image includes receiving a photograph of a non-textual object;

and

wherein determining an identification of the photographed image includes comparing the photographed non-textual object against one or more stored non-textual objects for identifying the photographed non-textual object.

17. The computer readable medium of claim 16, wherein passing the identification of the photographed image to one or more software applications includes passing the identified non-textual object to the one or more software applications.

18. A system for utilizing a photographed image in one or more software applications, comprising:

a mobile photographic device operative

to capture a photograph of an image;

to receive an annotation to the photographed image, the annotation providing information about the photographed image;

to pass the photograph to a recognizer application;

the recognizer application operative to determine an identification of the photographed image;

the mobile photographic device further operative

to pass the identification of the photographed image to one or more software applications; and

to utilize the photographed image via a programming associated with each of the one or more software applications.

19. The system of claim 18, wherein the recognizer application is further operative to compare the photographed image against one or more stored images for identifying the photographed image.

20. The system of claim 19, wherein the mobile photographic device is further operative

to store the annotation to the photographed image;

and to provide the annotation to a subsequent reviewer of the photographed image for providing information about the photographed image to the subsequent reviewer.