CAPTURING TEXT FROM RENDERED DOCUMENTS USING SUPPLEMENTAL INFORMATION

• US 20150063714A1
• Filed: 09/05/2014
• Published: 03/05/2015
• Est. Priority Date: 01/26/2004
• Status: Active Grant

• Current Assignee: Kyocera Corporation
• Original Assignee: Google Inc. (Alphabet Inc.), Cheryl Grunbock
• Inventors: King, Martin T., Grover, Dale L., Kushler, Clifford A., Stafford-Fraser, James Q.
• Granted Patent: US 10,115,041 B2
• Time in Patent Office: Days
• US Class Current: 382/229
• CPC Class Codes: G06F 40/00 Handling natural language data speech analysis or synthesis, speech recognition G10L
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes
• CPC Class Codes: G06V 10/768 using context analysis, e.g. recognition aided by known co-occurring patterns
• CPC Class Codes: G06V 30/40 Document-oriented image-based pattern recognition

Abstract

A system for processing a text capture operation is described. The system receives text captured from a rendered document in the text capture operation. The system also receives supplemental information distinct from the captured text. The system determines an action to perform in response to the text capture operation based upon both the captured text and the supplemental information.

Claims

1. (canceled)

2. A method performed by a data processing apparatus, the method comprising:

receiving, at a computing device, text captured from a rendered document during a text capture operation;

receiving, at the computing device, supplemental information relating to circumstances under which the text capture operation was performed; and

determining, by the computing device and based on the supplemental information, an action to be performed on the captured text.

3. The method of claim 2, wherein the supplemental information comprises a geographic location at which the text was captured from the rendered document.

4. The method of claim 3, wherein determining the action to be performed comprises determining the action based on actions being performed by users within a threshold distance of the geographic location.

5. The method of claim 2, wherein:

the text was captured by a user using a text capture device; and

the supplemental information comprises previous text captured by the user during one or more previous text capture operations.

6. The method of claim 5, wherein determining the action to be performed comprises determining the action based on additional supplemental information relating to circumstances under which the previous one or more text capture operations were performed.

7. The method of claim 6, wherein the additional supplemental information comprises information describing actions performed by the user within a threshold amount of time of at least one of the previous one or more text capture operations.

8. The method of claim 2, wherein the supplemental information comprises information describing an environment in which the text capture operation was performed.

9. The method of claim 8, wherein the information describing the environment comprises at least one of information describing lighting, temperature, or sound at a location in which the text capture operation was performed.

10. The method of claim 2, wherein the supplemental information comprises a prediction of a user'"'"'s future context.

11. The method of claim 2, wherein determining the action to be performed comprises customizing presentation of content based on the supplemental information.

12. The method of claim 2, further comprising identifying a plurality of electronic documents that include the captured text, wherein the action comprises identifying a particular electronic document from the plurality of electronic documents based on the supplemental information.

13. A system, comprising:

a data processing apparatus; and

a memory apparatus in data communication with the data processing apparatus and storing instructions executable by the data processing apparatus and that upon such execution cause the data processing apparatus to perform operations comprising;

receiving text captured from a rendered document during a text capture operation;

receiving supplemental information relating to circumstances under which the text capture operation was performed; and

determining, based on the supplemental information, an action to be performed on the captured text.

14. The system of claim 13, wherein the supplemental information comprises a geographic location at which the text was captured from the rendered document.

15. The system of claim 14, wherein determining the action to be performed comprises determining the action based on actions being performed by users within a threshold distance of the geographic location.

16. The system of claim 13, wherein:

the text was captured by a user using a text capture device; and

the supplemental information comprises previous text captured by the user during one or more previous text capture operations.

17. The system of claim 16, wherein determining the action to be performed comprises determining the action based on additional supplemental information relating to circumstances under which the previous one or more text capture operations were performed.

18. The system of claim 17, wherein the additional supplemental information comprises information describing actions performed by the user within a threshold amount of time of at least one of the previous one or more text capture operations.

19. The system of claim 13, wherein the supplemental information comprises information describing an environment in which the text capture operation was performed.

20. The system of claim 19, wherein the information describing the environment comprises at least one of information describing lighting, temperature, or sound at a location in which the text capture operation was performed.

21. A computer storage medium encoded with a computer program, the program comprising instructions that when executed by data processing apparatus cause the data processing apparatus to perform operations comprising:

receiving text captured from a rendered document during a text capture operation;

receiving supplemental information relating to circumstances under which the text capture operation was performed; and

determining, based on the supplemental information, an action to be performed on the captured text.