Triggering actions in response to optically or acoustically capturing keywords from a rendered document

• US 9,116,890 B2
• Filed: 06/11/2014
• Issued: 08/25/2015
• Est. Priority Date: 04/01/2004
• Status: Active Grant

• Current Assignee: Kyocera Corporation
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: King, Martin T., Grover, Dale L., Kushler, Clifford A., Stafford-Fraser, James Q.
• Primary Examiner(s): COUSO, JOSE L
• Application Number:
  US14/302,023
• Publication Number:
  US 20140294302A1
• Time in Patent Office: 440 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/41 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/433 using audio data
• CPC Class Codes: G06F 16/434 using image data, e.g. images, photos, pictures taken by a user
• CPC Class Codes: G06F 16/435 Filtering based on additional data, e.g. user or group profiles
• CPC Class Codes: G06F 16/44 Browsing; Visualisation therefor
• CPC Class Codes: G06F 16/5846 using extracted text
• CPC Class Codes: G06F 16/93 Document management systems
• CPC Class Codes: G06F 40/30 Semantic analysis
• CPC Class Codes: G06Q 30/0277 Online advertisement
• CPC Class Codes: G06V 30/153 using recognition of characters or words
• CPC Class Codes: G06V 30/412 Layout analysis of documents structured with printed lines or input boxes, e.g. business forms or tables
• CPC Class Codes: G06V 30/418 Document matching, e.g. of document images
• CPC Class Codes: H04L 51/04 Real-time or near real-time messaging, e.g. instant messaging [IM]

Abstract

A system for processing text captured from rendered documents is described. The system receives a sequence of one or more words optically or acoustically captured from a rendered document by a user. The system identifies among words of the sequence a word with which an action has been associated. The system then performs the associated action with respect to the user.

Claims

1. A computer-implemented method comprising:

receiving an output of performing an image capture process on a rendered document;

determining that the output includes a particular symbol;

determining a particular action that is associated with the particular symbol; and

transmitting an instruction to a document management system to perform the particular action.

2. The computer-implemented method of claim 1, further comprising:

receiving information associated with a user performing the image capture process on the rendered document;

identifying the user, based on the received information;

identifying the rendered document, based on the output of performing the image capture process;

identifying, from a corpus of electronic documents, an electronic document that corresponds to the rendered document; and

storing, in a repository, a record of the instruction to perform the particular action, the record comprising an identifier of the user, an identifier of the electronic document, an identifier of the particular action, and a timestamp associated with performing the particular action.

3. The computer-implemented method of claim 2, further comprising:

determining formatting information of the rendered document, based on the output of performing the image capture process,

wherein the record of the instruction to perform the particular action further comprises the formatting information of the rendered document and an identifier of the rendered document.

4. The computer-implemented method of claim 2, wherein transmitting the instruction to the document management system to perform the particular action comprises transmitting an instruction causing the electronic document to be displayed on a display device to the user.

5. The computer-implemented method of claim 2, wherein transmitting the instruction to the document management system to perform the particular action comprises transmitting an instruction causing the electronic document to be sent to an email address associated with the user.

6. The computer-implemented method of claim 2, further comprising:

receiving a request for document identifiers of documents on which the particular action has been performed;

locating records stored in the repository that are associated with the identifier of the particular action; and

providing document identifiers associated with the located records.

7. The computer-implemented method of claim 1, wherein transmitting the instruction to the document management system to perform the particular action comprises transmitting an instruction causing a copy of the rendered document to be printed.

8. The computer-implemented method of claim 1, wherein transmitting the instruction to the document management system to perform the particular action comprises transmitting an instruction causing a control program to be executed.

9. A system, comprising:

one or more data processing apparatus; and

a computer-readable storage device including instructions executable by the data processing apparatus and upon such execution cause the data processing apparatus to perform operations comprising;

receiving an output of performing an image capture process on a rendered document;

determining that the output includes a particular symbol;

determining a particular action that is associated with the particular symbol; and

transmitting an instruction to a document management system to perform the particular action.

10. The system of claim 9, wherein the operations further comprise:

receiving information associated with a user performing the image capture process on the rendered document;

identifying the user, based on the received information;

identifying the rendered document, based on the output of performing the image capture process;

identifying, from a corpus of electronic documents, an electronic document that corresponds to the rendered document; and

storing, in a repository, a record of the instruction to perform the particular action, the record comprising an identifier of the user, an identifier of the electronic document, an identifier of the particular action, and a timestamp associated with performing the particular action.

11. The system of claim 10, wherein the operations further comprise:

determining formatting information of the rendered document, based on the output of performing the image capture process,

wherein the record of the instruction to perform the particular action further comprises the formatting information of the rendered document and an identifier of the rendered document.

12. The system of claim 10, wherein transmitting the instruction to the document management system to perform the particular action comprises transmitting an instruction causing the electronic document to be displayed on a display device to the user.

13. The system of claim 10, wherein transmitting the instruction to the document management system to perform the particular action comprises transmitting an instruction causing the electronic document to be sent to an email address associated with the user.

14. The system of claim 10, wherein the operations further comprise:

receiving a request for document identifiers of documents on which the particular action has been performed;

locating records stored in the repository that are associated with the identifier of the particular action; and

providing document identifiers associated with the located records.

15. The system of claim 9, wherein transmitting the instruction to the document management system to perform the particular action comprises transmitting an instruction causing a copy of the rendered document to be printed.

16. The system of claim 9, wherein transmitting the instruction to the document management system to perform the particular action comprises transmitting an instruction causing a control program to be executed.

17. A computer-readable storage device storing software including instructions executable by one or more computers which, upon such execution, cause the one or more computers to perform operations comprising:

receiving an output of performing an image capture process on a rendered document;

determining that the output includes a particular symbol;

determining a particular action that is associated with the particular symbol; and

transmitting an instruction to a document management system to perform the particular action.

18. The computer-readable storage device of claim 17, wherein the operations further comprise:

receiving information associated with a user performing the image capture process on the rendered document;

identifying the user, based on the received information;

identifying the rendered document, based on the output of performing the image capture process;

identifying, from a corpus of electronic documents, an electronic document that corresponds to the rendered document; and

storing, in a repository, a record of the instruction to perform the particular action, the record comprising an identifier of the user, an identifier of the electronic document, an identifier of the particular action, and a timestamp associated with performing the particular action.

19. The computer-readable storage device of claim 18, wherein the operations further comprise:

determining formatting information of the rendered document, based on the output of performing the image capture process,

wherein the record of the instruction to perform the particular action further comprises the formatting information of the rendered document and an identifier of the rendered document.

20. The computer-readable storage device of claim 18, wherein the operations further comprise:

receiving a request for document identifiers of documents on which the particular action has been performed;

locating records stored in the repository that are associated with the identifier of the particular action; and

providing document identifiers associated with the located records.