Triggering actions in response to optically or acoustically capturing keywords from a rendered document

• US 9,514,134 B2
• Filed: 07/15/2015
• Issued: 12/06/2016
• Est. Priority Date: 04/01/2004
• Status: Active Grant

• Current Assignee: Kyocera Corporation
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: King, Martin T., Grover, Dale L., Kushler, Clifford A., Stafford-Fraser, James Q.
• Primary Examiner(s): COUSO, JOSE L
• Application Number:
  US14/800,335
• Publication Number:
  US 20150324355A1
• Time in Patent Office: 510 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/41 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/433 using audio data
• CPC Class Codes: G06F 16/434 using image data, e.g. images, photos, pictures taken by a user
• CPC Class Codes: G06F 16/435 Filtering based on additional data, e.g. user or group profiles
• CPC Class Codes: G06F 16/44 Browsing; Visualisation therefor
• CPC Class Codes: G06F 16/5846 using extracted text
• CPC Class Codes: G06F 16/93 Document management systems
• CPC Class Codes: G06F 40/30 Semantic analysis
• CPC Class Codes: G06Q 30/0277 Online advertisement
• CPC Class Codes: G06V 30/153 using recognition of characters or words
• CPC Class Codes: G06V 30/412 Layout analysis of documents structured with printed lines or input boxes, e.g. business forms or tables
• CPC Class Codes: G06V 30/418 Document matching, e.g. of document images
• CPC Class Codes: H04L 51/04 Real-time or near real-time messaging, e.g. instant messaging [IM]

Abstract

A system for processing text captured from rendered documents is described. The system receives a sequence of one or more words optically or acoustically captured from a rendered document by a user. The system identifies among words of the sequence a word with which an action has been associated. The system then performs the associated action with respect to the user.

Claims

1. A computer-implemented method comprising:

receiving a sequence of symbols optically captured from a rendered document;

determining that the sequence of symbols includes a particular symbol, word, or phrase;

determining a particular action that is associated with the particular symbol, word, or phrase; and

transmitting an instruction to a document management system to perform the particular action.

2. The computer-implemented method of claim 1, further comprising:

identifying the rendered document, based on the optically captured sequence of symbols; and

identifying, from a corpus of electronic documents, an electronic document that corresponds to the rendered document, wherein transmitting the instruction to the document management system includes specifying that the particular action is to be performed on the electronic document.

3. The computer-implemented method of claim 2, further comprising:

identifying an expiry date associated with the electronic document that corresponds to the rendered document, wherein transmitting the instruction to the document management system to perform the particular action on the electronic document occurs before the expiry date.

4. The computer-implemented method of claim 2, further comprising:

receiving information associated with an operator of a capture device used to optically capture the sequence of symbols from the rendered document;

identifying the operator, based on the received information; and

storing, in a repository, a record of the instruction to perform the particular action, the record comprising an identifier of the operator, an identifier of the electronic document, an identifier of the particular action, and a timestamp associated with performing the particular action.

5. The computer-implemented method of claim 1, wherein determining the particular action that is associated with the particular symbol, word, or phrase comprises accessing a data structure that associates the particular symbol, word, or phrase with the particular action, one or more conditions to be satisfied in order to perform the particular action, and an object on which the particular action is to be performed.

6. The computer-implemented method of claim 1, further comprising:

determining a location within the rendered document of the particular symbol, word, or phrase, wherein determining the particular action that is associated with the particular symbol, word, or phrase comprises accessing a data structure that associates the particular symbol, word, or phrase with the particular action when the location of the particular symbol, word, or phrase is in a particular portion of the rendered document, and an object on which the particular action is to be performed.

7. The computer-implemented method of claim 1, further comprising:

receiving information associated with an operator of a capture device used to optically capture the sequence of symbols from the rendered document, wherein determining the particular action is based at least in part on a profile of the operator.

8. The computer-implemented method of claim 1, further comprising:

receiving information associated with a location of a capture device used to optically capture the sequence of symbols from the rendered document, wherein determining the particular action is based at least in part on the location of the capture device.

9. The computer-implemented method of claim 1, wherein determining the particular action is based at least in part on a time or date range in which the sequence of symbols were optically captured from the rendered document.

10. The computer-implemented method of claim 1, wherein the particular symbol is encoded with data that identifies the particular symbol, the rendered document, and a location of the particular symbol within the document.

11. The computer-implemented method of claim 1, wherein the particular symbol is encoded with data that indicates that an electronic document that corresponds to the rendered document exists in a corpus of electronic documents.

12. The computer-implemented method of claim 1, further comprising:

transmitting a prompt to a capture device requesting that a particular portion of the rendered document be optically captured; and

in response to receiving, from the capture device, data corresponding to an optical capture of the particular portion of the rendered document, providing access to an electronic document that corresponds to the rendered document.

13. A system, comprising:

one or more data processing apparatus; and

one or more computer-readable storage devices including instructions executable by the data processing apparatus and upon such execution cause the data processing apparatus to perform operations comprising;

receiving a sequence of symbols optically captured from a rendered document;

determining that the sequence of symbols includes a particular symbol, word, or phrase;

determining a particular action that is associated with the particular symbol, word, or phrase; and

transmitting an instruction to a document management system to perform the particular action.

14. The system of claim 13, wherein the operations further comprise:

identifying the rendered document, based on the optically captured sequence of symbols; and

identifying, from a corpus of electronic documents, an electronic document that corresponds to the rendered document, wherein transmitting the instruction to the document management system includes specifying that the particular action is to be performed on the electronic document.

15. The system of claim 14, wherein the operations further comprise:

receiving information associated with an operator of a capture device used to optically capture the sequence of symbols from the rendered document;

identifying the operator, based on the received information; and

storing, in a repository, a record of the instruction to perform the particular action, the record comprising an identifier of the operator, an identifier of the electronic document, an identifier of the particular action, and a timestamp associated with performing the particular action.

16. The system of claim 13, wherein determining the particular action that is associated with the particular symbol, word, or phrase comprises accessing a data structure that associates the particular symbol, word, or phrase with the particular action, one or more conditions to be satisfied in order to perform the particular action, and an object on which the particular action is to be performed.

17. The system of claim 13, wherein the operations further comprise:

determining a location within the rendered document of the particular symbol, word, or phrase, wherein determining the particular action that is associated with the particular symbol, word, or phrase comprises accessing a data structure that associates the particular symbol, word, or phrase with the particular action when the location of the particular symbol, word, or phrase is in a particular portion of the rendered document, and an object on which the particular action is to be performed.

18. The system of claim 13, wherein the operations further comprise:

receiving information associated with a location of a capture device used to optically capture the sequence of symbols from the rendered document, wherein determining the particular action is based at least in part on the location of the capture device.

19. The system of claim 13, wherein the operations further comprise:

transmitting a prompt to a capture device requesting that a particular portion of the rendered document be optically captured; and

in response to receiving, from the capture device, data corresponding to an optical capture of the particular portion of the rendered document, providing access to an electronic document that corresponds to the rendered document.

20. A computer-readable storage device storing software including instructions executable by one or more computers which, upon such execution, cause the one or more computers to perform operations comprising:

receiving a sequence of symbols optically captured from a rendered document;

determining that the sequence of symbols includes a particular symbol, word, or phrase;

determining a particular action that is associated with the particular symbol, word, or phrase; and

transmitting an instruction to a document management system to perform the particular action.