Publishing techniques for adding value to a rendered document

• US 8,621,349 B2
• Filed: 10/05/2010
• Issued: 12/31/2013
• Est. Priority Date: 04/01/2004
• Status: Active Grant

• Current Assignee: Kyocera Corporation
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: King, Martin T., Grover, Dale L., Kushler, Clifford A., Stafford-Fraser, James Q.
• Primary Examiner(s): Abdul-Ali, Omar
• Assistant Examiner(s): TANK, ANDREW L
• Application Number:
  US12/898,653
• Publication Number:
  US 20110026838A1
• Time in Patent Office: 1,183 Days
• Field of Search: 715/201, 715/205, 715/705, 715/708, 715/720, 715/864, 715/716, 382/100, 382/172, 382/181, 382/306, 382/292, 382/305, 434/308, 434/317, 434/318, 434/316
• US Class Current: 715/716
• CPC Class Codes: G06Q 30/00 Commerce
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: G06V 30/1452 based on positionally close symbols, e.g. amount sign or URL-specific characters

Abstract

A system for processing a visual capture operation as described. The system receives an indication of a visual capture operation performed from a rendered document. The indication specifies both a text sequence capture As part of the capture operation and a supplemental marking captured as part of the capture operation. The system determines an action to perform in response to receiving the indication, based both upon the text sequence specified in the indication and the supplemental markings specified by the indication.

Claims

1. A method, comprising:

capturing an image from a printed document using a mobile device, the image including a text fragment;

locating a position in the printed document containing the text fragment; and

presenting a time-indexed media sequence at a time index for the time-indexed media sequence that corresponds to the located position in the printed document.

2. The method of claim 1, further comprising:

identifying the printed document using the text fragment.

3. The method of claim 1 wherein presenting the time-indexed media sequence comprises presenting the time-indexed media sequence using the mobile device.

4. The method of claim 1 wherein the media sequence comprises an audio sequence, a movie, a video sequence, a sequence of images, an audio/video sequence, or combinations thereof.

5. The method of claim 1 wherein the printed document comprises a book.

6. The method of claim 1 wherein the time-indexed media sequence contains all words of a contiguous portion of the printed document, and wherein the contiguous portion comprises multiple words and includes the text fragment.

7. A non-transitory computer-readable medium having instructions stored thereon that, if executed by a mobile device, cause the mobile device to perform functions comprising:

capturing an image from a printed document, the image including a text fragment;

locating a position in the printed document containing the text fragment; and

presenting a time-indexed media sequence at a time index for the time-indexed media sequence that corresponds to the located position in the printed document.

8. A mobile device, comprising:

an image sensor configured to capture an image of a printed document, the image including a text fragment;

a location subsystem configured to locate a position in the printed document containing the text fragment; and

a displaying subsystem configured to present a time-indexed media sequence at a time index for the time-indexed media sequence that corresponds to the located position in the printed document.

9. The mobile device of claim 8 wherein the mobile device further comprises a wireless transceiver for mobile telephony.

10. A method, comprising:

performing an optical capture from a book using an optical component of a mobile device

identifying the book from the optical capture, using the mobile device, by at least;

identifying a text fragment within the optical capture, and

locating, a position in the book containing the identified text fragment;

retrieving a media sequence associated with the book using the mobile device; and

presenting the retrieved media sequence using the mobile device by at least presenting the retrieved media sequence at a time in the time-indexed media sequence that corresponds to the located position in the book.

11. The method of claim 10, wherein the book comprises an academic textbook.

12. The method of claim 10, wherein the retrieved media sequence was created after the book was produced.

13. The method of claim 10, wherein the retrieved media sequence was created by a creator unrelated to a publisher of the book.

14. The method, of claim 10, wherein the mobile device comprises a cell phone.

15. The method of claim 10, wherein the presented media sequence contains all words of a contiguous portion of the book, and wherein the contiguous portion comprises multiple words and includes the text fragment.

16. A non-transitory computer-readable medium having instructions stored thereon that, if executed by a mobile device, cause the mobile device to perform functions comprising:

performing a optical capture from a book;

identifying the book from the optical capture, by at least;

identifying a text fragment within the optical capture, and

locating a position in the book containing the identified text fragment;

retrieving a media sequence associated with the book; and

presenting the retrieved media sequence by at least presenting the retrieved media sequence at a time in the time-indexed media sequence that corresponds to the located position in the book.

17. The non-transitory computer-readable medium of claim 16, wherein the book comprises an academic textbook.

18. The non-transitory computer-readable medium of claim 16, wherein the retrieved media sequence was created after the book was produced.

19. The non-transitory computer-readable medium of claim 16, wherein the retrieved media sequence was created by a creator unrelated to a publisher of the book.

20. The non-transitory compute-readable medium of claim 16, wherein the mobile device comprises a cell phone.

21. The non-transitory computer -readable medium of claim 16, wherein the presented media sequence contains all words of a contiguous portion of the book, and wherein the contiguous portion comprises multiple words that include the text fragment.

22. A mobile device, comprising:

an image sensor configured to perform an optical capture from a book;

an identification subsystem that is configured to identify the book from the optical capture by at least;

identifying a text fragment within the optical capture, and

locating a position in the book containing the identified text fragment;

a retrieval subsystem configured to retrieve a media sequence associated with the book; and

a display subsystem configured to present the retrieved media sequence by at least presenting the retrieved media sequence at a time in the media sequence that corresponds to the located position in the book.

23. The mobile device of claim 22, wherein the book comprises an academic textbook.

24. The mobile device of claim 22, wherein the retrieved media sequence was created after the book was produced.

25. The mobile device of claim 22, wherein the retrieved media. sequence was created by a creator unrelated to a publisher of the book.

26. The mobile device of claim 22, further comprising a wireless transceiver configured for mobile telephony.

27. The mobile device of claim 22, wherein the presented media sequence contains all words of a contiguous portion of the book, and wherein the contiguous portion comprises multiple words and includes the text fragment.