System and methods for use of voice mail and email in a mixed media environment

• US 7,812,986 B2
• Filed: 07/31/2006
• Issued: 10/12/2010
• Est. Priority Date: 08/23/2005
• Status: Active Grant

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Graham, Jamey, Piersol, Kurt, Hart, Peter E., Hull, Jonathan J., Weyl, Stephen A., Ridout, Kevin
• Primary Examiner(s): Tieu; Benny Q
• Assistant Examiner(s): Chen; Huo Long
• Application Number:
  US11/461,075
• Publication Number:
  US 20070047008A1
• Time in Patent Office: 1,534 Days
• Field of Search: 358/442, 358/401, 358/1.15, 358/402, 379/88.14, 379/88.22, 379/142.01, 379/110.13, 379/88.17, 379/433.07, 701/1, 701/10, 701/206, 714/752, 714/776
• US Class Current: 358/1.15
• CPC Class Codes: G06V 20/62 Text, e.g. of license plates, overlay texts or captions on TV images
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: G06V 30/18086 by performing operations within image blocks or by using histograms
• CPC Class Codes: G06V 30/274 Syntactic or semantic context, e.g. balancing
• CPC Class Codes: H04N 1/32133 on the same paper sheet, e.g. a facsimile page header
• CPC Class Codes: H04N 1/34 for coin-freed systems ; Pay systems
• CPC Class Codes: H04N 2201/3249 data relating to a linked page or object, e.g. hyperlink
• CPC Class Codes: H04N 2201/3269 of machine readable codes or marks, e.g. bar codes or glyphs
• CPC Class Codes: H04N 2201/3273 Display
• CPC Class Codes: H04N 2201/3274 Storage or retrieval of prestored additional information

Abstract

A mixed media reality (MMR) system includes an MMR user, a MMR computer, a user printer that produces a printed document, a networked media server, an office portal, a service provider server, an electronic display that is electrically connected to a set-top box, a document scanner, a network, a capture device, a cellular infrastructure, wireless fidelity (Wi-Fi) technology, Bluetooth® technology, infrared (IR) technology, wired technology, and a geo location mechanism. The MMR system provides mechanisms for forming a mixed media document that includes media of at least two types, such as printed paper as a first medium and a digital photograph, digital movie, digital audio file, or web link as a second medium. Furthermore, the MMR system facilitates business methods that take advantage of the combination of a portable electronic device, voice mail or email, and a paper document.

Claims

1. A method for updating hotspot information, the method comprising:

capturing, via a capture device, a portion of a printed document that is less than an entire page of the printed document;

displaying, at the capture device, a representation of the printed document received as a result of a match between the captured portion and a stored mixed media reality document data structure, the mixed media reality document data structure comprising the representation, at least one media, and a hotspot that links the at least one media to a location in the representation of the printed document corresponding to a selectable portion of the representation, the selectable portion associated with a predetermined location in the printed document and visually indicated in the representation by a bounding region;

receiving via the capture device user selection of the selectable portion from the representation of the printed document;

receiving an update signal from the user to update the hotspot in the mixed media reality document data structure that is associated with the selected selectable portion from the representation of the printed document;

receiving a voice mail from the user; and

storing the voice mail as new media within the stored mixed media reality document data structure for association with the hotspot.

2. The method of claim 1 further comprising:

prompting the user to identify the voice mail.

3. The method of claim 1 further comprising:

prompting the user to authorize payment for receiving a voice mail; and

wherein receiving the voice mail from the user occurs after payment is authorized.

26. The method of claim 1, wherein the capture device is a device configured to capture an image of the printed document.

27. The method of claim 26, wherein the device comprises one selected from the group consisting of a cellular camera phone, a personal digital assistant, a digital camera, a barcode reader, a radio frequency identification reader, and a webcam.

4. A mixed media information device comprising:

a capture mechanism for capturing a portion of a printed document that is less than an entire page of the printed document;

a display mechanism for displaying a representation of the printed document received as a result of a match between the captured portion and a stored mixed media reality document data structure, the mixed media reality document data structure comprising the representation, at least one media, and a hotspot that links the at least one media to a location in the representation of the printed document corresponding to a selectable portion of the representation, the selectable portion associated with a predetermined location in the printed document and visually indicated in the representation by a bounding region;

a first communication mechanism for receiving user selection of the selectable portion from the representation of the printed document;

a second communication mechanism for receiving an update signal from the user to update the hotspot in the mixed media reality document data structure that is associated with the selected portion from the representation of the printed document; and

a voice mail server for receiving a voice mail from the user in response to receiving the update signal and for storing the voice mail as new media within the stored mixed media realty document data structure for association with the hotspot.

5. The mixed media information device of claim 4 further comprising:

a server for providing a prompt to the user to authorize payment for receiving a voice mail, and commanding the voice mail server to receive the voice mail if payment is authorized.

6. A method of providing hotspot information, the method comprising:

capturing via a capture device a portion of a printed document that is less than an entire page of the printed document;

displaying, at the capture device, a representation of the printed document received as a result of a match between the captured portion and a stored mixed media reality document data structure, the mixed media reality document data structure comprising the representation, at least one voice mail, and a hotspot that links the at least one voice mail to a location in the representation of the printed document corresponding to a selectable portion of the representation, the selectable portion associated with a predetermined location in the printed document and visually indicated in the representation by a bounding region;

receiving via the capture device user selection of the selectable portion from the representation of the printed document;

retrieving the at least one voice mail associated with the selected portion from the representation; and

providing the at least one voice mail to the user.

7. The method of claim 6 further comprising:

providing a menu of voice mails corresponding to the selected portion of the representation;

retrieving the selected voice mail.

8. The method of claim 6 further comprising:

prompting the user to authorize payment for receiving a voice mail; and

providing the voice mail to the user after payment is authorized.

9. A mixed media information device comprising:

a capture mechanism for capturing a portion of a printed document that is less than an entire page of the printed document;

a display mechanism for displaying a representation of the printed document received as a result of a match between the captured portion and a stored mixed media reality document data structure, the mixed media reality document data structure comprising the representation, at least one voice mail, and a hotspot that links the at least one voice mail to a location in the representation of the printed document corresponding to a selectable portion of the representation, the selectable portion associated with a predetermined location in the printed document and visually indicated in the representation by a bounding region;

a communication mechanism for receiving user selection of the selectable portion from the representation of the printed document; and

a voice mail server for retrieving the at least one voice mail associated with the selected portion from the representation and for providing the at least one voice mail associated with the selected portion to the user.

10. The mixed media information device of claim 9 further comprising:

a server for providing a prompt to the user to authorize payment for receiving a voice mail, and commanding the voice mail server to provide the voice mail if payment is authorized.

11. A method of providing hotspot information, the method comprising:

capturing via a capture device a portion of a printed document that is less than an entire page of the printed document;

displaying, at the capture device, a representation of the printed document received as a result of a match between the captured portion and a stored mixed media reality document data structure, the mixed media reality document data structure comprising the representation, at least one media, and a hotspot that links the at least one media to a location in the representation of the printed document corresponding to a selectable portion of the representation, the selectable portion associated with a predetermined location in the printed document and visually indicated in the representation by a bounding region;

receiving via the capture device user selection of the selectable portion from the representation of the printed document;

retrieving the at least one media associated with the selected portion from the representation; and

emailing the at least one media to the user.

12. The method of claim 11 wherein the emailing includes setting a priority code of the email to high priority.

13. The method of claim 11 wherein emailing the at least one media includes emailing the at least one media to an email server that is separate from a capture device that provides the selection by the user.

14. The method of claim 13 further comprising sending a confirmation email to the capture device indicating sending of the email.

15. The method of claim 11 further comprising:

storing said selection by the user in a capture device if the capture device is not in communication with a voice mail server;

sending said selection by the user from the capture device when the capture device is in communication with the voice mail server.

16. The method of claim 11 further comprising:

storing a plurality of media associated with a plurality of selected portions of the representation by the user; and

indexing the plurality of media.

17. The method of claim 16 further comprising:

searching the plurality of indexed media to find media associated with a selected portion that is related to a query.

18. The method of claim 11 further comprising:

providing a user interface for user purchasing of media associated with a selectable portion of the representation;

asynchronously providing purchased media in response to a selection of the media by the user.

19. The method of claim 18 wherein the asynchronously providing is via a communication channel different than a communication channel of a capture device.

20. The method of claim 11 further comprising:

retrieving the at least one media associated with the selected portion from a document database for asynchronous emailing.

21. The method of claim 11 further comprising:

storing emails including media associated with the selected portion in a user database.

22. A mixed media information device comprising:

a capture mechanism for capturing a portion of a printed document that is less than an entire page of the printed document;

a display mechanism for displaying a representation of the printed document received as a result of a match between the captured portion and a stored mixed media reality document data structure, the mixed media reality document data structure comprising the representation, at least one media, and a hotspot that links the at least one media to a location in the representation of the printed document corresponding to a selectable portion of the representation, the selectable portion associated with a predetermined location in the printed document and visually indicated in the representation by a bounding region;

communication mechanism for receiving user selection of the selectable portion from the representation of the printed document; and

a media retrieval mechanism for retrieving the at least one media associated with the selected portion;

an email server for providing an email with the retrieved at least one media to the user.

23. The mixed media information device of claim 22 wherein the email server sends a confirmation email to the capture device indicating providing of the email.

24. The mixed media information device of claim 22 further comprising:

a database storing hotspot information for a plurality of selections of selectable portions of the representation by the user, said database including an index for searching said hotspot information.

25. The mixed media information device of claim 22 further comprising:

a database storing user emails related to a plurality of selections of selectable portions of the representation by the user, said database including an index for searching said selected portion information.