System and methods for creation and use of a mixed media environment with geographic location information
First Claim
1. A computer-implemented method for providing a mixed media environment for interacting with documents of a first media type and a second media type, the method comprising:
- acquiring a representation of a portion of a printed document comprising geographical location information by receiving a captured image of the portion of the printed document via a capture device;
indexing the acquired representation of the portion of the printed document for identification of a corresponding mixed media reality document,wherein the corresponding mixed media reality document comprising a matching electronic representation of the printed document,wherein indexing the acquired representation includes specifying an x-y location of at least one of a character, a word and an image from the acquired representation within the printed document;
parsing the representation of the portion of the printed document to identify a first geographic location from the geographical location information;
identifying a second geographic location of the capture device; and
performing an action specified by the mixed media reality document based on the first and second geographic locations,wherein specifying the x-y location of the acquired representation includes one selected from the group of;
specifying x-y locations of characters of a printed document, specifying x-y locations of words of the printed document, specifying x-y locations of an image or a portion of an image in a printed document, performing an OCR operation and specifying x-y locations of characters or words, and performing feature extraction and specifying x-y locations of characters or words.
1 Assignment
0 Petitions
Accused Products
Abstract
A Mixed Media Reality (MMR) system and associated techniques are disclosed. The MMR system provides mechanisms for forming a mixed media document that includes media of at least two types (e.g., printed paper as a first medium and digital content and/or web link as a second medium). In one particular embodiment, the MMR system provides a user with information related to the location of the user. The system acquires a document, extracts location related information from the document, identifies the location of the users, and provides information to the user based on the identified location and the extracted information.
256 Citations
17 Claims
-
1. A computer-implemented method for providing a mixed media environment for interacting with documents of a first media type and a second media type, the method comprising:
-
acquiring a representation of a portion of a printed document comprising geographical location information by receiving a captured image of the portion of the printed document via a capture device; indexing the acquired representation of the portion of the printed document for identification of a corresponding mixed media reality document, wherein the corresponding mixed media reality document comprising a matching electronic representation of the printed document, wherein indexing the acquired representation includes specifying an x-y location of at least one of a character, a word and an image from the acquired representation within the printed document; parsing the representation of the portion of the printed document to identify a first geographic location from the geographical location information; identifying a second geographic location of the capture device; and performing an action specified by the mixed media reality document based on the first and second geographic locations, wherein specifying the x-y location of the acquired representation includes one selected from the group of;
specifying x-y locations of characters of a printed document, specifying x-y locations of words of the printed document, specifying x-y locations of an image or a portion of an image in a printed document, performing an OCR operation and specifying x-y locations of characters or words, and performing feature extraction and specifying x-y locations of characters or words. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A computer-readable storage medium comprising computer-executable code stored on the medium for causing a processor to perform the following steps:
-
acquiring a representation of a portion of a printed document comprising geographical location information by receiving a captured image of the portion of the printed document via a capture device; indexing the acquired representation of the portion of the printed document for identification of a corresponding mixed media reality document, wherein the corresponding mixed media reality document comprising a matching electronic representation of the printed document, wherein indexing the acquired representation includes specifying an x-y location of at least one of a character, a word and an image from the acquired representation within the printed document; parsing the representation of the portion of the printed document to identify a first geographic location from the geographical location information; identifying a second geographic location of the capture device; and performing an action specified by the mixed media reality document based on the first and second geographic locations, wherein specifying the x-y location of the acquired representation includes one selected from the group of;
specifying x-y locations of characters of a printed document, specifying x-y locations of words of the printed document, specifying x-y locations of an image or a portion of an image in a printed document, performing an OCR operation and specifying x-y locations of characters or words, and performing feature extraction and specifying x-y locations of characters or words. - View Dependent Claims (13, 14, 15, 16)
-
-
17. A method for providing a mixed media environment for interacting with documents of a first media type and a second media type, the method comprising:
-
acquiring a representation of a portion of a pending printed document comprising geographical location information, wherein acquiring the representation comprises either automatically capturing a text layout of the pending printed document at the time of printing or receiving a file comprising the representation of the portion of the pending printed document; indexing the acquired representation of the portion of the pending printed document for identification of a corresponding mixed media reality document, the corresponding mixed media reality document comprising a matching electronic representation of the pending printed document, wherein indexing the acquired representation includes specifying an x-y location of at least one of a character, a word and an image from the acquired representation within the pending printed document; parsing the representation of the portion of the pending printed document to identify a first geographic location from the geographical location information; identifying a second geographic location of a capture device; and performing an action specified by the mixed media reality document based on the first and second geographic locations, wherein specifying the x-y location of the acquired representation includes one selected from the group of;
specifying x-y locations of characters of a printed document, specifying x-y locations of words of the printed document, specifying x-y locations of an image or a portion of an image in a printed document, performing an OCR operation and specifying x-y locations of characters or words, and performing feature extraction and specifying x-y locations of characters or words.
-
Specification