System and methods for creation and use of a mixed media environment with geographic location information
First Claim
1. A computer-implemented method for providing a mixed media environment for interacting with documents of a first media type and a second media type, the method comprising:
- acquiring a representation of a portion of a printed document comprising geographical location information by receiving a captured image of the portion of the printed document via a capture device;
indexing the acquired representation of the portion of the printed document for identification of a corresponding mixed media reality document,wherein the corresponding mixed media reality document comprising a matching electronic representation of the printed document,wherein indexing the acquired representation includes specifying an x-y location of at least one of a character, a word and an image from the acquired representation within the printed document;
parsing the representation of the portion of the printed document to identify a first geographic location from the geographical location information;
identifying a second geographic location of the capture device; and
performing an action specified by the mixed media reality document based on the first and second geographic locations,wherein specifying the x-y location of the acquired representation includes one selected from the group of;
specifying x-y locations of characters of a printed document, specifying x-y locations of words of the printed document, specifying x-y locations of an image or a portion of an image in a printed document, performing an OCR operation and specifying x-y locations of characters or words, and performing feature extraction and specifying x-y locations of characters or words.
1 Assignment
0 Petitions
Accused Products
Abstract
A Mixed Media Reality (MMR) system and associated techniques are disclosed. The MMR system provides mechanisms for forming a mixed media document that includes media of at least two types (e.g., printed paper as a first medium and digital content and/or web link as a second medium). In one particular embodiment, the MMR system provides a user with information related to the location of the user. The system acquires a document, extracts location related information from the document, identifies the location of the users, and provides information to the user based on the identified location and the extracted information.
-
Citations
17 Claims
-
1. A computer-implemented method for providing a mixed media environment for interacting with documents of a first media type and a second media type, the method comprising:
-
acquiring a representation of a portion of a printed document comprising geographical location information by receiving a captured image of the portion of the printed document via a capture device; indexing the acquired representation of the portion of the printed document for identification of a corresponding mixed media reality document, wherein the corresponding mixed media reality document comprising a matching electronic representation of the printed document, wherein indexing the acquired representation includes specifying an x-y location of at least one of a character, a word and an image from the acquired representation within the printed document; parsing the representation of the portion of the printed document to identify a first geographic location from the geographical location information; identifying a second geographic location of the capture device; and performing an action specified by the mixed media reality document based on the first and second geographic locations, wherein specifying the x-y location of the acquired representation includes one selected from the group of;
specifying x-y locations of characters of a printed document, specifying x-y locations of words of the printed document, specifying x-y locations of an image or a portion of an image in a printed document, performing an OCR operation and specifying x-y locations of characters or words, and performing feature extraction and specifying x-y locations of characters or words. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A computer-readable storage medium comprising computer-executable code stored on the medium for causing a processor to perform the following steps:
-
acquiring a representation of a portion of a printed document comprising geographical location information by receiving a captured image of the portion of the printed document via a capture device; indexing the acquired representation of the portion of the printed document for identification of a corresponding mixed media reality document, wherein the corresponding mixed media reality document comprising a matching electronic representation of the printed document, wherein indexing the acquired representation includes specifying an x-y location of at least one of a character, a word and an image from the acquired representation within the printed document; parsing the representation of the portion of the printed document to identify a first geographic location from the geographical location information; identifying a second geographic location of the capture device; and performing an action specified by the mixed media reality document based on the first and second geographic locations, wherein specifying the x-y location of the acquired representation includes one selected from the group of;
specifying x-y locations of characters of a printed document, specifying x-y locations of words of the printed document, specifying x-y locations of an image or a portion of an image in a printed document, performing an OCR operation and specifying x-y locations of characters or words, and performing feature extraction and specifying x-y locations of characters or words. - View Dependent Claims (13, 14, 15, 16)
-
-
17. A method for providing a mixed media environment for interacting with documents of a first media type and a second media type, the method comprising:
-
acquiring a representation of a portion of a pending printed document comprising geographical location information, wherein acquiring the representation comprises either automatically capturing a text layout of the pending printed document at the time of printing or receiving a file comprising the representation of the portion of the pending printed document; indexing the acquired representation of the portion of the pending printed document for identification of a corresponding mixed media reality document, the corresponding mixed media reality document comprising a matching electronic representation of the pending printed document, wherein indexing the acquired representation includes specifying an x-y location of at least one of a character, a word and an image from the acquired representation within the pending printed document; parsing the representation of the portion of the pending printed document to identify a first geographic location from the geographical location information; identifying a second geographic location of a capture device; and performing an action specified by the mixed media reality document based on the first and second geographic locations, wherein specifying the x-y location of the acquired representation includes one selected from the group of;
specifying x-y locations of characters of a printed document, specifying x-y locations of words of the printed document, specifying x-y locations of an image or a portion of an image in a printed document, performing an OCR operation and specifying x-y locations of characters or words, and performing feature extraction and specifying x-y locations of characters or words.
-
Specification