System and methods for creation and use of a mixed media environment
First Claim
Patent Images
1. A system comprising:
- one or more media processors configured to;
receive an image patch of at least a first portion of a first media;
convert the image patch into an object pair to capture a two-dimensional geometric relationship between objects in the image patch, the two-dimensional geometric relationship specifying one or more of a direction, an angle, and a distance between the objects; and
compare the object pair to previously generated object pairs in a media data structure to associate the first media with the media data structure, the media data structure comprising;
a representation of the first media comprising a matchable object pair corresponding to a first location within the first media, the matchable object pair for matching to the object pair;
a second media; and
an index correlating the matchable object pair of the representation with the second media, the index recording a document, a page, and a second location within the page at which the object pair appears; and
a media storage communicatively coupled to the one or more media processors that stores the media data structure.
1 Assignment
0 Petitions
Accused Products
Abstract
A Mixed Media Reality (MMR) system and associated techniques are disclosed. The MMR system provides mechanisms for forming a media document that includes media of at least two types (e.g., printed paper as a first medium and digital content and/or web link as a second medium). The MMR system provides mechanisms for forming a media document that includes media of at least two types, such as printed paper as a first medium and a digital photograph, digital movie, digital audio file, or web link as a second medium. Furthermore, the MMR system facilitates business methods that take advantage of the combination of a portable electronic device, such as a cellular camera phone, and a paper document.
-
Citations
19 Claims
-
1. A system comprising:
-
one or more media processors configured to; receive an image patch of at least a first portion of a first media; convert the image patch into an object pair to capture a two-dimensional geometric relationship between objects in the image patch, the two-dimensional geometric relationship specifying one or more of a direction, an angle, and a distance between the objects; and compare the object pair to previously generated object pairs in a media data structure to associate the first media with the media data structure, the media data structure comprising; a representation of the first media comprising a matchable object pair corresponding to a first location within the first media, the matchable object pair for matching to the object pair; a second media; and an index correlating the matchable object pair of the representation with the second media, the index recording a document, a page, and a second location within the page at which the object pair appears; and a media storage communicatively coupled to the one or more media processors that stores the media data structure. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A computer-implemented method for creating a media data structure, the method comprising:
-
receiving a first media; receiving an image patch of at least a first portion of the first media; converting the image patch into an object pair to capture a two-dimensional geometric relationship between objects in the image patch, the two-dimensional geometric relationship specifying one or more of a direction, an angle, and a distance between the objects; comparing the object pair to previously generated object pairs in the media data structure to determine a match; and responsive to the comparing resulting no matches, creating the media data structure, comprising; a representation of the first media comprising a matchable object pair corresponding to a first location within the first media, the matchable object pair for matching to the object pair; a second media; and an index correlating the matchable object pair of the representation with the second media, the index recording a document, a page, and a second location within the page at which the object pair appears. - View Dependent Claims (9, 10, 11, 12, 13, 14, 15, 16)
-
-
17. A computer program product comprising a machine-readable medium including a non-transitory computer readable program, wherein the computer readable program when executed on a computer causes the computer to:
-
receive a first media; receive an image patch of at least a first portion of the first media; convert the image patch into an object pair to capture a two-dimensional geometric relationship between objects in the image patch, the two-dimensional geometric relationship specifying one or more of a direction, an angle, and a distance between the objects; compare the object pair to previously generated object pairs in a media data structure; and responsive to the comparing resulting no matches, create a media data structure, comprising; a representation of the first media comprising a matchable object pair corresponding to a first location within the first media, the matchable object pair for matching to the object pair; a second media; and an index correlating the matchable object pair of the representation with the second media, the index recording a document, a page, and a second location within the page at which the object pair appears. - View Dependent Claims (18, 19)
-
Specification