Dynamic presentation of targeted information in a mixed media reality recognition system
First Claim
1. A computer-implemented method comprising:
- receiving an input image from a camera of a mobile device;
performing, with one or more processors, a visual search within a database of mixed media objects using the input image to identify and retrieve a mixed media object corresponding to the input image;
producing recognized text for a portion of the retrieved mixed media object corresponding to the input image and a document context including text surrounding the input image, each word of the recognized text having a word relevancy weight;
creating a user context based on user interaction data over time to identify user trends;
receiving targeted information;
generating, with the one or more processors, relevant targeted information based on the word relevancy weight of each word of the recognized text, the document context including the text surrounding the input image, the user context, and the targeted information; and
providing the relevant targeted information to the user, wherein the relevant targeted information includes an element that allows the user to perform an action.
1 Assignment
0 Petitions
Accused Products
Abstract
A context-aware targeted information delivery system comprises a mobile device, an MMR matching unit, a plurality of databases for user profiles, user context and advertising information, a plurality of comparison engines and a plurality of weight adjusters. The mobile device is coupled to deliver an image patch to the MMR matching unit which in turn performs recognition to produce recognize text. The recognized text is provided to a first and second comparison engines to produce relevant topics and relevant ads. The relevant topics and relevant ads are adjusted with information from a user context database including information such as location, date, time, and other information from a user profile. The third comparison engine compares the relevant topics and relevant ads to produce a set of final ads that are most related to the topics of interest for the user and delivered for display on to the mobile device.
111 Citations
20 Claims
-
1. A computer-implemented method comprising:
-
receiving an input image from a camera of a mobile device; performing, with one or more processors, a visual search within a database of mixed media objects using the input image to identify and retrieve a mixed media object corresponding to the input image; producing recognized text for a portion of the retrieved mixed media object corresponding to the input image and a document context including text surrounding the input image, each word of the recognized text having a word relevancy weight; creating a user context based on user interaction data over time to identify user trends; receiving targeted information; generating, with the one or more processors, relevant targeted information based on the word relevancy weight of each word of the recognized text, the document context including the text surrounding the input image, the user context, and the targeted information; and providing the relevant targeted information to the user, wherein the relevant targeted information includes an element that allows the user to perform an action. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A system comprising:
-
one or more processors; and a memory storing instructions, which when executed, cause the one or more processors to; receive an input image from a camera of a mobile device; perform a visual search within a database of mixed media objects using the input image to identify and retrieve a mixed media object corresponding to the input image; produce recognized text for a portion of the retrieved mixed media object corresponding to the input image and a document context including text surrounding the input image, each word of the recognized text having a word relevancy weight; create a user context based on user interaction data over time to identify user trends; receive targeted information; generate relevant targeted information based on the word relevancy weight of each word of the recognized text, the document context including the text surrounding the input image, the user context, and the targeted information; and provide the relevant targeted information to the user, wherein the relevant targeted information includes an element that allows the user to perform an action. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. A computer program product comprising a non-transitory computer useable medium including a computer readable program, wherein the computer readable program when executed on a computer causes the computer to:
-
receive an input image from a camera of a mobile device; perform a visual search within a database of mixed media objects using the input image to identify and retrieve a mixed media object corresponding to the input image; produce recognized text for a portion of the retrieved mixed media object corresponding to the input image and a document context including text surrounding the input image, each word of the recognized text having a word relevancy weight; create a user context based on user interaction data over time to identify user trends; receive targeted information; generate relevant targeted information based on the word relevancy weight of each word of the recognized text, the document context including the text surrounding the input image, the user context, and the targeted information; and provide the relevant targeted information to the user, wherein the relevant targeted information includes an element that allows the user to perform an action. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification