Mobile query system and method based on visual cues

• US 20050261990A1
• Filed: 04/14/2005
• Published: 11/24/2005
• Est. Priority Date: 04/16/2004
• Status: Active Grant

• Current Assignee: Mobot Incorporated (FMS Group, Inc.)
• Original Assignee: Mobot Incorporated (FMS Group, Inc.)
• Inventors: Puopolo, John, Gocht, Russell
• Granted Patent: US 7,707,218 B2
• Time in Patent Office: Days
• US Class Current: 705/27
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising

Abstract

A mobile query and response system and method that is based on visual cues, in which a user captures and transmits an image with a networked mobile device such as a cell phone or PDA with image capture and transmission capabilities. Searchable records that include stored image data and response information associated with such data are provided. The image transmitted by the user is used to perform a search of the records, to find in the records an image that matches the transmitted image. If a match is found, the response information associated with the stored image data for the matching image is retrieved, and that response information is used to send a reply to the user.

Claims

1. A method of accomplishing a mobile query and response system based on visual cues, in which a user captures and transmits an image with a networked mobile device with image capture and transmission capabilities, comprising:

providing searchable records comprising stored image data and response information associated with such data;

receiving the captured image from the mobile device;

using the received image to perform an at least partially automated search of the records, to find in the records one or more images that match the transmitted image;

if a match is found, retrieving the response information associated with the stored image data for the matching image; and

using the response information to send a reply to the user.

2. The method of claim 1, wherein the reply is sent to the mobile device.

3. The method of claim 1, wherein the device is a mobile telephone or personal digital assistant (PDA).

4. The method of claim 1, further comprising determining if the user who sent the received image has previously registered as a user.

5. The method of claim 4, wherein determining if the user who sent the received image has previously registered as a user is based on an identification of the networked mobile device from which the image is received.

6. The method of claim 4, wherein the reply to the user depends at least in part on whether the user has previously registered.

7. The method of claim 4, further comprising determining preexisting preferences for such authorized user.

8. The method of claim 6, wherein the response information comprises a set of predetermined query responses.

9. The method of claim 1, wherein the response information comprises product source information.

10. The method of claim 9, wherein the product source information comprises an internet address or a street address.

11. The method of claim 1, wherein the response information comprises providing a direct link to a web page.

12. The method of claim 1, wherein the response information comprises product information.

13. The method of claim 1, wherein the response information comprises content provider information

14. The method of claim 1, wherein the response information comprises content provider information.

15. The method of claim 1, wherein the response information comprises image information.

16. The method of claim 15, wherein the image information comprises video images.

17. The method of claim 15, wherein the image information comprises still images.

18. The method of claim 1, wherein the response information comprises audio information.

19. The method of claim 1, wherein the reply comprises an email or postal mail message.

20. The method of claim 1, wherein the reply comprises a telephone contact.

21. The method of claim 1, wherein the reply comprises multiple contacts with the user.

22. The method of claim 1, wherein the reply comprises confirmation of an action taken in response to the match.

23. The method of claim 21, wherein the action taken comprises a contest entry.

24. The method of claim 1, wherein the reply comprises altering game play.

25. The method of claim 1, further comprising logging information regarding the queries in a database.

26. The method of claim 25, wherein the logged information comprises one or more of the originating mobile phone number, the date and time of the query, the date and time of the image capture, the location from which the query was sent, the user profile, and the types of replies made.

27. The method of claim 25, further comprising generating a report from the database.

28. The method of claim 27, wherein the report comprises demographic data.

29. The method of claim 27, wherein the report comprises information regarding a particular image.

30. The method of claim 1, further comprising identifying the media outlet that was the source of the captured image.

31. The method of claim 30, wherein identifying the media outlet that was the source of the captured image comprises using a publication cover as an identifying image.

32. The method of claim 31, wherein the user first makes a query based on the publication cover, and only then may make a query based on an image in the publication.

33. The method of claim 32, wherein the identification of the publication and the query based on an image in the publication are both stored in a query database.

34. The method of claim 30, wherein identifying the media outlet that was the source of the captured image comprises tracking and analyzing at least recent past queries from the user.

35. The method of claim 34, wherein identifying the media outlet that was the source of the captured image further comprises determining if recent past inquiries closely clustered in time are from a single media source.

36. The method of claim 34, wherein identifying the media outlet that was the source of the captured image further comprises determining the location of recent queries.

37. The method of claim 30, wherein identifying the media outlet that was the source of the captured image comprises the user selecting a source from a series of choices communicated to the mobile device.

38. The method of claim 30, wherein identifying the media outlet that was the source of the captured image comprises determining the date, time and location of the query.

39. The method of claim 1, wherein the records further comprise at least one media source.

40. The method of claim 39, wherein the records further comprise an identification of the advertiser.

41. The method of claim 1, further comprising allowing the user to select reply preferences.

42. The method of claim 1, wherein the captured image comprises a unique service identifier.

43. The method of claim 42, wherein the unique service identifier comprises visual information located in close proximity to an advertisement.

44. The method of claim 1, wherein the device comprises a digital camera and a device for transmitting the camera image over the internet.

45. The method of claim 1, further comprising maintaining the searchable records database.

46. The method of claim 45, wherein affiliates are provided limited access to the searchable records database to maintain records associated therewith.

47. A mobile query and response system based on visual cues, in which a user captures an image with a networked mobile device with image capture and transmission capabilities, and transmits the image to the system, the system comprising:

one or more searchable databases comprising stored image data and response information associated with such data, in which such databases include matching image identification information;

image lookup means for using the received image to perform a search of the records, to find in the records an image that matches the transmitted image;

response handler means, responsive to the image lookup means, for retrieving the response information associated with the stored image data for a matching image, and using the response information to send a reply to the user.