Mobile query system and method based on visual cues

• US 7,707,218 B2
• Filed: 04/14/2005
• Issued: 04/27/2010
• Est. Priority Date: 04/16/2004
• Status: Expired due to Fees

• Current Assignee: Mobot Incorporated (FMS Group, Inc.)
• Original Assignee: Mobot Incorporated (FMS Group, Inc.)
• Inventors: Gocht, Russell, Puopolo, John
• Primary Examiner(s): Le, Miranda
• Application Number:
  US11/106,306
• Publication Number:
  US 20050261990A1
• Time in Patent Office: 1,839 Days
• Field of Search: 707/1, 707/3, 707/10, 707/104.1, 707/201, 707/758, 707/781, 707/784, 455/412.1, 455/422.1, 455/445, 455/466, 715/234, 705/67
• US Class Current: 707/758
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising

Abstract

A mobile query and response system and method that is based on visual cues, in which a user captures and transmits an image with a networked mobile device such as a cell phone or PDA with image capture and transmission capabilities. Searchable records that include stored image data and response information associated with such data are provided. The image transmitted by the user is used to perform a search of the records, to find in the records an image that matches the transmitted image. If a match is found, the response information associated with the stored image data for the matching image is retrieved, and that response information is used to send a reply to the user.

Claims

1. A method of accomplishing a mobile query and response system based on visual cues, in which a mobile user captures and transmits an image of a visual cue with a networked mobile device with image capture and transmission capabilities over a wireless network data service, comprising:

receiving a query from the mobile user over the wireless network data service, where the query comprises the image captured and transmitted by the mobile user with the networked mobile device;

providing a mobile user registration database comprising searchable records having information associated with one or more registered mobile users;

searching the mobile user registration database to determine if the mobile user is a registered mobile user;

sending a reply to the mobile user over the wireless network data service if the mobile user is not a registered mobile user, where the reply comprises text informing the mobile user how to register to use the mobile query and response system;

providing a mobile user preference database comprising searchable records having operational preference information associated with one or more registered mobile users;

receiving operational preference information from the mobile user and storing the operational preference information in the mobile user preference database;

searching the mobile user preference database to determine if the registered mobile user has an operational preference;

providing an image database comprising searchable records having stored images and response information associated with the stored images;

searching the image database for the image captured and transmitted by the mobile user and retrieving the response information associated with such image; and

sending a reply to the mobile user over the wireless network data service, where the reply comprises the retrieved response information, if the image captured and transmitted by the mobile user is found in the image database.

2. The method of claim 1, where the reply to the mobile user comprises text informing the mobile user how to use the mobile query and response system, if the image captured and transmitted by the mobile user is not found in the image database.

3. The method of claim 1, where the step of searching the mobile user registration database to determine if the mobile user is a registered mobile user is based at least in part on an identification of the networked mobile device from which the image is received.

4. The method of claim 1, further comprising the step of receiving interactive input from the mobile user after sending the reply comprising the retrieved response information to the mobile user.

5. The method of claim 1, further comprising the step of logging information associated with at least one of the query from the mobile user or the reply to the mobile user.

6. The method of claim 5, further comprising the step of generating a report from the logged information.

7. The method of claim 1, further comprising the step of maintaining the records in the image database.

8. The method of claim 7, further comprising the step of modifying a record in the image database.

9. The method of claim 1, further comprising the step of identifying the media outlet that was the source of the captured image.

10. The method of claim 9, where identifying the media outlet that was the source of the captured image comprises using a publication cover as an identifying image.

11. The method of claim 9, where identifying the media outlet that was the source of the captured image comprises tracking and analyzing at least recent past queries from the mobile user.

12. The method of claim 9, where identifying the media outlet that was the source of the captured image comprises the mobile user selecting a source from a series of choices communicated to the mobile device.

13. The method of claim 9, where identifying the media outlet that was the source of the captured image comprises determining the date, time, and location of the query.

14. The method of claim 9, where the networked mobile device is a mobile telephone or personal digital assistant (PDA).

15. The method of claim 1, where the networked mobile device comprises a digital camera.

16. The method of claim 1, where the retrieved response information comprises product source information.

17. The method of claim 1, where the retrieved response information comprises providing a direct link to a web page.

18. The method of claim 1, where the retrieved response information comprises product information.

19. The method of claim 1, where the retrieved response information comprises content provider information.

20. The method of claim 1, where the retrieved response information comprises video images.

21. The method of claim 1, where the retrieved response information comprises still images.

22. The method of claim 1, where the retrieved response information comprises audio information.

23. The method of claim 1, where the reply comprises an email or postal mail message.

24. The method of claim 1, where the reply comprises a telephone contact.

25. A method of accomplishing a mobile query and response system based on visual cues, in which a mobile user captures and transmits an image of a visual cue with a networked mobile device with image capture and transmission capabilities over a wireless network data service, comprising:

receiving a query from the mobile user over the wireless network data service, where the query comprises the image captured and transmitted by the mobile user with the networked mobile device;

providing a mobile user registration database comprising searchable records having information associated with one or more registered mobile users;

searching the mobile user registration database to determine if the mobile user is a registered mobile user, based at least in part on an identification of the networked mobile device from which the image is received;

sending a reply to the mobile user over the wireless network data service if the mobile user is not a registered mobile user, where the reply comprises text informing the mobile user how to register to use the mobile query and response system;

providing a mobile user preference database comprising searchable records having operational information associated with one or more registered mobile users;

receiving operational preference information from the mobile user and storing the operational preference information in the mobile user preference database;

searching the mobile user preference database to determine if the registered mobile user has an operational preference;

providing an image database comprising searchable records having stored images and response information associated with the stored images;

searching the image database for the image captured and transmitted by the mobile user and retrieving the response information associated with such image; and

sending a reply to the mobile user over the wireless network data service, where the reply comprises the retrieved response information, if the image captured and transmitted by the mobile user is found in the image database and where the reply to the mobile user comprises text informing the mobile user how to use the mobile query and response system, if the image captured and transmitted by the mobile user is not found in the image database.

26. The method of claim 25, further comprising the step of receiving interactive input from the user after sending the response comprising the retrieved response information to the mobile user.

27. The method of claim 25, further comprising the steps of:

logging information associated with at least one of the query from the mobile user or the response to the mobile user; and

generating a report from the logged information.

28. The method of claim 25, further comprising the step of maintaining the records in the image database.

29. The method of claim 25, further comprising the step of determining the media outlet that was the source of the captured image.

30. The method of claim 29, where identifying the media outlet that was the source of the captured image comprises using a publication cover as an identifying image.

31. The method of claim 29, where identifying the media outlet that was the source of the captured image comprises tracking and analyzing at least recent past queries from the mobile user.

32. The method of claim 29, where identifying the media outlet that was the source of the captured image comprises the mobile user selecting a source from a series of choices communicated to the mobile device.

33. The method of claim 29, where identifying the media outlet that was the source of the captured image comprises determining the date, time, and location of the query.