Method, Apparatus and Computer Program Product for Performing a Visual Search Using Grid-Based Feature Organization

• US 20090083275A1
• Filed: 09/24/2007
• Published: 03/26/2009
• Est. Priority Date: 09/24/2007
• Status: Abandoned Application

• Current Assignee: Nokia Corporation
• Original Assignee: Nokia Corporation
• Inventors: Chen, Wei-Chao, Gelfand, Natasha, Wang, Xianglin, Jacob, Matthias, Grzeszczuk, Radek, Gao, Jiang, Schloter, Philipp, Pulli, Kari, Xiong, Yingen
• Application Number:
  US11/860,136
• Publication Number:
  US 20090083275A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/29 Geographical information databases
• CPC Class Codes: G06F 16/583 using metadata automatically derived from the content

Abstract

A method, apparatus and computer program product are provided for visually searching feature sets that are organized in a grid-like manner. As such, a feature set associated with a location-based grid area may be received. The location-based grid area may also be associated with the location of a device. After receiving query image features, a visual search may be performed by comparing the query image features with the feature set. The search results are then returned. By conducting the visual search within a feature set that is selected based upon the location of the device, the efficiency of the search can be enhanced and the search may potentially be performed by the device, such as a mobile device, itself.

Claims

1. A method comprising:

receiving a feature set associated with a location-based grid area wherein the location-based grid area is further associated with a location of a device;

receiving query image features;

performing a visual search by comparing the query image features with the feature set; and

returning search results.

2. The method of claim 1, further comprising identifying the feature set using context, scenario and preference conditions.

3. The method of claim 1, wherein the feature set comprises location-based groupings of meta-features.

4. The method of claim 1, wherein the visual search is performed using a nearest neighbor search structure, wherein the nearest neighbor search structure comprises comparators and feature pointers.

5. The method of claim 1, further comprising excluding features with less than a specified number of neighbors from the feature set.

6. The method of claim 1, wherein receiving the feature set comprises updating the feature set by receiving features that are dissimilar from those in a current feature set when the device moves into a different location-based grid area.

7. The method of claim 1, further comprising transmitting the query image features and location information to a server to perform a visual search against additional features associated with the location-based grid area.

8. The method of claim 1, further comprising eliminating features from a memory component based upon a feature'"'"'s distance from the device.

9. An apparatus comprising a processor configured to:

receive a feature set associated with a location-based grid area wherein the location-based grid area is further associated with a location of a device;

receive query image features;

perform a visual search by comparing the query image features with the feature set; and

return search results.

10. The apparatus of claim 9, wherein the processor is further configured to use context, scenario and preference conditions to identify a feature set.

11. The apparatus of claim 9, wherein the processor is further configured to construct a nearest neighbor search structure using the feature set, wherein the nearest neighbor search structure comprises comparators and feature pointers.

12. The apparatus of claim 9, wherein the processor is further configured to exclude features with a robustness value less than a specified limit from the feature set.

13. The apparatus of claim 9, wherein the processor is further configured to receive feature set updates by receiving features that are dissimilar from those in the current feature set when the device moves into a different location-based grid area.

14. The apparatus of claim 9, wherein the processor is further configured to transmit the query image features and location information to a server to perform a visual search against additional features associated with the location-based grid area.

15. The apparatus of claim 9, further comprising a memory component for storing the feature set, and wherein the processor is further configured to eliminate features from the memory component based upon a feature'"'"'s distance from the device.

16. A computer program product comprising at least one computer-readable storage medium having computer-readable program code portions stored therein, the computer-readable program code portions comprising:

a first executable portion for receiving a feature set associated with a location-based grid area wherein the location-based rigid area is further associated with a location of a device;

a second executable portion for receiving query image features;

a third executable portion for performing a visual search by comparing the query image features with the feature set; and

a fourth executable portion for returning search results.

17. The computer program product of claim 16, wherein the first executable portion is further configured to identify a feature set using context, scenario and preference conditions.

18. The computer program product of claim 16, wherein the feature set comprises location-based groupings of meta-features.

19. The computer program product of claim 16, wherein the third executable portion is configured to perform a visual search using a nearest neighbor search structure, wherein the nearest neighbor search structure comprises comparators and feature pointers.

20. The computer program product of claim 16, wherein the third executable portion is further configured to exclude features with a robustness value less than a specified limit from the feature set.

21. The computer program product of claim 16, further comprising a fifth executable portion for updating the feature set by receiving features that are dissimilar from those in the current feature set when the device moves into a different location-based grid area.

22. The computer program product of claim 16, further comprising a fifth executable portion for transmitting the query image features and location information to a server to perform a visual search against additional features associated with the location-based grid area.

23. An apparatus comprising:

means for receiving a feature set associated with a location-based grid area wherein the location-based grid area is further associated with a location of a device,

means for receiving query image features;

means for performing a visual search by comparing the query image features with the feature set; and

means for returning search results.

24. The apparatus of claim 23, further comprising means for performing a visual search using a nearest neighbor search structure, wherein the nearest neighbor search structure comprises comparators and feature pointers.

25. A method for constructing a visual search database, the method comprising:

defining a location-based grid,

acquiring training images and related information,

associating the training images and related information to a portion of the location-based grid,

performing feature extraction,

assigning feature robustness values, and

generating and storing meta-features.