Method, Device, Mobile Terminal, and Computer Program Product for a Point of Interest Based Scheme for Improving Mobile Visual Searching Functionalities

• US 20080268876A1
• Filed: 04/23/2008
• Published: 10/30/2008
• Est. Priority Date: 04/24/2007
• Status: Abandoned Application

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Technologies Oy (Nokia Corporation)
• Inventors: Vatanparast, Ramin, Vedantham, Ramakrishna, Chen, Wei-Chao, Gelfand, Natasha, Grzeszczuk, Radek, Gao, Jiang, Chitturi, Suresh, Murphy, David, Pulli, Kari, Kahari, Markus, Xiong, Yingen, Schloter, C. Philipp
• Application Number:
  US12/108,281
• Publication Number:
  US 20080268876A1
• Time in Patent Office: Days
• US Class Current: 455/457
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/583 using metadata automatically derived from the content
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal
• CPC Class Codes: H04W 4/02 Services making use of location information
• CPC Class Codes: H04W 4/024 Guidance services
• CPC Class Codes: H04W 4/029 Location-based management or tracking services

Abstract

Systems, methods, devices and computer program products which relate to utilizing a camera of a mobile terminal as a user interface for search applications and online services to perform visual searching are provided. The system consists of an apparatus that includes a processor that is configured to capture an image of one or more objects and analyze data of the image to identify an object(s) of the image. The processor is further configured to receive information that is associated with at least one object of the images and display the information that is associated with the image. In this regard, the apparatus is able to simplify access to location based services and improve a user'"'"'s experience. The processor of the apparatus is configured to combine results of robust visual searches with online information resources to enhance location based services.

Claims

1. A method, comprising:

capturing an image of one or more objects;

analyzing data associated with the image to identify at least one object of the objects of the image;

receiving information that is associated with the at least one object; and

displaying the information that is associated with the at least one object.

2. The method of claim 1, wherein receiving information comprises a map of the area in which the at least one object is located, the map comprises one or more visual tags containing content that is linked to or associated with the object.

3. The method of claim 2 wherein at least one visual tag of the visual tags corresponds to a geographic location of the object and the other visual tags are located in an area within a predefined distance of the at least one visual tag.

4. The method of claim 2, wherein at least a portion of the content of the visual tags comprises data associated with an image of an object with which the visual tag is associated.

5. The method of claim 2, further comprising selecting a visual tag among the visual tags and switching a view of the display and displaying the image of the selected visual tag while excluding from display each of the other visual tags.

6. The method of claim 2, wherein each of the images of the visual tags relates to an object that is in the same category as the objects of the captured image.

7. The method of claim 1, further comprising automatically receiving one or more visual tags comprising data associated with an image of an object with which a respective visual tag is associated based on a proximity to at least one object that was captured in the image.

8. The method of claim 1, wherein prior to displaying the information the method further comprises:

defining metadata associated with at least one object of the image; and

linking the object and the metadata to generate one or more visual tags;

9. A method, comprising:

defining and associating meta-information with one or more objects;

receiving one or more captured images of objects from a device; and

automatically sending media data associated with at least one object to the device, when the captured images received from the device comprise data that corresponds to at least one of the one or more objects.

10. The method of claim 9, wherein automatically sending comprises identifying information in the images and matching the identified information with the associated meta-information.

11. The method of claim 10, wherein automatically sending comprises generating a list of candidate media data to be provided to the device.

12. The method of claim 9, wherein prior to automatically sending media data, the method further comprises determining a geographical location of the device and choosing the media data based on the geographical location.

13. The method of claim 9, wherein automatically sending the media data comprises using the meta-information associated with a first entity to send the media data to another entity.

14. The method of claim 9, wherein when the captured images correspond to data associated with a first entity, automatically sending comprises sending the media data to the device on behalf of a second entity that is different from the first entity.

15. The method of claim 9, wherein the media data comprises first and second parts, the first part comprises a first advertisement and the second part comprises a second advertisement that is inserted within the first advertisement.

16. The method of claim 9, wherein automatically sending comprises generating a list of candidates and selecting at least one candidate, of the candidates, from the list, the media data is sent to the device on behalf of the at least one candidate.

17. A method, comprising:

defining and storing one or more objects;

receiving one or more captured images of one or more objects from a device; and

automatically sending media data to the device, when the captured images received from the device comprises data that is associated with at least one of the defined objects.

18. The method of claim 17, wherein automatically sending comprises sending the media data to the device on behalf of an entity that paid a fee for the media data to be sent.

19. The method of claim 17, wherein defining comprises linking the one or more defined objects to a respective one of a plurality of media data.

20. A method, comprising:

receiving one or more captured images of one or more objects;

removing one or more features from the images;

generating a group of images, from among the images, that share at least one common feature, wherein each of the images of the group are associated with a point;

determining whether the group is associated with a shape of an object captured in one of the images based on a predetermined number of points corresponding to the images of the group;

associating the group to a single object when the determination reveals that there are a predetermined number of points; and

determining the location of at least one object in the images on the basis of the points.

21. The method of claim 20, wherein prior to determining the location, evaluating the coordinates of one or more physical entities along a roadway and identifying the points that are within an area associated with the coordinates.

22. The method of claim 21, further comprising determining a center point among the points that is closest to the coordinates and associating the points with an object of the captured images.

23. The method of claim 22, further comprising utilizing the associated points to determine the location of the at least one object.

24. An apparatus comprising a processor configured to:

capture an image of one or more objects;

analyze data associated with the image to identify at least one object of the objects of the image;

receive information that is associated with the at least one object of the images; and

display the information that is associated with the at least one object.

25. The apparatus of claim 24, wherein the processor is configured to receive information that comprises a map of the area in which the at least one object is located, the map comprises one or more visual tags which contain content that is linked to or associated with the object.

26. The apparatus of claim 25, wherein at least one visual tag of the visual tags corresponds to a geographic location of the object and the other visual tags are located in an area within a predefined distance of the at least one visual tag.

27. The apparatus of claim 25, wherein the processor is further configured to select a visual tag among the visual tags and switch a view of the display and display the image of the selected visual tag while excluding from display each of the other visual tags.

28. An apparatus, comprising a processor configured to:

define and associate meta-information with one or more objects;

receive one or more captured images of objects from a device; and

automatically send media data associated with at least one object to the device, when the captured images received from the device comprise data that corresponds to at least one of the one or more objects.

29. The apparatus of claim 28, wherein the processor is configured to automatically send media data by identifying information in the images and matching the identified information with the associated meta-information.

30. The apparatus of claim 29, wherein the processor is configured to automatically send media data by generating a list of candidate media data to be provided to the device.

31. An apparatus, comprising a processor configured to:

define and store one or more objects;

receive one or more captured images of one or more objects from a device; and

automatically send media data to the device, when the captured images received from the device comprises data that is associated with at least one of the defined objects.

32. The apparatus of claim 31, wherein the processor is configured to automatically send media data by sending the media data to the device on behalf of an entity that paid a fee for the media data to be sent.

33. An apparatus, comprising a processor configured to:

receive one or more captured images of one or more objects;

remove one or more features from the images;

generate a group of images, from among the images, that share at least one common feature, wherein each of the images of the group are associated with a point;

determine whether the group is associated with a shape of an object captured in one of the images based on a predetermined number of points corresponding to the images of the group;

associate the group to a single object when the determination reveals that there are a predetermined number of points; and

determine the location of at least one object in the images on the basis of the points.

34. The apparatus of claim 33, wherein the processor is further configured to evaluate the coordinates of one or more physical entities along a roadway and identify the points that are within an area associated with the coordinates.

35. The apparatus of claim 34, wherein the processor is further configured to determine a center point among the points that is closest to the coordinates and associate the points with an object of the captured images, and utilize the associated points to determine the location of the at least one object.