Method, apparatus and computer program product for providing standard real world to virtual world links

• US 8,775,452 B2
• Filed: 09/14/2007
• Issued: 07/08/2014
• Est. Priority Date: 09/17/2006
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Corporation
• Inventors: Schloter, Philipp
• Primary Examiner(s): TRUONG, CAM Y T
• Application Number:
  US11/855,430
• Publication Number:
  US 20080071750A1
• Time in Patent Office: 2,489 Days
• Field of Search: 707/3, 707/6, 707/770, 707/758, 707/707, 725/105, 382/305
• US Class Current: 707/758
• CPC Class Codes: G01C 21/3476 using point of interest [POI] information, e.g. a route passing visible POIs
• CPC Class Codes: G01C 21/3682 output of POI information on a road map G01C21/3614, G01C21/3685 take precedence
• CPC Class Codes: G01C 21/3685 the POI's being parking facilities
• CPC Class Codes: G06F 16/29 Geographical information databases
• CPC Class Codes: G06F 16/5854 using shape and object relationship
• CPC Class Codes: G08G 1/096827 where the route is computed onboard

Abstract

An apparatus for providing standard real world to virtual world links may include a processing element configured to receive indications of an image including an object, determine whether the object corresponds to a particular object having a predefined association based on a recognition of the object, and execute a function corresponding to the predefined association in response to the object corresponding to the particular object.

Claims

1. A method comprising:

receiving indications of an image including an object at a mobile terminal;

determining to identify, at the mobile terminal, whether the object corresponds to a particular real life object having a predefined association mapping the particular real life object to a function based, at least in part, on a recognition of the object; and

in response to the object corresponding to the particular real life object, determining to execute at the mobile terminal the function corresponding to the predefined association by executing a link to a predetermined destination and causing, at least in part, a display of a title describing the predefined association of the real life object and the function,

wherein the function includes retrieving information corresponding to a location of a camera providing the indications of the image, and the information defines an environment condition or another real life object, other than the object or the camera, associated with the location, and

wherein the determining whether the object corresponds to the particular real life object comprises comparing features of the image to source images including object features to find a corresponding object having features matching the features of the image and determining whether the corresponding object is in a list of particular objects having respective predefined associations.

2. The method of claim 1, wherein executing the function comprises placing a call, sending a text message or email, or a combination thereof corresponding to a location of a camera providing the indications of the image.

3. The method of claim 1, wherein the link is a phone number, a yellow pages entry, a document, or a radio station, the title is provided as text entry associated with the particular real life object, and executing the function further comprises displaying a banner.

4. The method of claim 1, wherein executing the function comprises retrieving information corresponding to a topic associated with the object via the predefined association.

5. The method of claim 4, further comprising enabling navigation with respect to information retrieved.

6. The method of claim 1, wherein the identified object and the predefined association further include one or more selections from the group consisting of:

a sky, a window having at least a partial sky view, or a cloud having an association with weather information;

a street, a street sign, or a street light having an association with traffic information;

a street, or a street sign having an association with ordering a taxi;

a printed transportation company logo or a printed public transportation schedule having an association with transportation time schedules;

a printed transportation company logo or a printed public transportation schedule having an association with transportation information;

a printed airline logo object or an airplane having an association with flight information;

a printed airline logo or an airplane having an association with accessing airline service hotlines;

a printed courier service logo having an association with accessing shipping information;

a clock or watch having an association with receiving access to world-times, calendar or other similar information;

a newspaper stand, newspaper or newspaper box having an association with accessing or viewing any kind of news, blog or informational service;

fronts of sites, buildings or other points of interest having an association with accessing information about the site, building or point of interest, respectively;

a particular recognized person having an association with enabling access to information about the particular recognized person or access to information used to transfer money to or receive money from the particular recognized person;

a restaurant, bar or other public space having an association with providing another party with an invitation to a location of the corresponding restaurant, bar or other public space; and

a shirt or ironing board having an association with finding a local cleaner or dry cleaner.

7. The method of claim 1, wherein the identified object further includes a parking meter, and the predefined association is between the parking meter and accessing parking information, paying parking or other tickets, storing information related to paying for parking services, obtaining access pointers to nearby parking spots, or a combination thereof.

8. The method of claim 1, wherein the another real life object is absent from the image.

9. The method of claim 1, wherein the information defines the environment condition associated with the location, and the environment condition includes weather, traffic, or a combination thereof.

10. The method of claim 1, wherein the particular real life object has a plurality of predefined associations mapping the particular real life object to functions based on the recognition of the object.

11. A non-transitory computer-readable storage medium carrying one or more sequences of one or more instructions which, when executed by one or more processors, cause a mobile terminal to at least perform the following steps:

receiving indications of an image including an object;

determining to identify whether the object corresponds to a particular real life object having a predefined association mapping the particular real life object to a function based, at least in part, on a recognition of the object; and

in response to the object corresponding to the particular real life object, determining to execute the function corresponding to the predefined association by executing a link to a predetermined destination and causing, at least in part, a display of a title describing the predefined association of the real life object and the function,

wherein the function includes retrieving information corresponding to a location of a camera providing the indications of the image, and the information defines an environment condition or another real life object, other than the object or the camera, associated with the location,

wherein the mobile terminal is caused to further perform;

comparing features of the image to source images including object features to find a corresponding object having features matching the features of the image and determining whether the corresponding object is in a list of particular objects having respective predefined associations.

12. The non-transitory computer-readable storage medium of claim 11, wherein the mobile terminal is caused to further perform:

placing a call, sending a text message or email, or a combination thereof corresponding to a location of a camera providing the indications of the image.

13. The non-transitory computer-readable storage medium of claim 11, wherein the identified object and the predefined association further include one or more selections from the group consisting of:

a sky, a window having at least a partial sky view, or a cloud having an association with weather information;

a street, a street sign, or a street light having an association with traffic information;

a street, or a street sign having an association with ordering a taxi;

a printed transportation company logo or a printed public transportation schedule having an association with transportation time schedules;

a printed transportation company logo or a printed public transportation schedule having an association with transportation information;

a printed airline logo object or an airplane having an association with flight information;

a printed airline logo or an airplane having an association with accessing airline service hotlines;

a printed courier service logo having an association with accessing shipping information;

a parking meter having an association with accessing parking information, paying parking or other tickets, storing information related to paying for parking services, or obtaining access pointers to nearby parking spots;

a clock or watch having an association with receiving access to world-times, calendar or other similar information;

a newspaper stand, newspaper or newspaper box having an association with accessing or viewing any kind of news, blog or informational service;

fronts of sites, buildings or other points of interest having an association with accessing information about the site, building or point of interest, respectively;

a particular recognized person having an association with enabling access to information about the particular recognized person or access to information used to transfer money to or receive money from the particular recognized person;

a restaurant, bar or other public space having an association with providing another party with an invitation to a location of the corresponding restaurant, bar or other public space; and

a shirt or ironing board having an association with finding a local cleaner or dry cleaner.

14. An apparatus comprising:

at least one processor; and

at least one memory including computer program code,

the at least one memory and the computer program code configured to, with the at least one processor, cause a mobile terminal to perform at least the following,

receive indications of an image including an object;

determine to identify whether the object corresponds to a particular real life object having a predefined association mapping the particular real life object to a function based, at least in part, on a recognition of the object; and

in response to the object corresponding to the particular real life object, determine to execute the function corresponding to the predefined association by executing a link to a predetermined destination and cause, at least in part, a display of a title describing the predetermined association of the real life object and the function,

wherein the function includes retrieving information corresponding to a location of a camera providing the indications of the image, and the information defines an environment condition or another real life object, other than the object or the camera, associated with the location, and

wherein the mobile terminal is further caused to compare features of the image to source images including object features to find a corresponding object having features matching the features of the image and determine whether the corresponding object is in a list of particular objects having respective predefined associations.

15. The apparatus of claim 14, wherein the mobile terminal is further caused to place a call, send a text message or email, or a combination thereof corresponding to a location of a camera providing the indications of the image.

16. The apparatus of claim 14, wherein the link is a phone number, a yellow pages entry, a document, or a radio station,

the title is provided as text entry associated with the particular real life object, and

executing the function further comprises displaying a banner.

17. The apparatus of claim 14, wherein the mobile terminal is further caused to retrieve information corresponding to a topic associated with the object via the predefined association.

18. The apparatus of claim 17, wherein the mobile terminal is further caused to enable navigation with respect to information retrieved.

19. The apparatus of claim 14, wherein the identified object and the predefined association further include one or more selections from the group consisting of:

a sky, a window having at least a partial sky view, or a cloud having an association with weather information;

a street, a street sign, or a street light having an association with traffic information;

a street, or a street sign having an association with ordering a taxi;

a printed transportation company logo or a printed public transportation schedule having an association with transportation time schedules;

a printed transportation company logo or a printed public transportation schedule having an association with transportation information;

a printed airline logo object or an airplane having an association with flight information;

a printed airline logo or an airplane having an association with accessing airline service hotlines;

a printed courier service logo having an association with accessing shipping information;

a parking meter having an association with accessing parking information, paying parking or other tickets, storing information related to paying for parking services, or obtaining access pointers to nearby parking spots;

a clock or watch having an association with receiving access to world-times, calendar or other similar information;

a newspaper stand, newspaper or newspaper box having an association with accessing or viewing any kind of news, blog or informational service;

fronts of sites, buildings or other points of interest having an association with accessing information about the site, building or point of interest, respectively;

a restaurant, bar or other public space having an association with providing another party with an invitation to a location of the corresponding restaurant, bar or other public space; and

a shirt or ironing board having an association with finding a local cleaner or dry cleaner.

20. A mobile terminal comprising:

a receiver which receives indications of an image including an object;

a position sensor that determines a location of the mobile terminal;

at least one processor; and

at least one memory including computer program code,

the at least one memory and the computer program code configured to, with the at least one processor, cause a mobile terminal to perform at least the following,

identify whether the object corresponds to a particular real life object having a predefined association mapping the particular real life object to a function based, at least in part, on a recognition of the object,

wherein in response to the object corresponding to the particular real life object, the controller executes the function corresponding to the predefined association by executing a link to a predetermined destination and causes, at least in part, a display of a title describing the predefined association of the real life object and the function,

wherein the function includes retrieving information corresponding to a location of a camera providing the indications of the image, and the information defines an environment condition or another real life object, other than the object or the camera, associated with the location, and

wherein the mobile terminal is further caused to compare features of the image to source images including object features to find a corresponding object having features matching the features of the image and determine whether the corresponding object is in a list of particular objects having respective predefined associations.