Community-based data for mapping systems

• US 9,874,454 B2
• Filed: 01/13/2011
• Issued: 01/23/2018
• Est. Priority Date: 01/13/2011
• Status: Active Grant

• Current Assignee: HERE Global B.V. (Nokia Corporation)
• Original Assignee: HERE Global B.V. (Nokia Corporation)
• Inventors: Stroila, Matei
• Primary Examiner(s): Bali, Vikkram
• Application Number:
  US13/005,686
• Publication Number:
  US 20120183172A1
• Time in Patent Office: 2,567 Days
• Field of Search: 382103, 382104, 382165, 382305, 701 26, 701 1, 701533, 701300, 701 36, 701538, 707E17018, 707736
• CPC Class Codes: G01C 21/3602 Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments

Abstract

Systems, devices, features, and methods for community-based collection and use of data for mapping and/or navigation are disclosed. For example, a method is provided for use of community-based data for mapping. A camera image from a mobile device is associated with a geographic location. A processor executes an image recognition algorithm on the camera image. An address or business logo in the camera image is identified with the image recognition algorithm. Address or business logo specific information is determined based on the address or logo and the geographic location. The specific information may be contact information or business operation information.

Claims

1. A method comprising:

providing a mobile augmented reality service to a first mobile device;

receiving a first camera image from the first mobile device through the augmented reality service;

associating the first camera image from the first mobile device with a first geographic location;

executing, with a processor, an image recognition algorithm on the first camera image;

detecting, with the processor, an address or business logo from the first camera image using the image recognition algorithm;

receiving, from the first mobile device through the augmented reality service, additional information not otherwise determinable by the first camera image or the first geographic location;

associating the additional information with the address or business logo from the first camera image and the first geographic location;

storing the additional information in connection with the first geographic location associated with the first camera image and the address or business logo from the first camera image in a map database;

receiving a second camera image from a second mobile device through the augmented reality service;

associating the second camera image from the second mobile device with a second geographic location;

executing, with a processor, an image recognition algorithm on the second camera image;

detecting, with the processor, an address or business logo from the second camera image using the image recognition algorithm;

matching, with the processor, the address or business logo and the second geographic location from the second camera image with the address or business logo and the first geographic location from the first camera image;

querying the map database for the additional information based on the matched address or business logo and geographic locations;

identifying, with the processor, the additional information associated with the second camera image;

generating data for overlay on the second camera image of a viewfinder using the augmented reality service at the second mobile device, the data including at least the additional information; and

sending the data for overlay to the second mobile device.

2. The method of claim 1, further comprising:

limiting a search space in the map database for the address or business logo based on the first geographic location, the second geographic location, or combinations thereof.

3. The method of claim 1, wherein the second mobile device is configured to initiate a communication based on the additional information overlaid on the second camera image.

4. The method of claim 1, wherein the second mobile device is configured to initiate an application based on the additional information overlaid on the second camera image.

5. The method of claim 1, wherein the additional information is a phone number or an email address.

6. The method of claim 1, wherein the data for overlay includes a door bell button associated with the additional information, wherein the door bell button is configured to initiate a communication based on the associated additional information when activated.

7. An apparatus comprising:

at least one processor; and

at least one memory including computer program code for one or more programs;

the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to at least perform;

providing a mobile service to a first mobile device;

receiving a first camera image from the first mobile device through the mobile service;

associating the first camera image from the first mobile device with a first geographic location;

executing, with a processor, an image recognition algorithm on the first camera image;

detecting, with the processor, an address or business logo from the first camera image using the image recognition algorithm;

receiving, from the first mobile device through the mobile service, additional information not otherwise determinable by the first camera image or the first geographic location;

associating the additional information with the address or business logo from the first camera image and the first geographic location;

storing the additional information in connection with the geographic location associated with the first camera image and the address or business logo from the first camera image in a map database;

receiving a second camera image from a second mobile device through the mobile service;

associating the second camera image from the second mobile device with a second geographic location;

executing, with a processor, an image recognition algorithm on the second camera image;

detecting, with the processor, an address or business logo from the second camera image using the image recognition algorithm;

matching, with the processor, the address or business logo and the second geographic location from the second camera image with the address or business logo and the first geographic location from the first camera image;

querying the map database for the additional information based on the matched address or business logo and geographic locations;

identifying, with the processor, the additional information associated with the second camera image; and

generating data for overlay on the second camera image collected at the second mobile device, the data including at least the additional information.

8. The apparatus of claim 7, further comprising:

a communication interface configured to send the data for overlay to the second mobile device through the mobile service.

9. The apparatus of claim 7, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to at least perform:

limiting a search space in the map database for the address or business logo based on the first geographic location, the second geographic location, or combinations thereof.

10. The apparatus of claim 7, wherein the second mobile device is configured to initiate a communication based on the additional information overlaid on the second camera image.

11. The apparatus of claim 7, wherein the second mobile device is configured to initiate an application based on the additional information overlaid on the second camera image.

12. The apparatus of claim 7, wherein the mobile service is an augmented reality application.

13. The apparatus of claim 7, wherein the mobile service is a navigation application.