Updating map data from camera images

• US 9,429,438 B2
• Filed: 12/23/2010
• Issued: 08/30/2016
• Est. Priority Date: 12/23/2010
• Status: Active Grant

• Current Assignee: Malikie Innovations Limited (Key Patent Innovations Limited)
• Original Assignee: Blackberry Limited
• Inventors: Weng, Jianfeng, Jin, Xin, Steer, David
• Primary Examiner(s): Sample, Jonathan L
• Application Number:
  US12/977,394
• Publication Number:
  US 20120166074A1
• Time in Patent Office: 2,077 Days
• US Class Current: 1/1
• CPC Class Codes: G01C 21/3811 Point data, e.g. Point of Interest [POI]
• CPC Class Codes: G01C 21/3837 Data obtained from a single source
• CPC Class Codes: G01C 21/3848 Data obtained from both position sensors and additional sensors

Abstract

A method of updating map data entails capturing an image using a camera, determining a location of an object in the image, creating new map data to represent the object in the image, and updating a map database to include the new map data for the object in the image. This method may be implemented on a GPS-enabled wireless communications device having an onboard camera which can transmit the new map data to a map server for updating its map database. Determining the position of the object in the image relative to the wireless device may be accomplished using a rangefinder and compass, triangulation of multiple images of the object, or a stereoscopic camera. The accuracy of the GPS position fix may be improved by capturing images of recognizable objects for which location coordinates are available.

Claims

1. A method of updating map data, the method comprising:

determining a current position of a wireless communications device;

capturing an image using a camera of the wireless communications device;

processing the image for transmission over a wireless network, the processing comprising one of creating a low resolution version of the image and creating a wire mesh version of the image;

transmitting the proceed image to a man server,

receiving a message from the man server in response to the processed image, the message including an identification of an object from the processed image and a location of a landmark in a map database from the map server, the landmark corresponding to the object;

using the location of the landmark to refine the current position of the wireless communications device;

determining a location of a second object in the image;

using the refined position of the wireless communications device and the location of the second object to create new map data; and

updating the map database with the new map data.

2. The method as claimed in claim 1 further comprising:

determining the current position of the wireless communications device using a GPS receiver in the wireless communications device; and

determining a relative position of the second object relative to the current position of the wireless communications device.

3. The method as claimed in claim 2 wherein determining the relative position of the second object comprises using multiple images to triangulate the relative position of the object.

4. The method as claimed in claim 2 wherein determining the relative position of the second object comprises using a stereoscopic camera to determine the relative position of the object.

5. The method as claimed in claim 2 wherein determining the relative position of the second object comprises using a rangefinder and compass to determine the relative position of the object.

6. The method as claimed in claim 2 wherein determining the current position of the wireless communications device comprises receiving location information from navigation signals of one of GPS services and terrestrial signals.

7. The method as claimed in claim 1 wherein updating the map database comprises wirelessly transmitting the new map data to the map server.

8. The method as claimed in claim 1 further wherein updating the map database comprises updating a local map database stored on a wireless device.

15. The method as claimed in claim 1 further comprising simultaneously displaying in real-time the image taken by the camera as a backdrop to a three-dimensionally rendered map of an area corresponding to the current position of the device.

9. A non-transitory computer-readable medium comprising instructions in code which when loaded into memory and executed on a processor of a wireless communications device is adapted to update map data in a map database by:

determining a current position of the wireless communications device;

capturing an image using a camera;

processing the image for transmission over a wireless network, the processing comprising one of creating a low resolution version of the image and creating a wire mesh version of the image;

transmitting the processed image to a map server;

receiving a message from the man server in response to the processed image, the message including an identification of an object from the processed image and a location of a landmark in a map database from the map server, the landmark corresponding to the object;

using the location of the landmark to refine the current position of the wireless communications device;

determining a location of a second object in the image;

using the refined position of the wireless communications device and the location of the second object to create new map data; and

updating the map database with the new map data.

10. The non-transitory computer-readable medium as claimed in claim 9 comprising code that causes the device to:

determine the current position of the wireless communications device using a GPS receiver in the wireless communications device; and

determine a relative position of the second object relative to the current position of the wireless communications device.

16. The computer-readable medium as claimed in claim 9 wherein the code is configured to simultaneously display in real-time the image taken by the camera as a backdrop to a three-dimensionally rendered map of an area corresponding to the current position of the device.

11. A wireless communications device for updating map data, the device comprising:

a camera;

a Global Positioning System (GPS) receiver;

a memory for storing the image, the memory being operatively coupled to a processor; and

a radiofrequency transceiver operatively coupled to the processor;

wherein the processor is configured to;

determine a current position of the wireless communications device;

capture an image using the camera;

process the image for transmission over a wireless network, the processing comprising one of creating a low resolution version of the image and creating a wire mesh version of the image;

transmit the processed image to a map server with the radiofrequency transceiver;

receive a message from the map server in response to the processed image, the message including an identification of an object from the processed image and a location of a landmark in a man database from the man server, the landmark corresponding to the object;

use the location of the landmark to refine the current position of the wireless communications device;

determine a location of a second object in the image;

use the refined position of the wireless communications device and the location of the second object to create new map data; and

update the man database with the new map data.

12. The device as claimed in claim 11 wherein updating the map database comprises transmitting the new map data to the map server.

13. The device as claimed in claim 11 comprising a rangefinder and a compass for determining the relative position of the second object in the image relative to the current location of the device.

14. The device as claimed in claim 11 wherein the processor is configured to:

cause the camera to take multiple images of the object from different positions; and

triangulate the relative position of the second object from the multiple images.

17. The device as claimed in claim 11 wherein the processor is configured to cause a display to simultaneously render in real-time the image taken by the camera as a backdrop to a three-dimensionally rendered map of an area corresponding to the current position of the device.