UPDATING MAP DATA FROM CAMERA IMAGES

• US 20120166074A1
• Filed: 12/23/2010
• Published: 06/28/2012
• Est. Priority Date: 12/23/2010
• Status: Active Grant

• Current Assignee: Malikie Innovations Limited (Key Patent Innovations Limited)
• Original Assignee: Blackberry Limited
• Inventors: WENG, Jianfeng, JIN, Xin, STEER, David
• Granted Patent: US 9,429,438 B2
• Time in Patent Office: Days
• US Class Current: 701/409
• CPC Class Codes: G01C 21/3811 Point data, e.g. Point of Interest [POI]
• CPC Class Codes: G01C 21/3837 Data obtained from a single source
• CPC Class Codes: G01C 21/3848 Data obtained from both position sensors and additional sensors

Abstract

A method of updating map data entails capturing an image using a camera, determining a location of an object in the image, creating new map data to represent the object in the image, and updating a map database to include the new map data for the object in the image. This method may be implemented on a GPS-enabled wireless communications device having an onboard camera which can transmit the new map data to a map server for updating its map database. Determining the position of the object in the image relative to the wireless device may be accomplished using a rangefinder and compass, triangulation of multiple images of the object, or a stereoscopic camera. The accuracy of the GPS position fix may be improved by capturing images of recognizable objects for which location coordinates are available.

Claims

1. A method of updating map data, the method comprising:

capturing an image using a camera of a wireless communications device;

determining a location of an object in the image;

creating new map data to represent the object in the image; and

updating a map database to include the new map data for the object in the image.

2. The method as claimed in claim 1 wherein determining the location of the object comprises:

determining a current position of a wireless communications device using a GPS receiver in the wireless communications device; and

determining a relative position of the object relative to the current position of the wireless communications device.

3. The method as claimed in claim 2 wherein determining the relative position of the object comprises using multiple images to triangulate the relative position of the object.

4. The method as claimed in claim 2 wherein determining the relative position of the object comprises using a stereoscopic camera to determine the relative position of the object.

5. The method as claimed in claim 2 wherein determining the relative position of the object comprises using a rangefinder and compass to determine the relative position of the object.

6. The method as claimed in claim 2 wherein determining the current position of the wireless communications device comprises:

capturing one or more photos of recognizable objects;

geotagging the one or more photos;

identifying the recognizable objects in the one or more geotagged photos;

obtaining position coordinates for the recognizable objects; and

refining the current position of the wireless communications device based on the position coordinates for the recognizable objects.

7. The method as claimed in claim 2 wherein determining the current position of the wireless communications device comprises receiving location information from navigation signals of one of GPS services and terrestrial signals.

8. The method as claimed in claim 1 wherein updating the map database comprises wirelessly transmitting the new map data to a server hosting the map database.

9. The method as claimed in claim 1 further wherein updating the map database comprises updating a local map database stored on a wireless device.

10. The method as claimed in claim 1 further comprising simultaneously displaying in real-time the image taken by the camera as a backdrop to a three-dimensionally rendered map of an area corresponding to the current position of the device.

11. A computer-readable medium comprising instructions in code which when loaded into memory and executed on a processor of a wireless communications device is adapted to update map data in a map database by:

capturing an image using a camera;

determining a location of an object in the image;

creating new map data to represent the object in the image; and

updating a map database to include the new map data for the object in the image.

12. The computer-readable medium as claimed in claim 11 comprising code that causes the device to:

determine a current position of the wireless communications device using a GPS receiver in the wireless communications device; and

determine a relative position of the object relative to the current position of the wireless communications device.

13. The computer-readable medium as claimed in claim 12 comprising code that causes the device to determine the current position of the wireless communications device by:

capturing one or more photos of recognizable objects;

geotagging the one or more photos;

identifying the recognizable objects in the one or more geotagged photos;

obtaining position coordinates for the recognizable objects; and

refining the current position of the wireless communications device based on the position coordinates for the recognizable objects.

14. The computer-readable medium as claimed in claim 11 wherein the code is configured to simultaneously display in real-time the image taken by the camera as a backdrop to a three-dimensionally rendered map of an area corresponding to the current position of the device.

15. A wireless communications device for updating map data, the device comprising:

a camera for capturing an image;

a Global Positioning System (GPS) receiver for determining a current location of the wireless communications device; and

a memory for storing the image, the memory being operatively coupled to a processor for determining a location of an object in the image,

wherein the processor is configured to cause new map data representing the object in the image to be created.

16. The device as claimed in claim 15 comprising a radiofrequency transceiver operatively coupled to the processor for transmitting the new map data to a map server for updating the map database stored at the map server.

17. The device as claimed in claim 15 comprising a rangefinder and a compass for determining the relative position of the object in the image relative to the current location of the device.

18. The device as claimed in claim 15 wherein the processor is configured to:

instruct the camera to capture one or more photos of recognizable objects;

geotag the one or more photos using the current location as determined by the GPS receiver;

identify the recognizable objects in the one or more geotagged photos;

obtain position coordinates for the recognizable objects; and

refine the current position of the wireless communications device based on the position coordinates for the recognizable objects.

19. The device as claimed in claim 15 wherein the processor is configured to cause a display to simultaneously render in real-time the image taken by the camera as a backdrop to a three-dimensionally rendered map of an area corresponding to the current position of the device.

20. The device as claimed in claim 15 wherein the processor is configured to:

cause the camera to take multiple images of the object from different positions; and

triangulate the relative position of the object from the multiple images.