Computer based location identification using images

• US 8,483,715 B2
• Filed: 03/26/2009
• Issued: 07/09/2013
• Est. Priority Date: 03/26/2009
• Status: Expired due to Fees

• Current Assignee: R2 Solutions LLC (Acacia Research Corporation)
• Original Assignee: Yahoo! Inc. (Apollo Global Management, Inc.)
• Inventors: Chen, Chien-Hung Z.
• Primary Examiner(s): DOAN, PHUOC HUU
• Application Number:
  US12/412,238
• Publication Number:
  US 20100250136A1
• Time in Patent Office: 1,566 Days
• Field of Search: 455/456.1, 340/573.1, 709/206
• US Class Current: 455/456.3
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/583 using metadata automatically derived from the content
• CPC Class Codes: G06T 1/0021 Image watermarking
• CPC Class Codes: G06V 20/176 Urban or other man-made structures
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal
• CPC Class Codes: H04W 4/02 Services making use of location information
• CPC Class Codes: H04W 4/029 Location-based management or tracking services
• CPC Class Codes: H04W 4/185 by embedding added-value information into content, e.g. geo-tagging
• CPC Class Codes: H04W 64/00 Locating users or terminals or network equipment for network management purposes, e.g. mobility management

Abstract

In the field of mobile computing, a user of a mobile device takes a picture of a nearby landmark or building or street and transmits that picture via his device'"'"'s wireless link to a remote server. The server has the capability of identifying the location from the photo by matching it against publicly available online collections of images, such as Flickr. The server executes a location identification algorithm to match the received photo to those in the collection to determine the actual location of the photo. Typically the images in the collections have metadata, such as textual tags. Upon identifying the most likely location of the received photo from the user, the server transmits back to the user'"'"'s mobile computing device an indication of the location, such as a textual location description from the tag, a map or directions to a particular location. This is especially useful in a city or dense urban environment and where the mobile computing device does not have GPS capability or its GPS is inoperative.

Claims

1. A method comprising:

capturing, by a mobile computing device, an image of a location, the mobile computing device includes at least one of an email client and a web browser;

storing the captured image in a first computer readable storage medium in the mobile computing device;

transmitting to a host computer, by the mobile computing device, the stored image via a wireless link that is one of a cellular telephone connection or Internet connection;

receiving from the host computer, by the mobile computing device via the wireless link, location information relating to the location;

storing, by the mobile computing device, the received location information in the mobile computing device; and

displaying, by the mobile computing device, the stored location information to a user, wherein the Internet connection includes transmitting the image by one of an email or HTTP protocol, wherein the email is transmitted by the email client and the HTTP protocol is transmitted by the web browser.

2. The method of claim 1, wherein the mobile computing device is selected from a group of device types consisting of a mobile telephone, Smart phone, personal digital assistant, and portable computer.

3. The method of claim 1, wherein a camera of the mobile computing device takes a plurality of images of the location, and the plurality of images are stored and transmitted.

4. The method of claim 1, wherein the location information includes a map or text.

5. The method of claim 1, wherein the location information is provided on a display at the mobile computing device.

6. A non-transitory computer readable storage medium storing a set of computer code instructions for execution by a processor, the computer code instructions comprising:

capturing, by the processor, an image of a location;

storing, by the processor, the captured image;

transmitting to a host computer, by the processor, the stored image via a wireless link that is one of a cellular telephone connection or Internet connection;

receiving from the host computer, by the processor via the wireless link, location information relating to the location;

storing, by the processor, the received location information; and

displaying, by the processor, the stored location information to a user,

wherein, the computer readable storage medium includes at least one of an email client and a web browser and the Internet connection includes transmitting the captured image by one of an email or HTTP protocol, wherein the email is transmitted by the email client and the HTTP protocol is transmitted by the web browser.

7. A method comprising:

receiving, at a server computer from a remote computing device via a wireless link, an image of a location, the remote computing device includes at least one of an email client and a web browser and the wireless link is one of a cellular telephone connection or Internet connection;

storing, by the server computer, the received image;

enabling, by the server computer via a network, access to a collection of images, at least one of the images in the collection having a tag denoting a location associated with the image, the collection of images being stored on a computer readable medium;

searching, by the server computer, the collection to match the stored image to at least one image in the collection;

extracting, by the server computer, a tag associated with the matched image; and

transmitting, by the server computer via the wireless link, the extracted tag to the remote computing device, wherein the Internet connection includes transmitting the image by one of an email or HTTP protocol, the email is transmitted by the email client and the HTTP protocol is transmitted by the web browser.

8. The method of claim 7, wherein the remote computing device is selected from a group of device types consisting of a mobile telephone, Smart phone, personal digital assistant, and portable computer.

9. The method of claim 7, wherein the server computer receives, from the remote computing device, a plurality of images of the location.

10. The method of claim 7, wherein the location information includes a map or text.

11. A mobile computing device comprising:

a camera which captures an image;

a processor coupled to the camera and storing the captured image in a computer readable storage medium coupled to the processor, the computer readable storage medium includes at least one of an email client and a web browser;

a port coupled to the processor for transmitting the stored image to a host computer via a wireless link that is one of a cellular telephone connection or Internet connection, wherein the Internet connection includes transmitting the stored image by one of an email or HTTP protocol and the email is transmitted by the email client and the HTTP protocol is transmitted by the web browser;

the port receiving location information from the host computer relating to the location;

the computer readable storage medium coupled to the port for storing the received location information; and

a display coupled to the processor and displaying the stored received location information,

wherein the processor displays on the display a user control interface for capturing the image and transmitting it.

12. A server computer comprising:

a port for receiving, from a remote computing device via a wireless link, an image of a location, the remote computing device includes at least one of an email client and a web browser;

a computer readable storage medium coupled to the port for storing the received image; and

a processor for enabling access to a collection of images having tags, at least one of the tags denoting a location associated with the image,

the processor coupled to the port and for searching the collection to match the stored image to at least one image in the collection and for extracting a tag associated with the matched image, wherein the processor transmits, via the port, the extracted tag to the remote computing device, the wireless link that is one of a cellular telephone connection or Internet connection, wherein the Internet connection includes transmitting the stored image by one of an email or HTTP protocol and the email is transmitted by the email client and the HTTP protocol is transmitted by the web browser.