Desktop application synchronization to process data captured on a mobile device

• US 9,756,138 B2
• Filed: 04/08/2013
• Issued: 09/05/2017
• Est. Priority Date: 04/08/2013
• Status: Active Grant

• Current Assignee: HERE Global B.V. (Nokia Corporation)
• Original Assignee: HERE Global B.V. (Nokia Corporation)
• Inventors: Stroila, Matei Nicolae
• Primary Examiner(s): Srivastava, Vivek
• Assistant Examiner(s): Khan, Atta
• Application Number:
  US13/858,399
• Publication Number:
  US 20140304321A1
• Time in Patent Office: 1,611 Days
• Field of Search: 709203
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal

Abstract

In one embodiment, a mobile device and another computer operate in tandem through a cloud synchronization service to analyze image data and provide a location based service to a user. A mobile application receives image data and stores the image data in a cloud service format. The cloud synchronization service sends the image data to a desktop application on the other computer. The desktop application analyzes the image data to generate an image attribute. The cloud synchronization service sends the image attribute data to the mobile application. The mobile application provides at least one location based service based on the image attribute. The mobile application may be an augmented reality application.

Claims

1. A method for providing augmented reality with images collected at a mobile device and supplemented in real time through analysis at a personal computer comprising:

generating a key at the mobile device;

receiving, at a communication interface, image data captured by the mobile device, the image data depicting objects in a vicinity of the mobile device;

encrypting, by the mobile device, the image data in a cloud service format that is inaccessible to a cloud storage service server;

sending, by the mobile device, the image data in the cloud service format to a cloud storage service server acting as an intermediary between the personal computer and the mobile device, wherein the cloud service format includes an identification value for the mobile device;

sending the key to a desktop application of the personal computer, wherein the desktop application is configured to access the image data with the key and generate an image attribute and a pixel coordinate;

receiving, at the mobile device, the image attribute, from the personal computer, for an object in the image data;

receiving the pixel coordinate, at the mobile device, from the cloud service server as received from the personal computer, that describes a location within the image data of the image attribute,

wherein the pixel coordinate and the image attribute are determined based on an analysis of the image data performed by the personal computer and sent from the personal computer to the cloud service server; and

providing, using a processor of the mobile device, at least one location based service based on the image attribute for the image data and the pixel coordinate,

wherein the personal computer is a user-accessible desktop computer.

2. The method of claim 1, wherein the location based service provides a link to information associated with the object depicted in the image data.

3. The method of claim 1, wherein the location based service provides navigation to the object depicted in the image data.

4. An apparatus for providing augmented reality with images collected at a mobile device and supplemented in real time through analysis at a personal computer, the apparatus comprising:

at least one processor; and

at least one memory including computer program code for one or more programs;

the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to at least;

generate a key at the mobile device;

receive, at a communication interface, image data captured by the mobile device, the image data depicting objects in a vicinity of the mobile device;

encrypt, by the mobile device, the image data in a format that is inaccessible to a cloud storage service server;

send, by the mobile device, the image data in the cloud service format to a cloud storage service server acting as an intermediary between the personal computer and the mobile device, wherein the cloud service format includes an identification value for the mobile device;

send the key to a desktop application of the personal computer, wherein the desktop application is configured to access the image data with the key and generate an image attribute and a pixel coordinate;

receive, at the mobile device, the image attribute, from the personal computer, for an object depicted the image data;

receive the pixel coordinate, at the mobile device from the cloud service server as received from the personal computer, for a location within the image data of the image attribute, wherein the pixel coordinate and the image attribute are determined based on an analysis of the image data performed by the personal computer and sent from the personal computer to the cloud service server, wherein the personal computer is a user-accessible desktop computer; and

provide at least one location based service based on the image attribute for the image data and the pixel coordinate.

5. The apparatus of claim 4, wherein the location based service provides a link to information associated with the object depicted in the image data.

6. The apparatus of claim 4, wherein the location based service provides navigation to the object depicted in the image data.