METHOD AND SYSTEM FOR MANAGING DATA IN TERMINAL-SERVER ENVIRONMENTS

• US 20130286048A1
• Filed: 04/24/2013
• Published: 10/31/2013
• Est. Priority Date: 04/25/2012
• Status: Abandoned Application

• Current Assignee: Christian Sternitzke
• Original Assignee: Christian Sternitzke
• Inventors: STERNITZKE, Christian
• Application Number:
  US13/869,489
• Publication Number:
  US 20130286048A1
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G06F 16/434 using image data, e.g. images, photos, pictures taken by a user
• CPC Class Codes: G06F 16/487 using geographical or spatial information, e.g. location
• CPC Class Codes: G06Q 10/06 Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

A system and method of providing augmented reality (AR) information uses a camera to take images from a mobile device'"'"'s environment. These images are compared to images stored in an image-object database to identify objects within these images. The objects are compared to objects stored in a database with AR information to display the AR information as an overlay of the real image on the mobile device. The AR information is generated from a mobile device user preference database. The preferences are matched with a second user'"'"'s preferences obtained from data mining activities across a store management system, ERP system, CRM system, data on sales figures tied to customer data, and the like. An additional image-object localization database provides detailed localization information for objects identified. The store management system, ERP, or CRM system can facilitate electronic analysis of products, sales and customer data.

Claims

1. A method that can be executed in a mobile device, the method comprising the following steps:

obtaining a current location of the mobile device,

obtaining one or more images via a sensor,

correlating the one or more images obtained from the sensor with reference data obtained from an image-object recognition database to identify objects within the one or more images,

obtaining augmented reality information that is linked to at least one of the objects from an augmented reality information database,

adjusting the augmented reality information to preferences stored in at least one preference data base,

comparing user preference data from a user preference database to preferences stored in one or more databases to obtain information to be displayed via augmented reality,

and displaying the information to be displayed via augmented reality on a display of the mobile device.

2. The method according to claim 1, wherein the preferences are based on data gathered from linking at least one of product information from mobile payments made, mobile coupons cashed by a user, and social media data analysis, and one of the one or more further databases comprising results based on data mining activities.

3. The method according to claim 1, wherein at least one of the at least one preference database is connected to at least one of a store management system, an enterprise resource planning (ERP) system, a customer relationship management system, and systems that allow the electronic analysis of product, sales and customer data, including social media data or a combination thereof.

4. The method according to claim 1, further specifying the current location of the mobile device by means of the objects identified via the images, which are compared to objects with location information stored in an image-object localization database.

5. The method according to claim 1, wherein the identification of objects is prioritized based on eye tracking.

6. A mobile device for providing augmented reality information to a user, the mobile devices comprising:

at least one sensor;

at least one network interface capable of communicating via a communication network;

at least a processor coupled to the network interfaces and the at least one sensor;

a locating means for obtaining a current location of the mobile device;

at least one image sensor for obtaining one or more images;

a correlating means for correlating the one or more images obtained from the image sensor with reference data obtained from an image-object recognition database to identify objects within the one or more images;

an augmented reality means for obtaining augmented reality information that is linked to at least one of the objects; and

a display for displaying the augmented reality information;

wherein at least the display is arranged in at least one glass of a pair of glasses.

7. The mobile device of claim 6, wherein a first one of the at least one image sensors is arranged for recording the eyes of the user and at least a second one of the at least one image sensor is arranged for recording at least parts of the field of view of the user.

8. The mobile device of claim 7, wherein a prioritization of object identification takes place from using data from the first image sensor recording the eyes of the user.

9. The mobile device according to claim 6, wherein the information displayed via augmented reality is adjusted to preferences stored in a preference database, the preference database is stored in a memory of the mobile device or is accessible via the interface of the communication network, and the information displayed via augmented reality emerges from comparing user preference data from a user preference database to preferences stored in one or more further databases and a preference matching may take place.

10. The mobile device according to claim 9, wherein the preferences are based on data gathered from linking at least one of product information from mobile payments made, mobile coupons used by the user, and social media data analysis;

and one of the databases comprises results based on data mining activities.

11. The mobile device according to claim 9, wherein at least one of the preference databases is connected to at least one of a store management system, an enterprise resource planning (ERP) system, a customer relationship management system, and systems that allow the electronic analysis of product, sales and customer data, including social media data or a combination thereof.

12. The mobile device of claim 6, wherein the current location of the mobile device is specified by means of the objects identified via the images, which are compared to objects with location information stored in an image-object localization database.

13. A system with at least one server, wherein the at least one server comprises:

a network interface capable of communicating via a network with at least one terminal;

a processor coupled to the network interface; and

a memory coupled to the processor, the memory including instructions that cause the processor to provide information to the at least one terminal to;

receive reference image data from an image-object recognition database;

receive information linked to a first object on a display of the at least one terminal, wherein the information are based on preferences;

obtain augmented reality information that is linked to the first object from an augmented reality information database; and

send the augmented reality information to the at least one terminal.

14. The system according to claim 13 further comprising:

correlating the image data which the at least one terminal obtains from at least one sensor with reference image data from an image-object recognition database to identify objects within the images, and

wherein the information sent to the at least one terminal is compared in real-time to preferences stored in one or more preference databases, and preference matching takes place.

15. The system according to claim 13, wherein the preferences are based on data gathered from linking at least one of product information from mobile payments made, mobile coupons cashed by the user, and social media data analysis.

16. The system according to claim 13 wherein the preferences stored in one or more preference databases are of multiple users.

17. A system according to claim 14, wherein at least a further preference database comprises results based on data mining activities.

18. The system according to claim 13, wherein the at least one terminal is a mobile device.

19. The system according to claim 14, wherein at least one of the one or more preference databases is connected to at least one of a store management system, an enterprise resource planning (ERP) system, a customer relationship management (CRM) system, and systems in general that allow the electronic analysis of product, sales and customer data, including social media data, or a combination thereof.

20. The system according to claim 13, wherein the current location of the terminal is specified by means of the objects identified via the images, which are compared to objects with location information stored in an image-object localization database via the communications network.