CONTEXT-AWARE APPLICATION

• US 20170322690A1
• Filed: 05/06/2016
• Published: 11/09/2017
• Est. Priority Date: 05/06/2016
• Status: Active Grant

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Chen, Wei-Peng
• Granted Patent: US 10,901,756 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/288 Entity relationship models
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal
• CPC Class Codes: H04L 67/53 using third party service providers

Abstract

A method may include obtaining context data describing a context of a user of an electronic device and transmitting the context data to a back-end device. The method may also include receiving instructions from the back-end device, the instructions directing the electronic device to dynamically generate a single user interface including interactive content from a plurality of related resources, the plurality of related resources determined by the back-end device to be related to each other and to the context of the user, features of the interactive dynamic content extracted by the back-end device. The method may additionally include dynamically generating the single user interface, and displaying the single user interface to the user of the electronic device.

Claims

1. A method comprising:

obtaining context data describing a context of a user of an electronic device;

transmitting the context data to a back-end device;

receiving instructions from the back-end device, the instructions directing the electronic device to dynamically generate a single user interface including interactive content from a plurality of related resources, the plurality of related resources determined by the back-end device to be related to each other and to the context of the user, features of the interactive dynamic content extracted by the back-end device;

dynamically generating the single user interface; and

displaying the single user interface to the user of the electronic device.

2. The method of claim 1, wherein obtaining the context data includes obtaining at least one of location information from a location sensing component of the electronic device, beacon data from an electronic beacon proximate the electronic device, or a quick response (QR) code scanned by the electronic device.

3. The method of claim 1, wherein the plurality of related resources are retrieved from two or more third parties.

4. The method of claim 1, wherein the plurality of related resources include one web service and one device connected to the Internet.

5. The method of claim 4, wherein the one device includes one of a vehicle, a point-of-sale terminal, an appliance, a security camera, an electrical outlet, a thermostat, or a light.

6. The method of claim 1, wherein dynamically generating the single user interface comprises:

mapping each of the features extracted by the back-end device to a respective element generated as part of the single user interface; and

incorporating the interactive content from each of the plurality of related resources in a common format and a common visual scheme of the single user interface.

7. The method of claim 1, further comprising:

receiving an interaction of the user with an element of the single user interface to generate interaction data; and

transmitting the interaction data to the back-end device to be conveyed to a resource of the plurality of resources associated with the element of the single user interface.

8. The method of claim 1, wherein the back-end device determines the plurality of related resources are related to each other and to the context of the user and extracts the features of the interactive dynamic content by:

connecting to the plurality of resources;

building an application interface (API) model for each of the plurality of resources;

classifying each of the plurality of resources in a class;

extracting a feature from each of the plurality of resources;

storing the feature and the class for each of the plurality of resources in a database;

determining that two or more of the plurality of resources are related by a relationship;

storing the relationship between the two or more of the plurality of resources in the database;

generating a model interface that combines at least one of the features from each of the plurality of resources that are related to each other;

storing the model interface in the database; and

relating the model interface with a context for each of the plurality of resources that include a feature in the model interface.

9. A non-transitory computer-readable medium containing instructions that, when executed by a processor, are configured to cause the processor to perform or control performance of one or more operations, the operations including:

obtaining context data describing a context of a user of an electronic device;

transmitting the context data to a back-end device;

receiving instructions from the back-end device, the instructions directing the electronic device to dynamically generate a single user interface including interactive content from a plurality of related resources, the plurality of related resources determined by the back-end device to be related to each other and to the context of the user, features of the interactive dynamic content extracted by the back-end device;

dynamically generating the single user interface; and

displaying the single user interface to the user of the electronic device.

10. The non-transitory computer-readable medium of claim 9, wherein obtaining the context data includes obtaining at least one of location information from a location sensing component of the electronic device, beacon data from an electronic beacon proximate the electronic device, or a quick response (QR) code scanned by the electronic device.

11. The non-transitory computer-readable medium of claim 9, wherein the plurality of related resources are retrieved from two or more third parties.

12. The non-transitory computer-readable medium of claim 9, wherein the plurality of related resources include one web service and one device connected to the Internet.

13. The non-transitory computer-readable medium of claim 9, wherein the one device includes one of a vehicle, a point-of-sale terminal, an appliance, a security camera, an electrical outlet, a thermostat, or a light.

14. The non-transitory computer-readable medium of claim 9, wherein dynamically generating the single user interface comprises:

mapping each of the features extracted by the back-end device to a respective element generated as part of the single user interface; and

incorporating the interactive content from each of the plurality of related resources in a common format and a common visual scheme of the single user interface.

15. The non-transitory computer-readable medium of claim 9, wherein the operations additionally include:

receiving an interaction of the user with an element of the single user interface to generate interaction data; and

transmitting the interaction data to the back-end device to be conveyed to a resource of the plurality of resources associated with the element of the single user interface.

16. The non-transitory computer-readable medium of claim 9, wherein the back-end device determines the plurality of related resources are related to each other and to the context of the user and extracts the features of the interactive dynamic content by:

connecting to the plurality of resources;

building an application interface (API) model for each of the plurality of resources;

classifying each of the plurality of resources in a class;

extracting a feature from each of the plurality of resources;

storing the feature and the class for each of the plurality of resources in a database;

determining that two or more of the plurality of resources are related by a relationship;

storing the relationship between the two or more of the plurality of resources in the database;

generating a model interface that combines at least one of the features from each of the plurality of resources that are related to each other;

storing the model interface in the database; and

relating the model interface with a context for each of the plurality of resources that include a feature in the model interface.

17. A system comprising:

a back-end device; and

an electronic device, the electronic device including;

a display;

a processor; and

a computer-readable medium containing instructions that, when executed by the processor, are configured to cause the processor to perform or control performance of operations, the operations including;

obtaining context data describing a context of a user of the electronic device;

transmitting the context data to the back-end device;

receiving instructions from the back-end device, the instructions directing the electronic device to dynamically generate a single user interface including interactive content from a plurality of related resources, the plurality of related resources determined by the back-end device to be related to each other and to the context of the user, features of the interactive dynamic content extracted by the back-end device;

dynamically generating the single user interface; and

displaying the single user interface on the display of the electronic device.

18. The system of claim 17, wherein the back-end device determines the plurality of related resources are related to each other and to the context of the user and extracts the features of the interactive dynamic content by:

connecting to the plurality of resources;

building an application interface (API) model for each of the plurality of resources;

classifying each of the plurality of resources in a class;

extracting a feature from each of the plurality of resources;

storing the feature and the class for each of the plurality of resources in a database;

determining that two or more of the plurality of resources are related;

storing the relationship between the two or more of the plurality of resources in the database;

generating a model interface that combines at least one of the features from each of the plurality of resources that are related to each other;

storing the model interface in the database; and

relating the model interface with a context for each of the plurality of resources that include a feature in the model interface.

19. The system of claim 17, wherein the electronic device additionally includes at least one of a sensor for detecting a physical location of the electronic device and a scanner for scanning a quick response (QR) code.

20. The system of claim 17, wherein the plurality of related resources are retrieved from two or more third parties.