System and method for personalized and adaptive application management

• US 10,567,570 B2
• Filed: 12/27/2018
• Issued: 02/18/2020
• Est. Priority Date: 12/29/2017
• Status: Active Grant

• Current Assignee: DMAI Company Limited
• Original Assignee: DMAI, Inc.
• Inventors: Rajab, Nawar, Shukla, Nishant
• Primary Examiner(s): Gelin, Jean A
• Application Number:
  US16/233,566
• Publication Number:
  US 20190208052A1
• Time in Patent Office: 418 Days
• CPC Class Codes: G06F 11/3438 monitoring of user actions tracking the activity of the user H04L67/535
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04L 67/125 involving control of end-device applications over a network
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04L 67/306 User profiles
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34
• CPC Class Codes: H04L 67/56 Provisioning of proxy services store-and-forward switching systems in data switching networks H04L12/54
• CPC Class Codes: H04M 1/72454 according to context-related or environment-related conditions
• CPC Class Codes: H04W 4/021 Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
• CPC Class Codes: H04W 4/38 for collecting sensor information

Abstract

The present teaching relates to method, system, and medium for cross network communications. Information related to an application running on a user device is first received, which includes a state of the application and sensor data obtained with respect to a user interacting with the application on the user device. A request is sent to an application server for an instruction of a state transition of the application. A light weight model (LWM) for an object involved in the state transition is received and is personalized based on at least one of the sensor data and one or more preferences related to the user to generate a personalized model (PM) for the object, which is then sent to the user device.

Claims

1. A method implemented on at least one machine including at least one processor, memory, and communications platform connected to a network for cross network communications, the method comprising:

receiving information related to an application running on a user device, wherein the information includes a state of the application and sensor data obtained with respect to a user interacting with the application on the user device, and with respect to a surrounding of the user;

sending a request to an application server, with the state of the application, for an instruction to make a state transition of the application;

receiving a light weight model (LWM) for an object involved in the state transition;

personalizing the LWM based on at least one of the sensor data and one or more preferences related to the user to generate a personalized model (PM) for the object, wherein the PM includes additional parameters, as compared with the LWM, that are needed in order to render the object on the user device;

sending the PM to the user device.

2. The method of claim 1, wherein the state of the application is obtained from the user device based on an interaction of the user with the application.

3. The method of claim 1, wherein the sensor data include data acquired via multi-modal sensors.

4. The method of claim 1, wherein the step of personalizing comprises:

analyzing the sensor data to identify the user and the surrounding of the user;

extracting one or more features related to the user;

identifying at least one feature associated with the surrounding;

determining the values of the additional parameters based on the one or more features and/or the at least one feature;

generating the PM based on the values of the additional parameters.

5. A machine readable and non-transitory medium with information stored thereon for cross network communications, wherein the information, when read by the machine, causes the machine to perform:

receiving information related to an application running on a user device, wherein the information includes a state of the application and sensor data obtained with respect to a user interacting with the application on the user device, and with respect to a surrounding of the user;

sending a request to an application server, with the state of the application, for an instruction to make a state transition of the application;

receiving a light weight model (LWM) for an object involved in the state transition;

personalizing the LWM based on at least one of the sensor data and one or more preferences related to the user to generate a personalized model (PM) for the object, wherein the PM includes additional parameters, as compared with the LWM, that are needed in order to render the object on the user device;

sending the PM to the user device.

6. The medium of claim 5, wherein the state of the application is obtained from the user device based on an interaction of the user with the application.

7. The medium of claim 5, wherein the sensor data include data acquired via multi-modal sensors.

8. The medium of claim 5, wherein the step of personalizing comprises:

analyzing the sensor data to identify the user and the surrounding of the user;

extracting one or more features related to the user;

identifying at least one feature associated with the surrounding;

determining the values of the additional parameters based on the one or more features and/or the at least one feature;

generating the PM based on the values of the additional parameters.

9. A system for cross network communications, the system comprising:

a user device interface unit configured for receiving information related to an application running on a user device, wherein the information includes a state of the application and sensor data obtained with respect to a user interacting with the application on the user device, and with respect to a surrounding of the user;

an application client controller configured for sending a request to an application server, with the state of the application, for an instruction to make a state transition of the application;

a PM generator configured for personalizing a light weight model (LWM) of an object involved in the state transition from the application server to generate a personalized model (PM) for the object, wherein the personalizing is based on at least one of the sensor data and one or more preferences related to the user, and wherein the PM includes additional parameters, as compared with the LWM, that are needed in order to render the object on the user device;

an application server interface unit configured for sending the PM to the user device.

10. The system of claim 9, wherein the state of the application is obtained from the user device based on an interaction of the user with the application.

11. The system of claim 9, wherein the sensor data include data acquired via multi-modal sensors.

12. The system of claim 9, wherein the PM generator personalizes the LWM via:

analyzing the sensor data to identify the user and the surrounding of the user;

extracting one or more features related to the user;

identifying at least one feature associated with the surrounding;

determining the values of the additional parameters based on the one or more features and/or the at least one feature;

generating the PM based on the values of the additional parameters.

13. A method implemented on at least one machine including at least one processor, memory, and communications platform connected to a network for cross network communications, the method comprising:

receiving a first request from an application client for an instruction to make a state transition of an application running on a user device, wherein the request includes a state of the application, which is obtained based on an interaction of the user with the application on the user device;

determining the state transition based on the state of the application;

identifying an object related to the state transition;

selecting a subset of parameters from a plurality of parameters, that are needed to render the object on the user device;

determining a value for each of the subset of parameters;

generating a light weight model (LWM) of the object based on the values of the subset of parameters;

sending, as a response to the first request, the LWM of the object to the application client so that the LWM is to be personalized with respect to additional parameters by the application client based on information related to the user.

14. The method of claim 13, wherein a combination of the subset of parameters and the additional parameters corresponds to the plurality of parameters.

15. The method of claim 14, wherein values of the additional parameters are determined based on sensor data acquired by the user device, wherein the sensor data capture information of the user and/or surrounding near the user.

16. The method of claim 15, wherein the values of the additional parameters are determined based on at least one of:

one or more features related to the user extracted based on the sensor data;

at least one feature associated with the surrounding of the user; and

previously known information about preferences of the user.

17. The method of claim 13, further comprising:

receiving a second request from the application client for further parameters of the object, wherein the further parameters are included in the plurality of parameters of the object;

retrieving values of the further parameters; and

sending the values of the further parameters to the application client as a response to the second request.

18. Machine readable and non-transitory medium having information recorded thereon for cross network communications, wherein the information, when read by the machine, causes the machine to perform:

receiving a first request from an application client for an instruction to make a state transition of an application running on a user device, wherein the request includes a state of the application, which is obtained based on an interaction of the user with the application on the user device;

determining the state transition based on the state of the application;

identifying an object related to the state transition;

selecting a subset of parameters from a plurality of parameters, that are needed to render the object on the user device;

determining a value for each of the subset of parameters;

generating a light weight model (LWM) of the object based on the values of the subset of parameters;

sending, as a response to the first request, the LWM of the object to the application client so that the LWM is to be personalized with respect to additional parameters by the application client based on information related to the user.

19. The medium of claim 18, wherein a combination of the subset of parameters and the additional parameters corresponds to the plurality of parameters.

20. The medium of claim 19, wherein values of the additional parameters are determined based on sensor data acquired by the user device, wherein the sensor data capture information of the user and/or surrounding near the user.

21. The medium of claim 20, wherein the values of the additional parameters are determined based on at least one of:

one or more features related to the user extracted based on the sensor data;

at least one feature associated with the surrounding of the user; and

previously known information about preferences of the user.

22. The medium of claim 18, further comprising:

receiving a second request from the application client for further parameters of the object, wherein the further parameters are included in the plurality of parameters of the object;

retrieving values of the further parameters; and

sending the values of the further parameters to the application client as a response to the second request.

23. A system for cross network communications, comprising:

an application client interface unit configured for receiving a first request from an application client for an instruction to make a state transition of an application running on a user device, wherein the request includes a state of the application, which is obtained based on an interaction of the user with the application on the user device;

a state transition determiner configured for determining the state transition based on the state of the application;

a transition object determiner configured for identifying an object related to the state transition;

an object LWM generator configured for

selecting a subset of parameters from a plurality of parameters, that are needed to render the object on the user device,

determining a value for each of the subset of parameters, and

generating a light weight model (LWM) of the object based on the values of the subset of parameters; and

a transition instruction generator configured for sending, as a response to the first request, the LWM of the object to the application client so that the LWM is to be personalized with respect to additional parameters by the application client based on information related to the user.

24. The system of claim 23, wherein a combination of the subset of parameters and the additional parameters corresponds to the plurality of parameters.

25. The system of claim 24, wherein values of the additional parameters are determined based on sensor data acquired by the user device, wherein the sensor data capture information of the user and/or surrounding near the user.

26. The system of claim 25, wherein the values of the additional parameters are determined based on at least one of:

one or more features related to the user extracted based on the sensor data;

at least one feature associated with the surrounding of the user; and

previously known information about preferences of the user.

27. The system of claim 23, further comprising;

an application server controller configured for processing a second request from the application client for further parameters of the object, wherein the further parameters are included in the plurality of parameters of the object; and

a further inquiry response generator configured for

retrieving values of the further parameters, and

sending the values of the further parameters to the application client as a response to the second request.