METHOD AND APPARATUS FOR AUTOMATED DECISION MAKING

• US 20190318254A1
• Filed: 12/14/2017
• Published: 10/17/2019
• Est. Priority Date: 12/15/2016
• Status: Active Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: LOBETE, Daniel Ansorregui, SARAVANAN, Karthikeyan Palavedu
• Application Number:
  US16/468,597
• Publication Number:
  US 20190318254A1
• Time in Patent Office: Days
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06N 3/006 based on simulated virtual individual or collective life forms, e.g. social simulations or particle swarm optimisation [PSO]
• CPC Class Codes: G06N 3/08 Learning methods
• CPC Class Codes: G06N 5/045 Explanation of inference; Explainable artificial intelligence [XAI]; Interpretable artificial intelligence

Abstract

A method for a first electronic device comprises generating a decision-making data structure using a machine learning data structure; transmitting, to a second electronic device, the decision-making data structure; receiving, from the electronic device, result data regarding a result of performing a selected action selected from the decision-making data structure; and updating the machine learning data structure using the result data.

Claims

1. A method for operating a first electronic device, the method comprising:

generating a decision-making data structure using a machine learning data structure;

transmitting, to a second electronic device, the decision-making data structure;

receiving, from the electronic device, result data regarding a result of performing a selected action selected from the decision-making data structure; and

updating the machine learning data structure using the result data.

2. The method of claim 1,

wherein the machine learning data structure comprises data regarding a plurality of states, and data regarding a plurality of possible actions for each of the plurality of states, and

wherein the decision-making data structure comprises data regarding the plurality of states, and data regarding one action for each of the plurality of states.

3. The method of claim 2,

wherein the machine learning data structure further comprises a rating value associated with each of the plurality of possible actions for each of the plurality of states, and

wherein the one action for each of the plurality of states in the decision-making data structure corresponds to an action with a highest rating value among the plurality of possible actions for each of the plurality of states in the machine learning data structure.

4. The method of claim 3,

wherein the machine learning data structure further comprises a Q-table regarding Q-value of each of the plurality of possible actions for each of the plurality of states,

wherein the one action for each of the plurality of states in the decision-making data structure corresponds to an action with a highest Q-value for each of the plurality of states in the Q-table.

5. The method of claim 4,

wherein the decision-making data structure further comprises a look-up table regarding each of the plurality of states and the action with the highest Q-value.

6. An apparatus of a first electronic device, the apparatus comprising:

a memory storing a machine learning data structure;

a transceiver; and

at least one processor,

wherein the at least one processor is configured to;

generate a decision-making data structure using the machine learning data structure,

control the transceiver to transmit, to a second electronic device, the decision-making data structure,

control the transceiver to receive, from the second electronic device, result data regarding a result of performing a selected action selected from the decision-making data structure, and

update the machine learning data structure stored in the memory using the result data.

7. The apparatus of claim 6,

wherein the machine learning data structure comprises data regarding a plurality of states, and data regarding a plurality of possible actions for each of the plurality of states, and

wherein the decision-making data structure comprises data regarding the plurality of states, and data regarding one action for each of the plurality of states.

8. The apparatus of claim 7,

wherein the machine learning data structure further comprises a rating value associated with each of the plurality of possible actions for each of the plurality of states, and

wherein the one action for each of the plurality of states in the decision-making data structure corresponds to an action with a highest rating value among the plurality of possible actions for each of the plurality of states in the machine learning data structure.

9. The apparatus of claim 8,

wherein the machine learning data structure further comprises a Q-table regarding Q-value of each of the plurality of possible actions for each of the plurality of states,

wherein the one action for each of the plurality of states in the decision-making data structure corresponds to an action with a highest Q-value for each of the plurality of states in the Q-table.

10. The apparatus of claim 9,

wherein the decision-making data structure further comprises a look-up table regarding each of the plurality of states and the action with the highest Q-value.

11. An apparatus of a second electronic device, the apparatus comprising:

a memory;

at least one sensor;

a transceiver; and

at least one processor,

wherein the at least one processor is configured to;

control the transceiver to receive, from a first electronic device, a decision-making data structure,

control the at least one sensor to obtain state information on a current state of the second electronic device,

select an action from the decision-making data structure using the state information,

perform the selected action, and

control the transceiver to transmit, to the first electronic device, result data regarding a result of the performing the selected action,

wherein the decision-making data structure is generated using a machine learning data structure.

12. The apparatus of claim 11,

wherein the machine learning data structure comprises data regarding a plurality of states, and data regarding a plurality of possible actions for each of the plurality of states, and

wherein the decision-making data structure comprises data regarding the plurality of states, and data regarding one action for each of the plurality of states.

13. The apparatus of claim 12,

wherein the machine learning data structure further comprises a rating value associated with each of the plurality of possible actions for each of the plurality of states, and

wherein the one action for each of the plurality of states in the decision-making data structure corresponds to an action with a highest rating value among the plurality of possible actions for each of the plurality of states in the machine learning data structure.

14. The apparatus of claim 13,

wherein the machine learning data structure further comprises a Q-table regarding Q-value of each of the plurality of possible actions for each of the plurality of states,

wherein the one action for each of the plurality of states in the decision-making data structure corresponds to an action with a highest Q-value for each of the plurality of states in the Q-table.

15. The apparatus of claim 14,

wherein the decision-making data structure further comprises a look-up table regarding each of the plurality of states and the action with the highest Q-value.