Multiple-user processing device with intuitive learning capability

• US 8,214,307 B2
• Filed: 12/05/2008
• Issued: 07/03/2012
• Est. Priority Date: 06/26/2001
• Status: Expired due to Term

• Current Assignee: Intuition Intelligence Incorporated
• Original Assignee: Intuition Intelligence Incorporated
• Inventors: Ansari, Arif M, Shiek Ansari, Yusuf Sulaiman M
• Primary Examiner(s): Gaffin, Jeffrey A
• Assistant Examiner(s): Wong, Lut
• Application Number:
  US12/329,433
• Publication Number:
  US 20090138421A1
• Time in Patent Office: 1,306 Days
• Field of Search: 706/12
• US Class Current: 706/12
• CPC Class Codes: A63F 13/10 Control of the course of the game, e.g. start, progess, end
• CPC Class Codes: A63F 13/12 involving interaction between a plurality of game devices, e.g. transmisison or distribution systems protocols for networked virtual reality, networked games H04L29/06034
• CPC Class Codes: A63F 13/23 for interfacing with the game device, e.g. specific interfaces between game controller and console
• CPC Class Codes: A63F 13/30 Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
• CPC Class Codes: A63F 13/338 using television networks
• CPC Class Codes: A63F 13/45 Controlling the progress of the video game
• CPC Class Codes: A63F 13/67 adaptively or by learning from player actions, e.g. skill level adjustment or by storing successful combat sequences for re-use
• CPC Class Codes: A63F 13/798 for assessing skills or for ranking players, e.g. for generating a hall of fame computing the game score A63F13/46
• CPC Class Codes: A63F 2300/558 by assessing the players' skills or ranking
• CPC Class Codes: A63F 2300/6027 using adaptive systems learning from user actions, e.g. for skill level adjustment
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: H04N 21/44222 Analytics of user selections, e.g. selection of programs or purchase activity monitoring of user selections in data processing systems G06F11/34; arrangements for monitoring the user's behaviour or opinions in broadcast systems H04H60/33
• CPC Class Codes: H04N 21/443 OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
• CPC Class Codes: H04N 21/466 Learning process for intelligent management, e.g. learning user preferences for recommending movies services using the results of monitoring in broadcast systems H04H60/61
• CPC Class Codes: H04N 21/4751 for defining user accounts, e.g. accounts for children

Abstract

A processing device having one or more objectives is provided. The processing device comprises a probabilistic learning module having a learning automaton configured for learning a plurality of processor actions in response to a plurality of actions performed by a plurality of users, and an intuition module configured for modifying a functionality of said probabilistic learning module based on said one or more objectives.

Claims

1. A processing device having one or more objectives, comprising:

a processor;

a probabilistic learning module having a learning automaton that, when executed by a processor, is configured for learning a plurality of processor actions in response to a plurality of actions performed by a plurality of users, wherein said probabilistic learning module comprises;

one or more action selection modules configured for selecting one or more of a plurality of processor actions, said action selection being based on an action probability distribution comprising a plurality of probability values corresponding to said plurality of processor actions;

one or more outcome evaluation modules configured for determining one or more outcomes of one or both of said identified plurality of user actions and said selected one or more processor actions; and

a probability update module configured for updating said action probability distribution based on said one or more outcomes; and

an intuition module external to the probabilistic learning module, the intuition module, when executed by the processor, configured for dynamically and continuously modifying a functionality of said probabilistic learning module based on said one or more objectives by operating on any combination of said one or more action selection modules, one or more outcome evaluation modules, and said probability update module, wherein said dynamic modification is configured for being performed independent of the plurality of user actions.

2. The processing device of claim 1, wherein said intuition module is further configured for determining one or more performance indexes indicative of a performance of said probabilistic learning module relative to said one or more objectives, and for modifying said probabilistic learning module functionality based on said one or more performance indexes.

3. The processing device of claim 2, wherein said one or more performance indexes comprises a single performance index corresponding to said plurality of users.

4. The processing device of claim 2, wherein said one or more performance indexes comprises a plurality of performance indexes respectively corresponding to said plurality of users.

5. The processing device of claim 1, wherein said intuition module is configured for modifying a functionality of said one or more action selection modules based on said one or more objectives.

6. The processing device of claim 1, wherein said intuition module is configured for modifying a functionality of said one or more outcome evaluation modules based on said one or more objectives.

7. The processing device of claim 1, wherein said intuition module is configured for modifying a functionality of said probability update module based on said one or more objectives.

8. The processing device of claim 1, further comprising:

a server containing said one or more action selection modules, said one or more outcome evaluation modules, and said probability update module;

a plurality of computers configuring for respectively generating said identified plurality of user actions; and

a network configured for transmitting said identified plurality of user actions from said plurality of computers to said server and for transmitting said selected one or more processor actions from said server to said plurality of computers.

9. The processing device of claim 1, wherein said one or more action selection modules comprises a plurality of action selection modules, and said selected one or more processor actions comprises a plurality of processor actions, the processing device further comprising:

a server containing said one or more outcome evaluation modules, and said probability update module;

a plurality of computers configuring for respectively generating said identified plurality of user actions, said plurality of computers respectively containing said plurality of action selection modules; and

a network configured for transmitting said identified plurality of user actions and said selected plurality of processor actions from said plurality of computers to said server.

10. The processing device of claim 1, wherein said one or more action selection modules comprises a plurality of action selection modules, said selected one or more processor actions comprises a plurality of processor actions, said one or more outcome evaluation modules comprises a plurality of outcome evaluation modules, and said one or more outcomes comprises a plurality of outcomes, the processing device further comprising:

a server containing said probability update module;

a plurality of computers configuring for respectively generating said identified plurality of user actions, said plurality of computers respectively containing said plurality of action selection modules and said plurality of outcome evaluation modules; and

a network configured for transmitting said plurality of outcomes from said plurality of computers to said server.

11. The processing device of claim 1, wherein said plurality of users are divided amongst a plurality of user sets, and wherein said probabilistic learning module comprises:

one or more action selection modules configured for, each user set, selecting one or more of a plurality of processor actions, said action selection being based on an action probability distribution comprising a plurality of probability values corresponding to said plurality of processor actions;

one or more outcome evaluation modules configured for, for said each user set, determining one or more outcomes of one or both of one or more user actions and said selected one or more processor actions; and

one or more probability update modules configured for, for said each user set, updating said action probability distribution based on said one or more outcomes.

12. The processing device of claim 11, wherein said one or more outcome are of said selected one or more processor actions relative to said plurality of identified plurality of user actions.

13. The processing device of claim 11, wherein each user set comprises a single user.

14. The processing device of claim 11, wherein each user set comprises a plurality of users.

15. The processing device of claim 11, wherein said selected one or more processor actions comprises a single processor action corresponding to said identified plurality of user actions.

16. The processing device of claim 11, further comprising:

a server containing said one or more action selection modules, said one or more outcome evaluation modules, and said one or more probability update modules;

a plurality of computers configuring for respectively generating said identified plurality of user actions; and

a network configured for transmitting said identified plurality of user actions from said plurality of computers to said server and for transmitting said selected one or more processor actions from said server to said plurality of computers.

17. The processing device of claim 11, wherein said one or more action selection modules comprises a plurality of action selection modules, and said selected one or more processor actions comprises a plurality of processor actions, the processing device further comprising:

a server containing said one or more outcome evaluation modules and said one or more probability update modules;

a plurality of computers configuring for respectively generating said identified plurality of user actions, said plurality of computers respectively containing said plurality of action selection modules; and

a network configured for transmitting said identified plurality of user actions and said selected plurality of processor actions from said plurality of computers to said server.

18. The processing device of claim 11, wherein said one or more action selection modules comprises a plurality of action selection modules, said selected one or more processor actions comprises a plurality of processor actions, said one or more outcome evaluation modules comprises a plurality of outcome evaluation modules, and said one or more outcomes comprises a plurality of outcomes, the processing device further comprising:

a server containing said one or more probability update modules;

a plurality of computers configuring for respectively generating said identified plurality of user actions, said plurality of computers respectively containing said plurality of action selection modules and said plurality of outcome evaluation modules; and

a network configured for transmitting said plurality of outcomes from said plurality of computers to said server.

19. The processing device of claim 11, wherein said one or more action selection modules comprises a plurality of action selection modules, said selected one or more processor actions comprises a plurality of processor actions, said one or more outcome evaluation modules comprises a plurality of outcome evaluation modules, and said one or more outcomes comprises a plurality of outcomes, said one or more probability update modules comprises a plurality of update modules for updating said plurality of action probability distributions, the processing device further comprising:

a server containing said a module for generating a centralized action probability distribution based on said plurality of action probability distributions, said centralized action probability distribution used to initialize a subsequent plurality of action probability distributions;

a plurality of computers configuring for respectively generating said identified plurality of user actions, said plurality of computers respectively containing said plurality of action selection modules, said plurality of outcome evaluation modules, and said plurality of probability update modules; and

a network configured for transmitting said plurality of action probability distributions from said plurality of computers to said server, and said centralized action probability distribution from said server to said plurality of computers.