System and method for conducting a game including a computer-controlled player

• US 7,892,080 B1
• Filed: 06/07/2007
• Issued: 02/22/2011
• Est. Priority Date: 10/24/2006
• Status: Expired due to Fees

• Current Assignee: Brain Games, LC
• Original Assignee: Fredrik Andreas Dahl
• Inventors: Dahl, Fredrik Andreas
• Primary Examiner(s): Elisca; Pierre E
• Application Number:
  US11/810,827
• Time in Patent Office: 1,356 Days
• Field of Search: 463/10, 463/21, 463/1
• US Class Current: 463/10
• CPC Class Codes: A63F 13/67 adaptively or by learning from player actions, e.g. skill level adjustment or by storing successful combat sequences for re-use
• CPC Class Codes: G06Q 20/202 Interconnection or interaction of plural electronic cash registers [ECR] or to host computer, e.g. network details, transfer of information from host to ECR or from ECR to ECR
• CPC Class Codes: G07F 17/32 for games, toys, sports, or amusements
• CPC Class Codes: G07F 17/3262 Player actions which determine the course of the game, e.g. selecting a prize to be won, outcome to be achieved, game to be played
• CPC Class Codes: G07F 17/3276 wherein the players compete, e.g. tournament
• CPC Class Codes: G07F 17/3288 Betting, e.g. on live events, bookmaking
• CPC Class Codes: G07F 17/3293 Card games, e.g. poker, canasta, black jack

Abstract

A system and method for conducting a game between at least one live player and at least one computer-controlled player includes executing a training program between at least two agents to generate probability weights correlating actions or meta-actions representing a set or sequenced set of actions with a probability that the action or meta-action will produce a game outcome meeting a specified criterion or specified criteria. A game is conducted in which at least one live player plays against at least one computer-controlled player in which the computer-controlled player selects actions at one or more of the decision nodes in the game based, at least in part, on the probability weights.

Claims

1. A system for conducting a game between at least one computer-controlled player and at least one live player, said game comprising at least one decision node at which an action is taken by said computer-controlled player and said live player, said game producing a game outcome, comprising:

a data processor;

a data storage in communication with said data processor, said data storage adapted to store instructions executable by said data processor, said instructions comprising a training program, said training program adapted to conduct said game among two or more agents controlled by said data processor to select actions at said decision nodes to produce game outcomes, said training program adapted to evaluate said game outcomes based on one or more predetermined criteria, said training program adapted to generate probability weights associating sets of one or more of said actions with a probability that said predetermined criteria will be met as a result of said set of one or more actions; and

a gaming device comprising;

a gaming device processor;

a gaming device interface in communication with said gaming device processor; and

a gaming device data storage in communication with said gaming device processor, said gaming device data storage adapted to store instructions executable by said gaming device processor to conduct said game, said instructions comprising a game program, said game program adapted to receive input including a wager from said live player through said gaming device interface and conduct said game to produce a game outcome by controlling said computer-controlled player against said live player, said computer-controlled player selecting at least one action at one or more of said decision nodes based, at least in part, on said probability weights, said game program adapted to evaluate said game outcome and resolve said wager.

2. The system of claim 1 further comprising a database storage device in communication with said gaming machine, said database storage device adapted to store said probability weights.

3. The system of claim 1 wherein said gaming machine data storage is adapted to store said probability weights.

4. The system of claim 1 wherein said training program is adapted to fix said probability weights such that said game outcomes produced by said gaming device leave said probability weights unaltered.

5. The system of claim 1 wherein said game program is adapted to reconstruct said probability weights such that game outcomes produced by said gaming device alter said probability weights.

6. The system of claim 1 wherein said game program is adapted to control said computer-controlled player to select sets of two or more actions at one or more of said decision nodes based, at least in part, on said probability weights.

7. The system of claim 1 wherein said game program is adapted to conduct a game in which each decision node includes the same actions available to said computer-controlled player and said live player.

8. The system of claim 1 wherein said game program is adapted to conduct a poker game in which said wager is contributed to a pot, said game outcome is determined by which of the computer-controlled player and live player wins said poker game, and at least a portion of said pot is distributed to said live player if said live player wins said poker game.

9. The system of claim 1 wherein said game program is adapted to conduct a game in which at least one of said actions at one or more of said decision nodes includes a wagering action to place an additional wager.

10. The system of claim 1 wherein said game program is adapted to conduct a game in which at least one of said actions at one or more of said decision nodes includes a fold action to terminate conduct of said game.

11. The system of claim 1 wherein said training program stored at said data storage further includes a learning program adapted to alter said agents'"'"' selections of actions at said decision nodes in the conduct of said game based on whether the actions selected in a prior game produce a game outcome meeting said predetermined criteria.

12. The system of claim 1 wherein said training program stored at said data storage further includes a learning program adapted to conduct a game with said agents selecting an initial set of actions, repeat the conduct of said game at least one time with said agents selecting a set of actions different from said initial set of actions, compare said game outcomes resulting from each set of actions, and alter said agents'"'"' selection of actions in subsequent games based whether any selected set of actions produced an outcome meeting said predetermined criteria.

13. The system of claim 1 wherein said training program stored at said data storage is adapted to control said agents to select actions using a neural net examining game outcomes of prior games to increase the probability that actions leading to a game outcome meeting said predetermined criteria will be selected and decrease the probability that actions leading to a game outcome not meeting said predetermined criteria will be selected.

14. The system of claim 1 wherein said actions include a wagering action such that said game outcome includes a win or loss of wagers, and wherein said predetermined criteria include a minimization of the maximum loss.

15. A system for conducting a game between at least one computer-controlled player and at least one live player, said game comprising at least one decision node at which an action is taken by said computer-controlled player and said live player, said game producing a game outcome, comprising:

a data processor;

a data storage in communication with said data processor, said data storage adapted to store instructions executable by said data processor, said instructions comprising a training program, said training program adapted to conduct said game among two or more agents controlled by said data processor, said training program including a plurality of meta-actions each representing a set of one or more of said actions, said training program adapted to control said agents to conduct said game multiple times using said meta-actions at said decision nodes to produce game outcomes, said training program adapted to evaluate said game outcomes based on one or more predetermined criteria, said training program adapted to generate probability weights associating meta-actions with a probability that said predetermined criteria will be met as a result of said meta-actions; and

a gaming device comprising;

a gaming device processor;

a gaming device interface in communication with said gaming device processor; and

a gaming device data storage in communication with said gaming device processor, said gaming device data storage adapted to store instructions executable by said gaming device processor to conduct said game, said instructions comprising a game program, said game program adapted to receive input including a wager from a player through said gaming device interface and conduct said game to produce a game outcome by controlling a gaming device controlled player against said player, said gaming device controlled player selecting at least one action at one or more of said decision nodes based, at least in part, on said probability weights, said game program adapted to evaluate said game outcome and resolve said wager.

16. The system of claim 15 further comprising a database storage device in communication with said gaming machine, said database storage device adapted to store said probability weights.

17. The system of claim 15 wherein said gaming machine data storage is adapted to store said probability weights.

18. The system of claim 15 wherein said training program is adapted to fix said probability weights such that said game outcomes produced by said gaming device leave said probability weights unaltered.

19. The system of claim 15 wherein said game program is adapted to reconstruct said probability weights such that game outcomes produced by said gaming device alter said probability weights.

20. The system of claim 15 wherein said game program is adapted to control said computer-controlled player to select meta-actions, each representing a set of one or more of said actions, at one or more of said decision nodes based, at least in part, on said probability weights.

21. The system of claim 15 wherein said game program is adapted to conduct a game in which each decision node includes the same actions available to said computer-controlled player and said live player.

22. The system of claim 15 wherein said game program is adapted to conduct a poker game in which said wager is contributed to a pot, said game outcome is determined by which of the computer-controlled player and live player wins said poker game, and at least a portion of said pot is distributed to said live player if said live player wins said poker game.

23. The system of claim 15 wherein said game program is adapted to conduct a game in which said action at one or more of said decision nodes includes a wagering action to place an additional wager.

24. The system of claim 15 wherein said game program is adapted to conduct a game in which said action at one or more of said decision nodes includes a fold action to terminate conduct of said game.

25. The system of claim 15 wherein said training program stored at said data storage further includes a learning program adapted to alter said agents'"'"' selections of actions at said decision nodes in the conduct of said game based on whether the actions selected in a prior game produce a game outcome meeting said predetermined criteria.

26. The system of claim 15 wherein said training program stored at said data storage further includes a learning program adapted to conduct a game with said agents selecting initial meta-actions, repeat the conduct of said game at least one time with said agents selecting meta-actions different from said initial meta-actions, compare said game outcomes resulting from each meta-action, and alter said agents'"'"' selection of meta-actions in subsequent games based whether any selected meta-actions produced an outcome meeting said predetermined criteria.

27. The system of claim 15 wherein said training program stored at said data storage is adapted to control said agents to select meta-actions using a neural net examining game outcomes of prior games to increase the probability that meta-actions leading to a game outcome meeting said predetermined criteria will be selected and decrease the probability that meta-actions leading to a game outcome not meeting said predetermined criteria will be selected.

28. The system of claim 15 wherein said actions include a wagering action such that said game outcome includes a win or loss of wagers, and wherein said predetermined criteria include a minimization of the maximum loss.

29. A system for conducting a game between at least one computer-controlled player and at least one live player, said game comprising at least one decision node at which an action is taken by said computer-controlled player and said live player, said game producing a game outcome, comprising:

a data processor;

a data storage in communication with said data processor, said data storage adapted to store instructions executable by said data processor, said instructions comprising a training program, said training program adapted to conduct said game among two or more agents controlled by said data processor, said training program including a plurality of meta-actions each representing a sequence of two or more of said actions, said training program adapted to control said agents to conduct said game multiple times using said meta-actions at said decision nodes to produce game outcomes, said training program adapted to evaluate said game outcomes based on one or more predetermined criteria, said training program adapted to generate probability weights associating meta-actions with a probability that said predetermined criteria will be met as a result of said meta-actions; and

a gaming device comprising;

a gaming device processor;

a gaming device interface in communication with said gaming device processor; and

a gaming device data storage in communication with said gaming device processor, said gaming device data storage adapted to store said probability weights in a fixed form such that game outcomes produced by said gaming device leave said probability weights unaltered and instructions executable by said gaming device processor to conduct said game, said instructions comprising a game program, said game program adapted to receive input including a wager from said live player through said gaming device interface and conduct said game to produce a game outcome by controlling said computer-controlled player against said live player, said computer-controlled player selecting actions at said decision nodes randomly based on said probability weights, said game program adapted to evaluate said game outcome and resolve said wager.

30. The system of claim 29 further comprising a database storage device in communication with said gaming machine, said database storage device adapted to store said probability weights.

31. The system of claim 29 wherein said game program is adapted to control said computer-controlled player to select meta-actions each representing a sequence of one or more of said actions at one or more of said decision nodes based on said probability weights.

32. The system of claim 29 wherein said game program is adapted to conduct a game in which each decision node includes the same actions available to said computer-controlled player and said live player.

33. The system of claim 29 wherein said game program is adapted to conduct a poker game in which said wager is contributed to a pot, said game outcome is determined by which of the computer-controlled player and live player wins said poker game, and at least a portion of said pot is distributed to said live player if said live player wins said poker game.

34. The system of claim 29 wherein said game program is adapted to conduct a game in which said action at one or more of said decision nodes includes a wagering action to place an additional wager.

35. The system of claim 29 wherein said game program is adapted to conduct a game in which said action at one or more of said decision nodes includes a fold action to terminate conduct of said game.

36. The system of claim 29 wherein said training program stored at said data storage further includes a learning program adapted to alter said agents'"'"' selections of actions at said decision nodes in the conduct of said game based on whether the actions selected in a prior game produce a game outcome meeting said predetermined criteria.

37. The system of claim 29 wherein said training program stored at said data storage further includes a learning program adapted to conduct a game with said agents selecting initial meta-actions, repeat the conduct of said game at least one time with said agents selecting meta-actions different from said initial meta-actions, compare said game outcomes resulting from each meta-action, and alter said agents'"'"' selection of meta-actions in subsequent games based whether any selected meta-actions produced an outcome meeting said predetermined criteria.

38. The system of claim 29 wherein said training program stored at said data storage is adapted to control said agents to select meta-actions using a neural net examining game outcomes of prior games to increase the probability that meta-actions leading to a game outcome meeting said predetermined criteria will be selected and decrease the probability that meta-actions leading to a game outcome not meeting said predetermined criteria will be selected.

39. The system of claim 29 wherein said actions include a wagering action such that said game outcome includes a win or loss of wagers, and wherein said predetermined criteria include a minimization of the maximum loss.

40. A method for conducting a game between at least one computer-controlled player and at least one live player, said game comprising at least one decision node at which an action is taken by said computer-controlled player and said live player, said game producing a game outcome, comprising:

generating probability weights comprising;

conducting multiple iterations of said game among two or more agents controlled by a data processor, each said iteration using a meta-action representing a sequence of two or more of said actions at said decision nodes to produce game outcomes;

evaluating said game outcomes based on one or more predetermined criteria; and

associating meta-actions with a probability weight that said predetermined criteria will be met as a result of said meta-actions; and

conducting said game comprising;

receiving input including a wager from said live player;

producing a game outcome by controlling said computer-controlled player against said live player, said computer-controlled player selecting at least one action at one or more of said decision nodes randomly based, at least in part, on said probability weights;

evaluating said game outcome; and

resolving said wager.

41. The method of claim 40 wherein said step of generating said probability weights further comprises fixing said probability weights such that said game outcomes produced while conducting said game leave said probability weights unaltered.

42. The method of claim 40 further comprising reconstructing said probability weights such that game outcomes produced while conducting said game alter said probability weights.

43. The method of claim 40 wherein said step of producing a game outcome comprises controlling said computer-controlled player to select meta-actions each representing a sequence of two or more of said actions at one or more of said decision nodes based, at least in part, on said probability weights.

44. The method of claim 40 wherein said step of producing a game outcome comprises conducting a game in which each decision node includes the same actions available to the computer-controlled player and the live player.

45. The method of claim 40 wherein said step of producing a game outcome comprises conducting a poker game in which said wager is contributed to a pot, said game outcome is determined by which of the computer-controlled player and live player wins said poker game, and at least a portion of said pot is distributed to said live player if said live player wins said poker game.

46. The method of claim 40 wherein said step of producing a game outcome comprises conducting a game in which at least one of said actions at one or more of said decision nodes includes a wagering action to place an additional wager.

47. The method of claim 40 wherein said step of producing a game outcome comprises conducting a game in which at least one of said actions at one or more of said decision nodes includes a fold action to terminate conduct of said game.

48. The method of claim 40 wherein said step of generating said probability weights further comprises altering said agents'"'"' selections of actions at said decision nodes in the conduct of said game based on whether the actions selected in a prior game produce a game outcome meeting said predetermined criteria.

49. The method of claim 40 wherein said step of generating said probability weights further comprises:

conducting a game with said agents selecting initial meta-actions;

repeating the conduct of said game at least one time with said agents selecting meta-actions different from said initial meta-actions;

comparing said game outcomes resulting from each meta-action; and

altering said agents'"'"' selection of meta-actions in subsequent games based whether any selected meta-actions produced an outcome meeting said predetermined criteria.

50. The method of claim 40 wherein said step of generating said probability weights comprises training said agents to select meta-actions using a neural net that examines game outcomes of prior games to increase the probability that meta-actions leading to a game outcome meeting said predetermined criteria will be selected and decrease the probability that meta-actions leading to a game outcome not meeting said predetermined criteria will be selected.

51. The method of claim 40 wherein said actions include a wagering action such that said game outcome includes a win or loss of wagers, and wherein said predetermined criteria include a minimization of the maximum loss.