Automated enhancements for billiards and the like

• US 8,727,875 B2
• Filed: 07/27/2009
• Issued: 05/20/2014
• Est. Priority Date: 07/27/2009
• Status: Expired due to Fees

• Current Assignee: Obscura Digital LLC
• Original Assignee: Obscura Digital LLC
• Inventors: Lundback, Niklas, Mason, Steve, Harville, Michael, Cornell, Nikolai, Threlkel, Travis
• Primary Examiner(s): Lewis, David L
• Assistant Examiner(s): LEICHLITER, CHASE E
• Application Number:
  US12/510,247
• Publication Number:
  US 20110021256A1
• Time in Patent Office: 1,758 Days
• Field of Search: 463/1, 463/2, 463/4, 463/31, 463/30, 463 33- 35, 473/1, 473/2, 273/118.R, 702/150
• US Class Current: 463/31
• CPC Class Codes: A63D 15/20 Scoring or registering devices
• CPC Class Codes: A63F 2009/2435 using a video camera
• CPC Class Codes: A63F 2009/2463 on a screen, e.g. using a video projector
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: G06F 18/00 Pattern recognition

Abstract

Position data is generated. The position data describes real-time positions of each of one or more billiard balls moving on a playing surface of a billiard table. Imagery is displayed on the playing surface. The imagery dynamically responds to the position data as the one or more billiard balls move on the playing surface.

Claims

1. A machine-implemented method, comprising:

by apparatus

generating position data describing real-time positions of each of one or more billiard balls moving on a playing surface of a billiard table,

displaying on the playing surface imagery that dynamically responds to the position data as the one or more billiard balls move on the playing surface,

capturing images comprising the playing surface, and

determining whether a static arrangement of multiple of the billiard balls detected in one or more of the captured images matches a prescribed pattern, wherein the determining comprises determining whether the static arrangement of the billiard balls matches a prescribed pattern of racked balls, and wherein the displaying comprises displaying imagery on the billiard table in response to a determination that the static arrangement matches the prescribed pattern of racked balls.

2. The method of claim 1, further comprising capturing images comprising the playing surface and detecting a billiard ball rack in one or more of the captured images;

and wherein the displaying comprises displaying imagery on the billiard table in response to a detection of the billiard ball rack.

3. A machine-implemented method, comprising:

by apparatus

generating position data describing real-time positions of each of one or more billiard balls moving on a playing surface of a billiard table,

displaying on the playing surface imagery that dynamically responds to the position data as the one or more billiard balls move on the playing surface,

capturing images comprising the playing surface, and

automatically ascertaining a type of a billiards game being played on the billiard table based on an evaluation of one or more of the captured images.

4. The method of claim 3, further comprising detecting occurrence of an event relating to the ascertained type of billiards game based on analysis of one or more of the captured images;

and wherein the displaying comprises selecting event-specific imagery associated with the detected event, and displaying the selected event-specific imagery on the billiard table in response to the detection of the event.

5. The method of claim 4, wherein the detecting comprises detecting an occurrence of a rule violation event corresponding to a failure of comply with a rule of the ascertained type of billiards game based on the analysis of one or more of the captured images;

and wherein the displaying comprises selecting event-specific imagery associated with the detected rule violation event, and displaying the selected event-specific imagery on the billiard table in response to the detection of the event.

6. A machine-implemented method, comprising:

by apparatus

generating position data describing real-time positions of each of one or more billiard balls moving on a playing surface of a billiard table,

determining whether one of the billiard balls has fallen into a pocket of the billiard table, and

displaying on the playing surface imagery that dynamically responds to the position data as the one or more billiard balls move on the playing surface,

wherein, in response to a determination that the billiard ball has fallen in the pocket, the displaying comprises selecting event-specific imagery associated with an event of a billiard ball falling into a pocket and displaying the selected event-specific imagery on the billiard table.

7. The method of claim 6, wherein the determining comprises determining whether a cue ball has fallen into a pocket of the billiard table, and the displaying comprises displaying on the billiard table event-specific imagery associated with a scratch event.

8. The method of claim 7, wherein, in response to a determination that the cue ball has fallen into the pocket, the displaying comprises displaying on the billiard table event-specific imagery prompting removal of the cue ball from the pocket.

9. The method of claim 7, wherein, in response to a determination that the cue ball has fallen into the pocket, the displaying comprises displaying on the billiard table event-specific imagery demarcating a region on the playing surface where the cue ball should be placed.

10. The method of claim 6, further comprising capturing images comprising the playing surface;

and wherein the determining comprises determining whether one of the billiard balls has fallen into a pocket of the billiard table based on an analysis of the captured images.

11. The method of claim 6, further comprising,

in each pocket of the billiard table, sensing a presence of a billiard ball and generating an associated signal indicating the presence of a billiard ball in response to a sensed presence of a billiard ball in the pocket;

and

wherein the determining comprises determining whether one of the billiard balls has fallen into a pocket of the billiard table based on an analysis of the signal associated with the pocket.

12. The method of claim 6, further comprising determining whether one of the billiard balls has fallen into a pocket of the billiard table, and producing an audible sound in response to a determination that the billiard ball has fallen in the pocket.

13. The method of claim 6, wherein the displaying comprises, based on the position data, displaying one or more visible dynamic artifacts trailing at least one of the billiard balls moving on the playing surface.

14. The method of claim 6, wherein the displaying comprises, based on the position data, displaying on the playing surface imagery showing a scene and local disturbances to local regions of the scene near one or more of the billiard balls moving on the playing surface.

15. The method of claim 6, wherein the displaying comprises, based on the position data, displaying on the playing surface imagery showing a scene that is visible only in regions that are revealed near positions of one or more of the billiard balls on the playing surface.

16. The method of claim 6, wherein the displaying comprises, based on the position data, displaying one or more visible artifacts connecting respective pairs of billiard balls.

17. The method of claim 6, wherein the displaying comprises, based on the position data, displaying on the playing surface a visualization of a virtual billiards shot from a current state of a billiards game being played on the billiard table.

18. The method of claim 6, further comprising detecting a collision between two or more billiard balls based on the position data;

and wherein the displaying comprises displaying imagery in response to detection of the collision.

19. The method of claim 6, further comprising determining when a billiard ball contacts a bumper of the billiard table;

and wherein the displaying comprises displaying a visible special effect in association with the bumper in response to a determination that a billiard ball has contacted the bumper.

20. The method of claim 6, wherein the displaying comprises, based on the position data, displaying a respective illumination around each of at least one of the one or more billiard balls on the playing surface.

21. The method of claim 6, further comprising producing an audible sound based on the position data.

22. The method of claim 21, further comprising detecting a collision between two or more billiard balls based on the position data, and the producing comprises producing an audible sound in response to detection of the collision.

23. The method of claim 21, further comprising determining when a billiard ball contacts a bumper of the billiard table based on the position data, and the producing comprises producing an audible sound in response to a determination that the billiard ball has contacted the bumper.

24. The method of claim 6, further comprising:

based on the position data, detecting an end-of-game event associated with a completion of the billiard game being played on the billiard table; and

in response to the detection of the end-of-game event, displaying on the playing surface imagery relating to one or more advertisements.

25. The method of claim 6, further comprising:

based on the position data, detecting an end-of-shot event associated with an end of a shot taken on the billiard table; and

in response to the detection of the end-of-shot event, displaying on the playing surface imagery relating to one or more advertisements.

26. The method of claim 6, further comprising recording a video of a billiard ball shot being taken in a billiards game that is being played on the billiards table;

and wherein the displaying comprises displaying on the playing surface imagery showing a replay of the billiard ball shot based on the recorded video.

27. The method of claim 6, further comprising recording a video of a billiards game that is being played on the billiards table;

and wherein the displaying comprises based on the recorded video displaying on the playing surface imagery showing a replay of a sequence of billiard ball shots that were taken during the billiards game.

28. The method of claim 6, wherein the generating comprises optically tracking the real-time positions of the one or more billiard balls on the playing surface during the displaying.

29. The method of claim 28, wherein the generating comprises capturing images comprising the playing surface, and detecting respective billiard ball regions corresponding to respective ones of the one or more billiard balls in the captured images.

30. The method of claim 29, wherein the detecting comprises generating respective gradient maps based on the captured images, and determining the respective billiard ball regions based on the gradient maps.

31. The method of claim 30, wherein the determining comprises blurring the gradient maps, thresholding the blurred gradient maps, and determining the respective billiard ball regions based on the blurred gradient maps.

32. The method of claim 31, wherein the determining comprises identifying blobs in the blurred gradient maps based on a connected components analysis of the blurred gradient maps, and classifying each of the blobs as blobs as either a billiard ball region or a non-billiard-ball region based on an evaluation of the blob.

33. The method of claim 29, wherein the generating comprises:

labeling each of the detected billiard ball regions in a first one of the captured images with a respective unique label; and

matching the labeled billiard ball regions to billiard ball regions in a second one of the captured images that was captured after the first captured image was captured.

34. The method of claim 6, further comprising determining real-time velocities of each of one or more billiard balls on the playing surface.

35. The method of claim 34, wherein the displaying comprises displaying imagery that depends on the determined real-time velocities of the one or more billiard balls.

36. The method of claim 34, further comprising predicting a respective future trajectory of each of one or more billiard balls on the playing surface based on the current respective position and the current respective velocity of the billiard ball, and the displaying comprises displaying imagery on the playing surface based on the respective future trajectory of each of one or more billiard balls on the playing surface.

37. The method of claim 6, further comprising detecting a cue stick, and wherein the displaying comprises changing one or more parameters influencing visual appearance of the displayed imagery on the playing surface in response to detection of the cue stick over the playing surface.

38. The method of claim 6, further comprising detecting one or more positions of a cue stick, and wherein the displaying comprises displaying imagery based on the one or more detected positions of the cue stick.

39. The method of claim 6, further comprising capturing images comprising the playing surface and detecting occurrence of an event relating to a start of a billiards game;

and wherein the displaying comprises displaying on the billiard table imagery associated with a start of a billiards game.

40. The method of claim 6, further comprising capturing images comprising the playing surface, tracking a score of a billiards game being played based on analysis of the captured images, and displaying the tracked score of the billiards game on the billiard table.

41. A machine-implemented method, comprising:

by apparatus

generating position data describing real-time positions of each of one or more billiard balls moving on a playing surface of a billiard table,

displaying on the playing surface imagery that dynamically responds to the position data as the one or more billiard balls move on the playing surface,

establishing a respective identity of each of one or more of the billiard balls,

detecting an event involving the one or more of the billiard balls whose identities have been established, and

in response to the detection of the events, producing near the billiard table a perceptible effect that depends on the established identity of each of the one or more billiard balls involved in the event;

wherein the detecting comprises detecting a start-of-game event based on the established identities of the one or more billiard balls, and in response to a detection of the start-of-game event the producing comprises producing an event-specific perceptible effect associated with a start of a billiards game.

42. A machine-implemented method, comprising:

by apparatus

generating position data describing real-time positions of each of one or more billiard balls moving on a playing surface of a billiard table,

displaying on the playing surface imagery that dynamically responds to the position data as the one or more billiard balls move on the playing surface,

establishing a respective identity of each of one or more of the billiard balls,

detecting an event involving the one or more of the billiard balls whose identities have been established, and

in response to the detection of the events, producing near the billiard table a perceptible effect that depends on the established identity of each of the one or more billiard balls involved in the event;

wherein the detecting comprises detecting a scoring event based on the established identities of the one or more billiard balls, and in response to a detection of the scoring event the producing comprises producing an event-specific perceptible effect associated with a score of a billiards game.

43. A machine-implemented method, comprising:

by apparatus

generating position data describing real-time positions of each of one or more billiard balls moving on a playing surface of a billiard table,

displaying on the playing surface imagery that dynamically responds to the position data as the one or more billiard balls move on the playing surface,

establishing a respective identity of each of one or more of the billiard balls,

detecting an event involving the one or more of the billiard balls whose identities have been established, and

in response to the detection of the events, producing near the billiard table a perceptible effect that depends on the established identity of each of the one or more billiard balls involved in the event;

wherein the detecting comprises detecting a billiard game rules violation event based on the established identities of the one or more billiard balls, and in response to a detection of the rules violation event the producing comprises producing an event-specific perceptible effect associated with a billiards game rules violation.

44. A machine-implemented method, comprising:

by apparatus

generating position data describing real-time positions of each of one or more billiard balls moving on a playing surface of a billiard table,

displaying on the playing surface imagery that dynamically responds to the position data as the one or more billiard balls move on the playing surface,

establishing a respective identity of each of one or more of the billiard balls,

detecting an event involving the one or more of the billiard balls whose identities have been established, and

in response to the detection of the events, producing near the billiard table a perceptible effect that depends on the established identity of each of the one or more billiard balls involved in the event;

wherein the detecting comprises detecting an end-of-game event based on the established identities of the one or more billiard balls, and in response to a detection of the end-of-game event the producing comprises producing an event-specific perceptible effect associated with an end of a billiards game.