AUTOMATED ENHANCEMENTS FOR BILLIARDS AND THE LIKE

• US 20110021256A1
• Filed: 07/27/2009
• Published: 01/27/2011
• Est. Priority Date: 07/27/2009
• Status: Active Grant

• Current Assignee: Obscura Digital LLC
• Original Assignee: Obscura Digital LLC
• Inventors: Cornell, Nikolai, Threlkel, Travis, Lundback, Niklas, Mason, Steve, Harville, Michael
• Granted Patent: US 8,727,875 B2
• Time in Patent Office: Days
• US Class Current: 463/2
• CPC Class Codes: A63D 15/20 Scoring or registering devices
• CPC Class Codes: A63F 2009/2435 using a video camera
• CPC Class Codes: A63F 2009/2463 on a screen, e.g. using a video projector
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: G06F 18/00 Pattern recognition

Abstract

Position data is generated. The position data describes real-time positions of each of one or more billiard balls moving on a playing surface of a billiard table. Imagery is displayed on the playing surface. The imagery dynamically responds to the position data as the one or more billiard balls move on the playing surface.

Claims

1. A machine-implemented method, comprising:

generating position data describing real-time positions of each of one or more billiard balls moving on a playing surface of a billiard table; and

displaying on the playing surface imagery that dynamically responds to the position data as the one or more billiard balls move on the playing surface.

2. The method of claim 1, wherein the generating comprises optically tracking the real-time positions of the one or more billiard balls on the playing surface during the displaying.

3. The method of claim 2, wherein the generating comprises capturing images comprising the playing surface, and detecting respective billiard ball regions corresponding to respective ones of the one or more billiard balls in the captured images.

4. The method of claim 3, wherein the detecting comprises generating respective gradient maps based on the captured images, and determining the respective billiard ball regions based on the gradient maps.

5. The method of claim 4, wherein the determining comprises blurring the gradient maps, thresholding the blurred gradient maps, and determining the respective billiard ball regions based on the blurred gradient maps.

6. The method of claim 5, wherein the determining comprises identifying blobs in the blurred gradient maps based on a connected components analysis of the blurred gradient maps, and classifying each of the blobs as blobs as either a billiard ball region or a non-billiard-ball region based on an evaluation of the blob.

7. The method of claim 3, wherein the generating comprises:

labeling each of the detected billiard ball regions in a first one of the captured images with a respective unique label; and

matching the labeled billiard ball regions to billiard ball regions in a second one of the captured images that was captured after the first captured image was captured.

8. The method of claim 1, further comprising determining real-time velocities of each of one or more billiard balls on the playing surface.

9. The method of claim 8, wherein the displaying comprises displaying imagery that depends on the determined real-time velocities of the one or more billiard balls.

10. The method of claim 8, further comprising predicting a respective future trajectory of each of one or more billiard balls on the playing surface based on the current respective position and the current respective velocity of the billiard ball, and the displaying comprises displaying imagery on the playing surface based on the respective future trajectory of each of one or more billiard balls on the playing surface.

11. The method of claim 1, further comprising detecting a cue stick, and wherein the displaying comprises changing one or more parameters influencing visual appearance of the displayed imagery on the playing surface in response to detection of the cue stick over the playing surface.

12. The method of claim 1, further comprising detecting one or more positions of a cue stick, and wherein the displaying comprises displaying imagery based on the one or more detected positions of the cue stick.

13. The method of claim 1, further comprising capturing images comprising the playing surface and determining whether a static arrangement of multiple of the billiard balls detected in one or more of the captured images matches a prescribed pattern.

14. The method of claim 13, wherein the ascertaining comprises determining whether the static arrangement of the billiard balls matches a prescribed pattern of racked balls, and wherein the displaying comprises displaying imagery on the billiard table in response to a determination that the static arrangement matches the prescribed pattern of racked balls.

15. The method of claim 1, further comprising capturing images comprising the playing surface and detecting a billiard ball rack in one or more of the captured images;

and wherein the displaying comprises displaying imagery on the billiard table in response to a detection of the billiard ball rack.

16. The method of claim 1, further comprising capturing images comprising the playing surface, and automatically ascertaining a type of a billiards game being played on the billiard table based on an evaluation of one or more of the captured images.

17. The method of claim 16, further comprising detecting occurrence of an event relating to the ascertained type of billiards game based on analysis of one or more of the captured images;

and wherein the displaying comprises selecting event-specific imagery associated with the detected event, and displaying the selected event-specific imagery on the billiard table in response to the detection of the event.

18. The method of claim 17, wherein the detecting comprises detecting an occurrence of a rule violation event corresponding to a failure of comply with a rule of the ascertained type of billiards game based on the analysis of one or more of the captured images;

and wherein the displaying comprises selecting event-specific imagery associated with the detected rule violation event, and displaying the selected event-specific imagery on the billiard table in response to the detection of the event.

19. The method of claim 1, further comprising capturing images comprising the playing surface and detecting occurrence of an event relating to a start of a billiards game;

and wherein the displaying comprises displaying on the billiard table imagery associated with a start of a billiards game.

20. The method of claim 1, further comprising capturing images comprising the playing surface, tracking a score of a billiards game being played based on analysis of the captured images, and displaying the tracked score of the billiards game on the billiard table.

21. The method of claim 1, further comprising determining whether one of the billiard balls has fallen into a pocket of the billiard table;

and wherein, in response to a determination that the billiard ball has fallen in the pocket, the displaying comprises selecting event-specific imagery associated with an event of a billiard ball falling into a pocket and displaying the selected event-specific imagery on the billiard table.

22. The method of claim 21, wherein the determining comprises determining whether a cue ball has fallen into a pocket of the billiard table, and the displaying comprises displaying on the billiard table event-specific imagery associated with a scratch event.

23. The method of claim 22, wherein, in response to a determination that the cue ball has fallen into the pocket, the displaying comprises displaying on the billiard table event-specific imagery prompting removal of the cue ball from the pocket.

24. The method of claim 22, wherein, in response to a determination that the cue ball has fallen into the pocket, the displaying comprises displaying on the billiard table event-specific imagery demarcating a region on the playing surface where the cue ball should be placed.

25. The method of claim 21, further comprising capturing images comprising the playing surface;

and wherein the determining comprises determining whether one of the billiard balls has fallen into a pocket of the billiard table based on an analysis of the captured images.

26. The method of claim 21, further comprising,

in each pocket of the billiard table, sensing a presence of a billiard ball and generating an associated signal indicating the presence of a billiard ball in response to a sensed presence of a billiard ball in the pocket;

and

wherein the determining comprises determining whether one of the billiard balls has fallen into a pocket of the billiard table based on an analysis of the signal associated with the pocket.

27. The method of claim 1, further comprising determining whether one of the billiard balls has fallen into a pocket of the billiard table, and producing an audible sound in response to a determination that the billiard ball has fallen in the pocket.

28. The method of claim 1, wherein the displaying comprises, based on the position data, displaying one or more visible dynamic artifacts trailing at least one of the billiard balls moving on the playing surface.

29. The method of claim 1, wherein the displaying comprises, based on the position data, displaying on the playing surface imagery showing a scene and local disturbances to local regions of the scene near one or more of the billiard balls moving on the playing surface.

30. The method of claim 1, wherein the displaying comprises, based on the position data, displaying on the playing surface imagery showing a scene that is visible only in regions that are revealed near positions of one or more of the billiard balls on the playing surface.

31. The method of claim 1, wherein the displaying comprises, based on the position data, displaying one or more visible artifacts connecting respective pairs of billiard balls.

32. The method of claim 1, wherein the displaying comprises, based on the position data, displaying on the playing surface a visualization of a virtual billiards shot from a current state of a billiards game being played on the billiard table.

33. The method of claim 1, further comprising detecting a collision between two or more billiard balls based on the position data;

and wherein the displaying comprises displaying imagery in response to detection of the collision.

34. The method of claim 1, further comprising determining when a billiard ball contacts a bumper of the billiard table;

and wherein the displaying comprises displaying a visible special effect in association with the bumper in response to a determination that a billiard ball has contacted the bumper.

35. The method of claim 1, wherein the displaying comprises, based on the position data, displaying a respective illumination around each of at least one of the one or more billiard balls on the playing surface.

36. The method of claim 1, further comprising producing an audible sound based on the position data.

37. The method of claim 36, further comprising detecting a collision between two or more billiard balls based on the position data, and the producing comprises producing an audible sound in response to detection of the collision.

38. The method of claim 36, further comprising determining when a billiard ball contacts a bumper of the billiard table based on the position data, and the producing comprises producing an audible sound in response to a determination that the billiard ball has contacted the bumper.

39. The method of claim 1, further comprising:

based on the position data, detecting an end-of-game event associated with a completion of the billiard game being played on the billiard table; and

in response to the detection of the end-of-game event, displaying on the playing surface imagery relating to one or more advertisements.

40. The method of claim 1, further comprising:

based on the position data, detecting an end-of-shot event associated with an end of a shot taken on the billiard table; and

in response to the detection of the end-of-shot event, displaying on the playing surface imagery relating to one or more advertisements.

41. The method of claim 1, further comprising:

establishing a respective identity of each of one or more of the billiard balls;

detecting an event involving the one or more of the billiard balls whose identities have been established; and

in response to the detection of the events, producing near the billiard table a perceptible effect that depends on the established identity of each of the one or more billiard balls involved in the event.

42. The method of claim 41, wherein the detecting comprises detecting a start-of-game event based on the established identities of the one or more billiard balls, and in response to a detection of the start-of-game event the producing comprises producing an event-specific perceptible effect associated with a start of a billiards game.

43. The method of claim 41, wherein the detecting comprises detecting a scoring event based on the established identities of the one or more billiard balls, and in response to a detection of the scoring event the producing comprises producing an event-specific perceptible effect associated with a score of a billiards game.

44. The method of claim 41, wherein the detecting comprises detecting a billiard game rules violation event based on the established identities of the one or more billiard balls, and in response to a detection of the rules violation event the producing comprises producing an event-specific perceptible effect associated with a billiards game rules violation.

45. The method of claim 41, wherein the detecting comprises detecting an end-of-game event based on the established identities of the one or more billiard balls, and in response to a detection of the end-of-game event the producing comprises producing an event-specific perceptible effect associated with an end of a billiards game.

46. The method of claim 1, further comprising recording a video of a billiard ball shot being taken in a billiards game that is being played on the billiards table;

and wherein the displaying comprises displaying on the playing surface imagery showing a replay of the billiard ball shot based on the recorded video.

47. The method of claim 1, further comprising recording a video of a billiards game that is being played on the billiards table;

and wherein the displaying comprises based on the recorded video displaying on the playing surface imagery showing a replay of a sequence of billiard ball shots that were taken during the billiards game.

48. Apparatus, comprising:

a computer-readable medium storing computer-readable instructions; and

a data processor coupled to the computer-readable medium, operable to execute the instructions, and based at least in part on the execution of the instructions operable to perform operations comprising

generating position data describing real-time positions of each of one or more billiard balls moving on a playing surface of a billiard table, and

displaying on the playing surface imagery that dynamically responds to the position data as the one or more billiard balls move on the playing surface.

49. At least one computer-readable medium having computer-readable program code embodied therein, the computer-readable program code adapted to be executed by a computer to implement a method comprising:

generating position data describing real-time positions of each of one or more billiard balls moving on a playing surface of a billiard table; and

displaying on the playing surface imagery that dynamically responds to the position data as the one or more billiard balls move on the playing surface.