Reconfigurable control displays for games, toys, and other applications

• US 20050064936A1
• Filed: 09/07/2004
• Published: 03/24/2005
• Est. Priority Date: 07/07/2000
• Status: Active Grant

• Current Assignee: Gesture Technology Partners, LLC
• Original Assignee: Timothy R. Pryor
• Inventors: Pryor, Timothy R.
• Granted Patent: US 8,287,374 B2
• Time in Patent Office: Days
• US Class Current: 463/36
• CPC Class Codes: A63F 2003/00974 mounted, drawn on or designed as a table
• CPC Class Codes: A63F 2009/243 with other kinds of input
• CPC Class Codes: A63F 2009/2433 Voice-actuated
• CPC Class Codes: A63F 2009/2435 using a video camera
• CPC Class Codes: A63F 2009/2457 Display screens, e.g. monitors, video displays
• CPC Class Codes: A63F 2300/1075 using a touch screen
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 3/00643 Electric board games; Electric features of board games electric word or number games A63F3/0421; computer chess G06F; electric raffle games A63F3/081
• CPC Class Codes: A63F 7/027 electric
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0423 using sweeping light beams, e.g. using rotating or vibrating mirror
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386

Abstract

Disclosed herein are new forms of computer inputs particularly using TV cameras, and providing affordable methods and apparatus for unique game play, such as rear projection devices for pinball and common board games using machine vision to determine the location of objects and/or features of objects. Particular embodiments employing fast and reliable acquisition and tracking of game related objects and their motion are disclosed, together with numerous applications. Also disclosed are related embodiments for instrumentation and control systems, such as those used in homes and cars.

Claims

1. A method for creating dynamically variable games in which one or more physical objects are moved on a play surface by the action of at least one player, comprising the steps of;

displaying graphics visible on the playing surface;

determining, using a TV camera behind the playing surface, the position or movement of said physical objects; and

, using said determined position or movement, controlling a game parameter

2. A method according to claim 1 wherein a game parameter is displayed data.

3. A method according to claim 1 wherein a rear projection display is used.

4. A method according to claim 1 wherein at least one said physical object is a marker in a Board game.

5. A method according to claim 1 wherein at least one said physical object is a ball in a pinball game.

6. A method for constructing a physical control detail for displaying information, which detail is mounted to a rear projection screen which diffuses light projected on it by a video image projection device, comprising the steps of;

providing a screen which has substantially no diffusing properties in at least a portion of the area overlapped by the control detail;

providing a clear path for projected light through said portion to pass through said detail; and

,

providing within said physical control detail at a position with said clear path, a diffusing surface for rendering data in a projected image visible to a user of the control detail.

7. A method according to claim 6 wherein said detail is a knob, slider or switch.

8. Apparatus for controlling a function of interest to the user of the apparatus, comprising;

a computer controlled rear projection display of video images on a screen observable by the user, said display screen having an cutout in it;

mechanical means protruding through said cutout for use by the user;

means to determine a characteristic of said means and;

means to control said display or another function according to said determination.

9. A method according to claim 8 wherein said mechanical means is a slot machine or transmission lever.

10. A control method comprising the steps of;

providing a knob or other physical control detail used to mechanically move an actuator used to control a variable to be controlled;

determining the position of said control detail using an electrooptical system such as a TV camera capable of obtaining information in at least two axes; and

,

using said determined position, controlling the display of information proximate said control detail.

11. A control system comprising two co-located physical control details in which the first such control detail is used to mechanically move an actuator to be controlled and the second control detail is monitored electro-optically and the data obtained used to determine the position of the second control detail, which position information is used to control an electronic variable.

12. A control system according to claim 11 wherein said control details are knobs having a common center of rotation.

13. A control system according to claim 11 wherein the first control detail is a slider and the second is a knob located so as to slide with the slider.

14. A control system according to claim 11 wherein a single physical control detail is utilized which can occupy two positions such that in the first it operates the mechanical actuator, and in the second it is disengaged therefrom.

15. A method for operating a switch mounted to the front of a rear projection screen and visible to a machine vision system behind the screen, comprising the steps of;

providing one or more reflecting portions of said switch, which vary with switch position with respect to said vision system;

Illuminating the reflecting portions of the switch with light from behind the screen;

determining, from images of said reflective portions, data related to the location, width or spacing of one or more of said reflecting portions, and

from said determined width, spacing or location, determining the state of said switch in order to cause a control action relating thereto.

20. A method according to claim 15 in which said switch is a rocker switch.

16. A method for determining finger touch on a rear projection screen surface on which data is projected, comprising the steps of;

Obtaining a first image of the finger tip in contact with the surface using a TV camera located behind the screen, said image indicating a xy location on the surface where finger touch is believed to occur;

Obtaining a second image of the finger tip in contact with said surface location at a later time,

Comparing, in a computer, the two images obtained, and,

Using the result of said comparison determining that a finger touch has occurred at said location on the surface.

21. A method according to claim 16 in which more than two finger contact images are used to determine location of finger touch.

17. A method for determining the presence and location of touch on a screen surface comprising the steps of;

observing a finger tip touching said surface using an electro-optical sensor such as a TV camera located behind the screen;

with the illumination light behind the screen off, determining from said observation if a black appearing blob portion of size indicative of a finger touch is present,

with the illumination light on so as to illuminate the finger tip from behind the screen, determining if a characteristic light colored blob indicative of a finger tip presence is reflected from screen in the region of observation of the near black portion; and

,

using one or both of said determinations, determining the location of a finger tip touch on said surface.

18. A method according to claim 17 in which characteristics of a users touch is learned and one or more of said characteristics used in determination.

19. A control system for a home, comprising

a display and control surface mounted in the wall of said home;

physical control details such as knobs mounted to the front surface of the screen of said display, and sensed by machine vision from behind the screen;

means including machine vision to sense touch on said front surface; and

,

means to communicate control information to controlled functions in the home.