Image-based control of video games

• US 20050009605A1
• Filed: 07/11/2003
• Published: 01/13/2005
• Est. Priority Date: 07/11/2003
• Status: Abandoned Application

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Rosenberg, Steven T., Miklos, Todd A.
• Application Number:
  US10/619,068
• Publication Number:
  US 20050009605A1
• Time in Patent Office: Days
• US Class Current: 463/36
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/24 Constructional details thereof, e.g. game controllers with detachable joystick handles
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 2300/1006 having additional degrees of freedom
• CPC Class Codes: A63F 2300/1012 involving biosensors worn by the player, e.g. for measuring heart beat, limb activity
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera

Abstract

Image-based video game control devices are described. In one aspect, a device for controlling a video game includes an input, an imager, and a movement detector. The input has a movable reference surface. The imager is operable to capture images of the reference surface. The movement detector is operable to detect movement of the reference surface based on one or more comparisons between images of the reference surface captured by the imager and to generate output signals for controlling the video game based on the detected movement. In another aspect, a device for controlling a video game includes a movable input, an imager, and a movement detector. The imager is attached to the input and is operable to capture images of a scene in the vicinity of the input. The movement detector is operable to compute three-dimensional position coordinates for the input based at least in part on one or more comparisons between images of the scene captured by the imager and to generate output signals for controlling the video game based on the computed position coordinates.

Claims

1. A device for controlling a video game, comprising:

an input having a movable reference surface;

an imager operable to capture images of the reference surface; and

a movement detector operable to detect movement of the reference surface based on one or more comparisons between images of the reference surface captured by the imager and to generate output signals for controlling the video game based on the detected movement.

2. The device of claim 1, wherein the input is a joystick and the reference surface moves in response to movement of the joystick.

3. The device of claim 2, wherein the input comprises a joystick shaft having a lower portion coupled to a base, and the reference surface corresponds to an area on the lower portion of the joystick shaft.

4. The device of claim 3, wherein the base includes a socket and the lower portion of the joystick shaft includes a spherical element positioned in the base socket and having a surface region corresponding to the reference surface.

5. The device of claim 1, wherein the input comprises a steering wheel coupled to a base through a steering column, and the reference surface tracks movement of the steering column.

6. The device of claim 5, wherein the reference surface corresponds to a surface of the steering column.

7. The device of claim 1, wherein the imager includes multiple image sensors each operable to capture images of the reference surface.

8. The device of claim 1, wherein the movement detector is operable to detect movement of the reference surface by tracking features of the reference surface across multiple images.

9. The device of claim 8, wherein the movement detector is operable to track structural features of the reference surface across multiple images.

10. The device of claim 8, wherein the movement detector is operable to compute position coordinates for the reference surface by correlating features of the reference surface across multiple images.

11. The device of claim 10, wherein the movement detector is operable to map the computed position coordinates to the output signals for controlling the video game.

12. The device of claim 1, further comprising at least one light source for illuminating the reference surface.

13. A device for controlling a video game, comprising:

a movable input;

an imager attached to the input and operable to capture images of a scene in the vicinity of the input; and

a movement detector operable to compute three-dimensional position coordinates for the input based at least in part on one or more comparisons between images of the scene captured by the imager and to generate output signals for controlling the video game based on the computed position coordinates.

14. The device of claim 13, wherein the movement detector is operable to compute rotational position of the movable input based at least in part on one or more comparisons between images of the scene captured by the imager.

15. The device of claim 13, wherein the input is a device for simulating a sports game.

16. The device of claim 15, wherein the input is formed in the shape of a glove.

17. The device of claim 13, further comprising an acceleration sensor unit attached to the input and operable to generate signals indicative of movement of the input in three-dimensions, wherein the movement detector is operable to detect movement of the input based at least in part on the signals generated by the acceleration sensor.

18. The device of claim 17, wherein the movement detector is operable to compute coarse three-dimensional position coordinates for the input based on the signals received from the acceleration sensor unit and to compute refined three-dimensional position coordinates for the input based on the computed coarse three-dimensional position coordinates and comparisons between images of the scene captured by the imager.

19. The device of claim 17, wherein the movement detector is operable to periodically correct three-dimensional position coordinates for the input computed from signals generated by the acceleration sensor based on position coordinates computed from comparisons between images of the scene captured by the imager.

20. The device of claim 17, wherein the movement detector is operable to compute acceleration information relative to position information computed from comparisons between images of the scene captured by the imager.

21. The device of claim 17, wherein the movement detector is operable to compute a measure of movement rate of the movable input based on the signals received from the acceleration sensor unit, and the imager captures images of the scene at a variable rate that is set based on the computed movement rate measure.

22. The device of claim 13, wherein the movement detector is operable to detect movement of the input by tracking features of the scene across multiple images.

23. The device of claim 13, wherein the movement detector is operable to compute position coordinates for the reference surface by correlating features of the reference surface across multiple images.

24. The device of claim 13, wherein the movement detector is operable to map the computed position coordinates to the output signals for controlling the video game.