MAPPING MOVEMENTS OF A HAND-HELD CONTROLLER TO THE TWO-DIMENSIONAL IMAGE PLANE OF A DISPLAY SCREEN

• US 20080100825A1
• Filed: 09/28/2006
• Published: 05/01/2008
• Est. Priority Date: 09/28/2006
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment LLC (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment America (Sony Group Corp.)
• Inventors: Zalewski, Gary M.
• Granted Patent: US 8,310,656 B2
• Time in Patent Office: Days
• US Class Current: 356/29
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 2300/1006 having additional degrees of freedom
• CPC Class Codes: A63F 2300/105 using inertial sensors, e.g. accelerometers, gyroscopes
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Abstract

A method for use in controlling a system includes tracking three-dimensional movements of a hand-held controller for the system, mapping the tracked three-dimensional movements of the handheld controller onto a two-dimensional image plane of a screen of a display for the system, and displaying one or more images on the two-dimensional image plane of the screen based on the mapping of the tracked three-dimensional movements of the handheld controller. Some embodiments may include one or more sensors configured to track three-dimensional movements of a hand-held controller for the system, and a processor configured to perform the above mentioned steps.

Claims

1. A method for use in controlling a system, comprising the steps of:

tracking three-dimensional movements of a hand-held controller for the system;

mapping the tracked three-dimensional movements of the handheld controller onto a two-dimensional image plane of a screen of a display for the system; and

displaying one or more images on the two-dimensional image plane of the screen based on the mapping of the tracked three-dimensional movements of the handheld controller.

2. A method in accordance with claim 1, wherein the one or more images comprise a pointer for use in selecting items displayed on the screen.

3. A method in accordance with claim 1, wherein the one or more images comprise a set of crosshairs.

4. A method in accordance with claim 1, wherein the step of tracking comprises the step of:

receiving on an image plane of a camera a projection of one or more detectable elements established on the hand-held controller.

5. A method in accordance with claim 4, wherein the step of tracking further comprises the step of:

analyzing movements and deformities in the projection of the one or more detectable elements.

6. A method in accordance with claim 1, wherein the step of tracking comprises the step of:

sensing an orientation of the hand-held controller using an inertial sensor.

7. A method in accordance with claim 1, wherein the step of tracking comprises the step of:

sensing an orientation of the hand-held controller using acoustic signals.

8. A method in accordance with claim 1, wherein the step of tracking comprises the step of:

sensing an orientation of the hand-held controller by sensing an output of a linear infrared array.

9. A method in accordance with claim 1, wherein the step of tracking comprises the step of:

mixing outputs from two or more sensors.

10. An apparatus for use in controlling a system, comprising:

one or more sensors configured to track three-dimensional movements of a hand-held controller for the system; and

a processor configured to map the tracked three-dimensional movements of the handheld controller onto a two-dimensional image plane of a screen of a display for the system, and display one or more images on the two-dimensional image plane of the screen based on the mapping of the tracked three-dimensional movements of the handheld controller.

11. An apparatus in accordance with claim 10, wherein the one or more images comprise a pointer for use in selecting items displayed on the screen.

12. An apparatus in accordance with claim 10, wherein the one or more images comprise a set of crosshairs.

13. An apparatus in accordance with claim 10, wherein the one or more sensors comprises a camera that receives on an image plane thereof a projection of one or more detectable elements established on the hand-held controller.

14. An apparatus in accordance with claim 13, wherein the processor is further configured to track by analyzing movements and deformities in the projection of the one or more detectable elements.

15. An apparatus in accordance with claim 10, wherein the one or more sensors comprises an inertial sensor that is configured to sense an orientation of the hand-held controller.

16. An apparatus in accordance with claim 10, wherein the one or more sensors comprises means for sensing an orientation of the hand-held controller using acoustic signals.

17. An apparatus in accordance with claim 10, wherein the one or more sensors comprises a linear infrared array that is configured to sense an orientation of the hand-held controller.

18. An apparatus in accordance with claim 10, further comprising a mixer for mixing outputs from two or more of the sensors.

19. An apparatus for use in controlling a system, comprising:

means for tracking three-dimensional movements of a hand-held controller for the system;

means for mapping the tracked three-dimensional movements of the handheld controller onto a two-dimensional image plane of a screen of a display for the system; and

means for displaying one or more images on the two-dimensional image plane of the screen based on the mapping of the tracked three-dimensional movements of the handheld controller.

20. An apparatus in accordance with claim 19 wherein the one or more images comprise a pointer for use in selecting items displayed on the screen.

21. An apparatus in accordance with claim 19, wherein the one or more images comprise a set of crosshairs.

22. An apparatus in accordance with claim 19, wherein the means for tracking comprises:

means for receiving on an image plane of a camera a projection of one or more detectable elements established on the hand-held controller.

23. An apparatus in accordance with claim 22, wherein the means for tracking further comprises:

means for analyzing movements and deformities in the projection of the one or more detectable elements.

24. An apparatus in accordance with claim 19 wherein the means for tracking comprises:

means for sensing an orientation of the hand-held controller using an inertial sensor.

25. An apparatus in accordance with claim 19, wherein the means for tracking comprises:

means for sensing an orientation of the hand-held controller using acoustic signals.

26. An apparatus in accordance with claim 19, wherein the means for tracking comprises:

means for sensing an orientation of the hand-held controller by sensing an output of a linear infrared array.

27. An apparatus in accordance with claim 19, further comprising:

means for mixing outputs from two or more sensors.