SYSTEMS AND METHODS FOR DETERMINING CONTROLLER FUNCTIONALITY BASED ON POSITION, ORIENTATION OR MOTION

• US 20110195782A1
• Filed: 11/23/2010
• Published: 08/11/2011
• Est. Priority Date: 02/05/2010
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.)
• Inventors: Rimon, Noam, Mao, Xiaodong
• Granted Patent: US 8,348,760 B2
• Time in Patent Office: Days
• US Class Current: 463/37
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/214 for locating contacts on a surface, e.g. floor mats or touch pads
• CPC Class Codes: A63F 13/215 comprising means for detecting acoustic signals, e.g. using a microphone
• CPC Class Codes: A63F 13/218 using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player
• CPC Class Codes: A63F 13/25 Output arrangements for video game devices
• CPC Class Codes: A63F 13/285 Generating tactile feedback signals via the game input device, e.g. force feedback
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 13/843 involving concurrently two or more players on the same game device, e.g. requiring the use of a plurality of controllers or of a specific view of game data for each player
• CPC Class Codes: A63F 2300/538 for performing operations on behalf of the game client, e.g. rendering
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0317 in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Abstract

Methods and systems for providing input to an interactive program are presented. An interactive system includes a display for displaying an interactive program and a controller device. The position and motion of the controller device are determined based on perspective distortion of the display in captured images of the display taken at the controller. In an interactive region, various interactive zones are defined, each of which have an associated specified function for an action of the controller device. When the controller device is determined to be within one of the interactive zones, the functionality of the action of the controller device is set to the specified function associated with that interactive zone.

Claims

1. A method for determining a functionality of an action of a controller device, the controller device configured for interfacing with an interactive program, the method comprising:

defining interactive zones, each interactive zone being defined by a spatial region having an associated specified function for the action of the controller device when the controller device is located within that interactive zone;

determining a position of the controller device; and

setting the functionality of the action of the controller device to have the specified function associated with the interactive zone within which the controller device is located.

2. The method of claim 1, wherein each spatial region defines a volume located on a front side of a display, the front side of the display being a side on which an image projected by the display may be viewed.

3. The method of claim 2, wherein a total volume defined by the interactive zones defines an interactive region within which the position of the controller device may be determined.

4. The method of claim 1, wherein each specified function is operable for causing an action within the interactive program.

5. The method of claim 4, wherein the specified functions associated with two or more of the interactive zones are similar functions which vary by degree.

6. The method of claim 4, wherein the specified functions associated with two or more of the interactive zones are dissimilar functions.

7. The method of claim 1, wherein the action of the controller device is an input received from a user of the controller device and communicated from the controller device to the interactive program.

8. The method of claim 7, wherein the input received from a user is entered via an input device of the controller device.

9. The method of claim 8, wherein the input device is selected from a group consisting of a button, joystick, trigger, touchpad, trackball, or pressure sensor.

10. The method of claim 7, wherein the input received from a user is entered via movement of the controller device.

11. The method of claim 1, wherein the determination of the position of the controller device includes,

capturing an image of a display at the controller device;

and

determining the position of the controller device based on perspective distortion of the display in the captured image of the display.

12. A method for interfacing with an interactive program, the method comprising:

defining a plurality of zones, the plurality of zones being defined within an interactive region of space for which a location of a controller device may be determined;

continuously detecting the location of one or more controller devices;

when a controller device is determined to be positioned within one of the plurality of zones, setting an action of the controller device that is communicated to the interactive program to have a function associated with that zone, the function being defined for causing an action within the interactive program.

13. The method of claim 12, wherein the plurality of zones are arranged in a non-overlapping and contiguous fashion so as to define a spatial matrix within the interactive region of space.

14. The method of claim 12, wherein a different subset of the plurality of zones is operative for determining the function of an action of each of the controller devices.

15. The method of claim 12, wherein each of the plurality of the zones has one or more associated functions which correspond to one or more of the controller devices.

16. The method of claim 12, further comprising,

activating a zone indicator when the controller device is determined to be positioned within one of the plurality of zones, the zone indicator providing a notification of which of the plurality of zones in which the controller devices is located.

17. The method of claim 16, wherein the zone indicator is selected from the group consisting of a light indicator, a sound, a visual indicator on a display, and vibration of the controller device.

18. The method of claim 12, wherein detection of a transition of the controller device from a location within a zone to a location outside of the zone causes a signaling response to be activated.

19. The method of claim 18, wherein the signaling response is selected from the group consisting of a sound, a light indicator, a warning on a display, and vibration of the controller device.

20. The method of claim 12, wherein functions associated with one or more of the zones are different types of sounds.

21. The method of claim 12, wherein the action communicated to the interactive program is a movement of the controller device, the movement of the controller device being defined by a change in location and/or orientation.

22. The method of claim 12, wherein the continuous detection of the location of the one or more controller devices includes,

capturing an image of a display at each controller device;

and

continuously determining the location of each controller device based on perspective distortion of the display in the captured image of the display.

23. A system for interfacing with an interactive program, the system configured for rendering the interactive program on a display, the system comprising:

a computing device for executing the interactive program;

a controller device for providing input to the interactive program, the controller device having an image capture device for capturing images of the display, the position of the controller device being continuously determined based on a perspective distortion of the display in the captured images of the display;

wherein the computing device is configured to define interactive zones, each interactive zone being defined by a spatial region having an associated specified function for an action of the controller device when the controller device is located within that interactive zone; and

wherein the computing device is configured to set the functionality of the action of the controller device to the specified function associated with the interactive zone within which the controller device is located.

24. The system of claim 23, wherein each spatial region defines a volume located on a front side of the display, the front side of the display being a side on which an image projected by the display may be viewed.

25. The system of claim 23, wherein each specified function is operable for causing an action within the interactive program.

26. The system of claim 23, wherein the interactive zones are dynamically determined according to a state of the interactive program.

27. A controller device for providing input to an interactive program, the interactive program being executed by a computing device and rendered on a display, the controller device comprising:

an image capture device for capturing images of a display;

a position determination module for continuously determining the position of the controller device based on a perspective distortion of the display in the captured images of the display;

a functionality setting module for setting the functionality of an action of the controller device;

wherein the controller device is configured to be operated within interactive zones, each interactive zone being defined by a spatial region having an associated specified function for the action of the controller device when the controller device is located within that interactive zone; and

wherein the functionality setting module is configured to set the functionality of the action of the controller device to the specified function associated with the interactive zone within which the controller device is located.