Remote input device

• US 8,723,794 B2
• Filed: 04/12/2010
• Issued: 05/13/2014
• Est. Priority Date: 05/27/2005
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.)
• Inventors: Corson, Gregory A., Zalewski, Gary Michael
• Primary Examiner(s): PATEL, PREMAL R
• Application Number:
  US12/758,727
• Publication Number:
  US 20100194687A1
• Time in Patent Office: 1,492 Days
• Field of Search: 345156-158, 345/180, 356/614, 353/121, 353/28
• US Class Current: 345/158
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Abstract

An input device providing users with a pointing capability includes a sender portion (100) and a receiver portion (200). The sender portion (100) is adapted to be manipulated by a user (the user manipulating button 125) to specify a target point within a target area. The sender portion projects a light beam (light output from light source 115) including a pattern onto the target area. A receiver portion (200) includes one or more sensor units (205, 210, 215) located in or near the target area. At least some of the sensor units (205, 210, 215) receive a portion of the light beam (light output from light source 115) regardless of the location of the target point within the target area. A processing unit (220) in the receiver portion (200) analyzes the portions of the light beam received by one or more sensor units (205, 210, 215) to determine an attribute of the target point. The attribute can be the location or relative motion of the target point. The receiver portion (200) may be integrated with a display device.

Claims

1. A system for providing an input value to an electronic device, the system comprising:

a sender portion adapted to be manipulated by a user, the sender portion including a light projecting system adapted to form a projection of an encoded pattern of light with respect to the light projecting system, the projection including a plurality of intensity transitions at a target area; and

a receiver portion including at least one sensor unit, the at least one sensor unit adapted to measure at least one intensity value of the intensity transitions of the projection at a location of the at least one sensor unit, wherein the receiver portion includes logic adapted to determine a position or orientation input value associated with the sender portion from the at least one intensity value of the intensity transitions of the projection at the location of the at least one sensor unit, wherein the receiver portion includes logic that determines a location of the sender portion based at least in part on matching the at least one intensity value to a known or determinable spatial distribution of light intensity.

2. The system of claim 1 wherein the positional or orientation input value is a position of the sender portion.

3. The system of claim 1 wherein the positional or orientation input value is a two-dimensional projection of a three-dimensional position and/or movement of the sender portion.

4. The system of claim 1 wherein location with respect to the screen is characterized by a fixed depth with respect to the screen.

5. The system of claim 1 wherein the location with respect to the screen is characterized by a variable depth with respect to the screen.

6. A system for providing a positional input value to an electronic device, the system comprising:

a sender portion adapted to be manipulated by a user to specify a target point within a target area, the sender portion including a light projecting system adapted to project a beam of light including an encoded pattern, the beam of light and the encoded pattern forming a projected pattern having a predefined spatially varying characteristic at the target area, the encoded pattern being adapted such that a number of transitions of the encoded pattern is proportional to a magnitude of a relative motion of the target point; and

a receiver portion including at least one sensor unit, the sensor unit adapted to measure at least one amount of light of the spatially varying characteristic of the projected pattern at a location of the sensor unit, wherein the receiver portion includes logic adapted to determine a positional input value associated with the target point from the at least one amount of light of the spatially varying characteristic at the location of the sensor unit,

wherein the sensor unit is attached to a user-moveable object.

7. The system of claim 6 wherein the positional input value is a position of the sender portion.

8. The system of claim 6 wherein the positional input value is a two-dimensional projection of a three-dimensional position and/or movement of the sender portion.

9. The system of claim 6 wherein the receiver portion includes logic that maps a position of the sensor to a location with respect to a screen.

10. The system of claim 9 wherein the location with respect to the screen is characterized by a fixed depth with respect to the screen.

11. The system of claim 9 wherein the location with respect to the screen is characterized by a variable depth with respect to the screen.

12. The system of claim 6, wherein the light projecting system further comprises a slide having the encoded pattern adapted to project a beam of light formed from the encoded pattern.

13. A system for determining a positional input value associated with a target point specified by a user, the system comprising:

at least one sensor unit, wherein the sensor unit is adapted to measure at least one amount of light of a spatially varying characteristic in a projection of a pattern of constant light intensity included in a beam of light projected towards the sensor unit; and

a processing unit connected with the at least one sensor unit and including logic adapted to determine a positional input value associated with a target point specified by a user from the at least one amount of light of the spatially varying characteristic from the at least one sensor unit, wherein the processing unit includes logic that determines a location of a sender portion based at least in part on matching the at least one amount of light of the spatially varying characteristic to a known or determinable spatial distribution of light intensity,

wherein the positional input value is a position of the target point.

14. The system of claim 13 wherein the predefined spatially varying characteristic of the projection is an intensity pattern, and wherein the at least one sensor unit is part of a plurality of sensor units, each sensor unit at a different location and adapted to measure the at least one amount of light of the spatially varying characteristic of the projection, wherein the at least one amount of light of the spatially varying characteristic is an intensity of light received from the sender portion, and wherein the processing unit includes logic adapted to determine the positional input value associated with the target point from intensity of the projection measured by the plurality of sensor units.

15. The system of claim 14 wherein the processing unit includes logic adapted to determine a plurality of distance values corresponding with at least a portion of the intensity values measured by the plurality of sensor units, each distance value representing the distance between the location of its respective sensor unit and the target point, and logic adapted to determine the position of the target point from the plurality of distance values.

16. The system of claim 13 wherein the predefined spatially varying characteristic of the projection is a pattern including a plurality of intensity transitions adapted to indicate motion of the target point.

17. The system of claim 16 wherein the at least one amount of light of the spatially varying characteristic of the projection at the location of each sensor unit includes the presence of an intensity transition at the location of the sensor unit.

18. The system of claim 17 wherein the sensor unit includes a plurality of sensors arranged to detect a direction of pattern motion along at least one axis, and wherein the processing unit includes logic adapted to compare changes in intensity received by each sensor over time to determine a direction of pattern motion.

19. The system of claim 18 wherein the positional input value is a relative motion of the target point and the processing unit includes logic adapted to determine a magnitude of the relative motion of the target point by detecting a change in the presence of an intensity transition at the location of the sensor unit and to determine a direction of the relative motion of the target point from the direction of pattern motion.

20. The system of claim 13 wherein the predefined spatially varying characteristic of the projected pattern is a pattern that includes a plurality of intensity transitions adapted to indicate a position, and/or orientation, and/or motion of the target point.

21. The system of claim 13 wherein the processing unit includes logic adapted to access menu items on a screen in response to the projection.

22. The system of claim 13 wherein the system is integrated with a display device, the display device adapted to provide visual feedback to a user in response to the positional input value associated with the target point specified by the user.

23. The system of claim 13 wherein the sensor unit is attached to a user-moveable object.

24. The system of claim 23 wherein the sensor unit is removably attached to the user-movable object.

25. The system of claim 23 wherein the user-movable object includes at least one of a game controller and an article mounted to a body of a game controller.

26. The system of claim 23 further comprising one or more of a sound source, a light source, and an inertial sensor attached to the body of the user-movable object.

27. The system of claim 26 wherein the senor unit, and/or sound source, and/or light source, and/or inertial sensor is removably attached to the user-movable object.

28. The system of claim 13 wherein the at least one sensor unit is located proximate an image display screen.

29. The system of claim 13 wherein the at least one sensor unit includes one or more quad sensors, each quad sensor having four light sensing components.

30. The system of claim 13 wherein the sensor unit is attached to a body of a controller, wherein the sensor unit is adapted to sense light from a remotely located source and generate signals related to tracking a location, and/or motion, and/or orientation of the source relative to the controller.

31. The system of claim 13 wherein the at least one sensor unit includes a sensor/emitter element having a source of light and a light sensor element.

32. The system of claim 31 wherein the processor includes logic adapted to determine a direction from the at least one sensor unit to a source of light using time of arrival delays and semi-blind source separation for light sensed by different sensors in the array.

33. The system of claim 13 wherein the at least one sensor unit includes an array of two or more light sensors.

34. The system of claim 13 wherein the at least one sensor unit is attached to a controller, the system further comprising one or more light sources and/or image capture units attached to the controller, a remotely located light source and one or more remotely located image capture units and/or remotely located light sensors.

35. The method of claim 34 wherein the processing unit includes logic adapted to track a position and/or orientation and/or motion of the controller relative to the image capture unit and/or remotely located light sensors based on measurement of light from the light sources attached to the controller with the image capture unit and/or remotely located light sensors, wherein the logic is further adapted to track a position and/or orientation and/or motion of the remotely located light sources based on measurement of light from the remotely located light sources with the light sensors and/or image capture units attached to the controller.

36. The system of claim 13 wherein the processor unit includes logic adapted to implement a method of obtaining input for controlling execution of a game program, wherein the method comprises:

receiving controller input information from a user-manipulable game controller, the controller input information including at least one of a) information for identifying a current position of a user-movable control stick of the game controller in relation to a rest position of the control stick, and/or b) information identifying whether a switch included in the game controller is active;

receiving supplementary input information from an environment in which the controller is being used; and

obtaining a combined input for controlling the execution of the game program by processing the controller input information and the supplementary input information to yield the combined input.

37. The system of claim 13, wherein the processor includes logic adapted to implement:

an image analyzer adapted to receive and analyze input data from an image capture device;

an inertial analyzer adapted to receive and analyze input data from an inertial sensor;

an acoustic analyzer adapted to receive and analyze input data from an acoustic receiver;

a light sensor analyzer adapted to receive and analyze input data from one or more light sensors; and

a mixer configured to receive analyzed input data from one or more of the inertial analyzer, the image analyzer, the acoustic analyzer, and the light sensor analyzer and generate tracking information based on information received from one or more of the image analyzer, the inertial analyzer, the acoustic analyzer, and the light sensor analyzer.

38. The system of claim 13, wherein the processor includes logic adapted to implement a method for analyzing game control input data, the method comprising:

receiving input control data from one or more input devices, the input control data associated with one or more user actions;

assigning a distribution value to the received input control data;

identifying at least one action in a game environment associated with the one or more user actions based on the distribution value assigned to the received input control data; and

executing the at least one action in the game environment.

39. The system of claim 13, wherein the processor includes logic adapted to implement:

a first analyzer operable to receive first input channel information via a first input channel, the first input channel information being representative of the user manipulations within the environment, the first analyzer further being operable to analyze the first input channel information to generate first output information for registering the user manipulations by a game program during execution of the game program.