Game controller using a plurality of light-emitting elements

• US 9,566,507 B2
• Filed: 06/16/2015
• Issued: 02/14/2017
• Est. Priority Date: 03/14/2006
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.), Sony Corporation (Sony Group Corp.)
• Inventors: Goto, Teiyu, Saito, Katsu, Ohba, Akio, Segawa, Hiroyuki
• Primary Examiner(s): Rowland, Steve
• Application Number:
  US14/740,696
• Publication Number:
  US 20150301616A1
• Time in Patent Office: 609 Days
• US Class Current: 1/1
• CPC Class Codes: A63F 13/06 using player-operated means for controlling the position of a specific area display
• CPC Class Codes: A63F 13/20 Input arrangements for video game devices
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/24 Constructional details thereof, e.g. game controllers with detachable joystick handles
• CPC Class Codes: A63F 13/26 having at least one additional display device, e.g. on the game controller or outside a game booth
• CPC Class Codes: A63F 13/31 Communication aspects specific to video games, e.g. between several handheld game devices at close range
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/56 Computing the motion of game characters with respect to other game characters, game objects or elements of the game scene, e.g. for simulating the behaviour of a group of virtual soldiers or for path finding
• CPC Class Codes: A63F 13/57 Simulating properties, behaviour or motion of objects in the game world, e.g. computing tyre load in a car race game A63F13/56 takes precedence
• CPC Class Codes: A63F 2300/1006 having additional degrees of freedom
• CPC Class Codes: A63F 2300/1043 being characterized by constructional details
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: A63F 2300/301 using an additional display connected to the game console, e.g. on the controller
• CPC Class Codes: A63F 2300/402 Communication between platforms, i.e. physical link to protocol
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: A63F 2300/64 for computing dynamical parameters of game objects, e.g. motion determination or computation of frictional forces for a virtual car
• CPC Class Codes: A63F 2300/6607 for animating game characters, e.g. skeleton kinematics
• CPC Class Codes: A63F 2300/6623 for animating a group of characters
• CPC Class Codes: G06F 3/033 Pointing devices displaced or positioned by the user , e.g. mice, trackballs, pens or joysticks; Accessories therefor digitisers characterised by the transducing means G06F3/041

Abstract

A game controller includes a plurality of LEDs formed on the rear of a case. The plurality of LEDs are arranged two-dimensionally in its layout area. The game controller has a plurality of PWM control units which are provided inside the case and control the lighting of the plurality of LEDs, respectively. The PWM control units control the lighting of the LEDs based on a control signal from a game apparatus. The game apparatus acquires a captured image of the game controller, and acquires the position of the game controller in the captured image based on the positions of the LEDs in the captured image.

Claims

1. A controller for providing user operation commands to an apparatus, the controller comprising:

a communication module configured to transmit the user operation commands to the apparatus;

a plurality of light-emitting elements provided on a case of the controller; and

a processing unit configured to cause the light-emitting elements to emit light,

wherein the light-emitting elements are arranged in a pattern on the case such that the emitted light is captured in an image by an imaging device of the apparatus,

wherein a position of the controller is determined based on a positional relationship of the light-emitting elements on the case affecting the emitted light captured in the image,

wherein the position of the controller is detected based on at least an angle between respective areas of the emitted light in the image captured from the plurality of light-emitting elements, and

wherein a first area of emitted light in the image is detected as a first of the plurality of light-emitting elements;

a second area of emitted light in the image is detected as a second of the plurality of light-emitting elements;

a third area of emitted light in the image is detected as a third of the plurality of light-emitting elements; and

a fourth area of emitted light in the image is detected as a fourth of the plurality of light-emitting elements, at least when a first angle formed between a first vector, extending between the first area and the second area, and a second vector, extending between the third area and the fourth area, is no greater than a predetermined high threshold value.

2. The controller of claim 1, wherein the position of the controller is detected based on at least one distance between respective areas of the emitted light in the image captured from the plurality of light-emitting elements.

3. The controller of claim 2, wherein:

a first area of emitted light in the image is detected as a first of the plurality of light-emitting elements;

a second area of emitted light in the image is detected as a second of the plurality of light-emitting elements at least when a distance, D(1,2), between the first area and the second area is between a predetermined lower limit and a predetermined higher limit, which are based on a positional relationship of the light-emitting elements on the case.

4. The controller of claim 3, wherein a third area of emitted light in the image is detected as a third of the plurality of light-emitting elements at least when a distance, D(1,3), between the first area and the third area is between 1/√

2×

D(1,2) and √

2×

D(1,2).

5. The controller of claim 1, wherein the fourth area of emitted light in the image is detected as the fourth of the plurality of light-emitting elements, at least when:

the first angle is no greater than the predetermined high threshold value; and

a second angle formed between a third vector, extending between the first area and the third area, and a fourth vector, extending between the second area and the fourth area, is no smaller than a predetermined low threshold value.

6. The controller of claim 1, wherein:

a first area of emitted light in the image is detected as a first of the plurality of light-emitting elements; and

a further area of emitted light in the image is detected as a further one of the plurality of light-emitting elements at least when a number of pixels within the further area is between 1/2 ×

N and 2×

N, where N is a number of pixels contained in the first area.

7. The controller of claim 1, wherein the controller is a game controller and the apparatus is a game console apparatus.

8. A method for providing user operation commands from a controller to an apparatus, the method comprising:

providing a plurality of light-emitting elements on a case of the controller, where the light-emitting elements are arranged in a pattern on the case;

causing the light-emitting elements to emit light;

capturing the emitted light in an image by an imaging device of the apparatus; and

determining a position of the controller based on a positional relationship of the light-emitting elements on the case affecting the emitted light captured in the image,

wherein the position of the controller is detected based on at least an angle between respective areas of the emitted light in the image captured from the plurality of light-emitting elements, and

wherein a first area of emitted light in the image is detected as a first of the plurality of light-emitting elements;

a second area of emitted light in the image is detected as a second of the plurality of light-emitting elements;

a third area of emitted light in the image is detected as a third of the plurality of light-emitting elements; and

a fourth area of emitted light in the image is detected as a fourth of the plurality of light-emitting elements, at least when a first angle formed between a first vector, extending between the first area and the second area, and a second vector, extending between the third area and the fourth area, is no greater than a predetermined high threshold value.

9. The method of claim 8, wherein the position of the controller is detected based on at least one distance between respective areas of the emitted light in the image captured from the plurality of light-emitting elements.

10. The method of claim 9, wherein:

a first area of emitted light in the image is detected as a first of the plurality of light-emitting elements;

a second area of emitted light in the image is detected as a second of the plurality of light-emitting elements at least when a distance, D(1,2), between the first area and the second area is between a predetermined lower limit and a predetermined higher limit, which are based on a positional relationship of the light-emitting elements on the case.

11. The method of claim 10, wherein a third area of emitted light in the image is detected as a third of the plurality of light-emitting elements at least when a distance, D(1,3), between the first area and the third area is between 1/√

×

D(1,2) and √

2×

D(1,2).

12. The method of claim 8, wherein the fourth area of emitted light in the image is detected as the fourth of the plurality of light-emitting elements, at least when:

the first angle is no greater than the predetermined high threshold value; and

a second angle formed between a third vector, extending between the first area and the third area, and a fourth vector, extending between the second area and the fourth area, is no smaller than a predetermined low threshold value.

13. The method of claim 8, wherein:

a first area of emitted light in the image is detected as a first of the plurality of light-emitting elements; and

a further area of emitted light in the image is detected as a further one of the plurality of light-emitting elements at least when a number of pixels within the further area is between 1/2 ×

N and 2×

N, where N is a number of pixels contained in the first area.

14. A system, comprising:

an apparatus configured to process user operation commands;

an imaging device configured to provide the apparatus with an image; and

a controller for receiving the user operation commands from the user, the controller comprising;

a communication module configured to transmit the user operation commands to the apparatus;

a plurality of light-emitting elements provided on a case of the controller; and

a processing unit configured to cause the light-emitting elements to emit light,

wherein the light-emitting elements are arranged in a pattern on the case such that the emitted light is captured in an image by an imaging device of the apparatus,

wherein a position of the controller is determined by the apparatus based on a positional relationship of the light-emitting elements on the case affecting the emitted light captured in the image,

wherein the position of the controller is detected based on at least an angle between respective areas of the emitted light in the image captured from the plurality of light-emitting elements, and

wherein a first area of emitted light in the image is detected as a first of the plurality of light-emitting elements;

a second area of emitted light in the image is detected as a second of the plurality of light-emitting elements;

a third area of emitted light in the image is detected as a third of the plurality of light-emitting elements; and

a fourth area of emitted light in the image is detected as a fourth of the plurality of light-emitting elements, at least when a first angle formed between a first vector, extending between the first area and the second area, and a second vector, extending between the third area and the fourth area, is no greater than a predetermined high threshold value.

15. The system of claim 14, wherein the controller is a game controller and the apparatus is a game console apparatus.