Game controller with lights visible inside and outside the game controller

• US 10,010,788 B2
• Filed: 12/21/2015
• Issued: 07/03/2018
• Est. Priority Date: 12/21/2015
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Inventors: Huang, Ennin
• Primary Examiner(s): D'AGOSTINO, PAUL ANTHONY
• Application Number:
  US14/976,907
• Publication Number:
  US 20170173453A1
• Time in Patent Office: 925 Days
• Field of Search: None
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/24 Constructional details thereof, e.g. game controllers with detachable joystick handles
• CPC Class Codes: A63F 13/26 having at least one additional display device, e.g. on the game controller or outside a game booth
• CPC Class Codes: A63F 2250/497 Head
• CPC Class Codes: A63F 2300/8082 Virtual reality
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/0308 comprising a plurality of distinctive and separately oriented light emitters or reflectors associated to the pointing device, e.g. remote cursor controller with distinct and separately oriented LEDs at the tip whose radiations are captured by a photo-detector associated to the screen
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Abstract

A system and method of tracking a user input device such as a game controller includes emitting light from multiple light sources in the user input device. The multiple light sources having a known spacing relative to each other on the user input device and at least some of the multiple light sources are capable of emitting light through a inside surface and an outside surface of the user input device. The multiple light sources can define a plane of the user input device that can be used to track the movement, location and orientation of the user input device. The user device is tracked using image data from a camera. The image data is communicated to a computer where the image data is processed to identify the movement, location and orientation of the user input device.

Claims

1. A user input device comprising:

a body including a proximate end and a distal end, the distal end being opposite from the proximate end;

a handgrip portion of the body; and

a first extension portion extending from the distal end of the body to a first end of the first extension portion, the first extension portion including;

a first inside surface;

a first outside surface, the first inside surface being opposite from the first outside surface; and

a first light source disposed in the first extension portion, the first light source capable of emitting light through the first inside surface and the first outside surface; and

a second extension portion extending from the distal end of the body to a second end, the second extension portion including;

a second inside surface;

a second outside surface, the second inside surface being opposite from the second outside surface; and

a second light source disposed in the second extension portion, the second light source capable of emitting light through the second inside surface and the second outside surface;

a third extension portion coupling the first end of the first extension portion to the second end of the second extension portion to form a closed loop having an open space defined by the first extension portion, the second extension portion, the third extension portion and the distal end.

2. The device of claim 1, further comprising a central light source disposed in the distal end, between the first extension portion and the second extension portion.

3. The device of claim 2, wherein at least a portion of the third extension portion is transparent to at least one of the central light source, the first light source or the third light source.

4. The device of claim 1, wherein the combined first extension portion, second extension portion and third extension portion form a substantially round closed loop.

5. The device of claim 1, wherein the first light source is disposed at an intersection where the first extension portion is coupled to the third extension portion.

6. The device of claim 1, further comprising a communication module in data communication with a computer system.

7. The device of claim 6, wherein the communication module is electrically coupled to the first light source, the second light source and capable of individually controlling light emitted from each one of the first light source or the second light source.

8. The device of claim 6, wherein the computer system is coupled to a camera capable of tracking at least one of the first light source or the second light source.

9. The device of claim 1, wherein the first light source is a light emitting diode.

10. The device of claim 1, further comprising at least one inertial sensor integrated in the body.

11. A user input device comprising:

a body including a proximate end and a distal end, the distal end being opposite from the proximate end;

a first loop portion extending from the distal end of the body;

a first light source disposed in the first loop portion;

a second loop portion extending from the distal end of the body;

a second light source disposed in the second loop portion;

a loop connecting portion defined between an end of the first loop portion and an end of the second loop portion to form a closed loop having an option space defined between the first loop portion, the distal end of the body, the second loop portion and the loop connecting portion;

a central light source disposed in the distal end, between the first loop portion and the second loop portion; and

a communication module configured for data communication with a computer system, the communication module is electrically coupled to the first light source, the second light source and the central light source and capable of individually controlling light emitted from each one of the first light source, the second light source or the central light source.

12. The method of providing user input to a computer system comprising:

tracking a user input device, the user input device including;

a body including a proximate end and a distal end, the distal end being opposite from the proximate end;

a handgrip portion of the body;

a first loop portion extending from the distal end of the body;

a first light source disposed in the first loop portion;

a second loop portion extending from the distal end of the body;

a second light source disposed in the second loop portion;

a loop connecting portion defined between an end of the first loop portion and an end of the second loop portion to form a closed loop having an option space defined between the first loop portion, the distal end of the body, the second loop portion and the loop connecting portion; and

a central light source disposed in the distal end, between the first loop portion and the second loop portion;

wherein tracking the user input device includes;

emitting light from each of the first light source, the second light source and the central light source;

capturing one or more images of the first light source, the second light source and the central light source using a camera coupled to a computer system;

identifying by a computer a location and orientation of the user input device by examining positions and changes in positions of the central light source, the left light source and the right light source in one or more captured images; and

adjusting at least one aspect of the application corresponding to the identified location and orientation of the user input device.

13. The method of claim 12, wherein emitting light from each of the first light source, the second light source and the central light source includes changing or modulating the respective light emitted from at least one of the first light source, the second light source and the central light source.

14. The method of claim 13, wherein modulating the respective light emitted from at least one of the first light source, the second light source and the central light source includes changing a wavelength of the respective light emitted from at least one of the first light source, the second light source and the central light source.

15. The method of claim 12, wherein identifying the location and orientation of the user input further includes:

determining a roll angle of the user input device;

determining a yaw angle of the user input device; and

determining a pitch angle of the user input device.

16. The method of claim 12, wherein identifying the location and orientation of the user input device includes determining a separation distance between the user input device and the camera.

17. The method of claim 12, further comprising identifying a plane defined by the first light source, the second light source and the central light source from the one or more captured images.

18. The method of claim 12, further comprising comparing two or more identified locations and/or orientations of the user input device to a computer executing an application to a second input identifying a second location and orientation of the user input device to define a second input.

19. The method of claim 16, wherein the second input is at least in part adjusted based on inertial data obtained from motion of the input device.

20. The method of claim 12, further comprising adjusting the user input based on processed inertial data received from an inertial sensor of the input device.