Reconfigurable clip-on modules for mobile computing devices

• US 10,437,411 B2
• Filed: 07/14/2017
• Issued: 10/08/2019
• Est. Priority Date: 01/18/2013
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Helmes, John, Taylor, Stuart, Hodges, Stephen E., Villar, Nicolas, Scott, James W.
• Primary Examiner(s): Renwick, Reginald A
• Application Number:
  US15/650,769
• Publication Number:
  US 20170315678A1
• Time in Patent Office: 816 Days
• CPC Class Codes: A63F 13/23 for interfacing with the game device, e.g. specific interfaces between game controller and console
• CPC Class Codes: A63F 13/24 Constructional details thereof, e.g. game controllers with detachable joystick handles
• CPC Class Codes: G06F 1/1632 External expansion units, e.g. docking stations
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials

Abstract

A set of reconfigurable clip-on modules for mobile computing devices includes two or more modules and at least one of the modules has an input button or other control and at least one of the modules can communicate with the computing device without needing to be connected to it via a wire. The input button is mapped to a user input in a program, such as a game, which is running or displayed on the computing device to which the modules are clipped. In an embodiment, user inputs via the buttons or other controls on the clip-on modules are mapped to user inputs in a game running on the device, which may be a touch-screen device, and the mapping between user inputs via the buttons and user inputs in the game may change dependent upon the game being played, user preference, or other criteria.

Claims

1. A set of reconfigurable input/output modules comprising at least two input/output modules, at least one of the input/output modules comprising:

an attachment mechanism for attaching the module to a position on a portion of a computing device including a touch screen;

an input control for providing user input to the computing device;

a depth camera configured to capture depth images usable for gesture detection;

an accelerometer configured to provide a signal usable for detecting movement of the at least one of the input/output modules; and

a wireless communication element configured to communicate with at least one of the computing device or another input/output module, wherein the wireless communication element is configured to transmit signals indicative of user inputs received via the input control to at least one of the computing device or another input/output module.

2. The set of reconfigurable input/output modules of claim 1, wherein the wireless communication element is further configured to transmit depth images captured by the depth camera to the computing device.

3. The set of reconfigurable input/output modules of claim 1, wherein the wireless communication element is further configured to transmit the signal usable for detecting movement of the at least one of the input/output modules to the computing device.

4. The set of reconfigurable input/output modules of claim 1, wherein at least one of the input/output modules further comprises a processor configured to:

receive a reconfiguration signal including reconfiguration instructions for changing at least one of the signals indicative of user inputs that are generated by at least one of the input/output modules in response to input to the input control; and

implement the reconfiguration instructions based on the input control.

5. The set of reconfigurable input/output modules of claim 4, wherein the processor is configured to implement the reconfiguration instructions by changing the at least one of the signals indicative of user inputs to a signal expected by a target program being executed on the computing device.

6. The set of reconfigurable input/output modules of claim 5, wherein the wireless communication element is configured to transmit the signal expected by the target program to the computing device in response to input to the input control.

7. The set of reconfigurable input/output modules of claim 1, wherein at least one of the input/output modules further comprises an output device configured to provide output selected from the group consisting of a visual indicator, an audible indicator, a tactile feedback, a temperature feedback, and an olfactory feedback.

8. The set of reconfigurable input/output modules of claim 1, wherein the input control is configured to be removably attachable to at least one of the input/output modules.

9. The set of reconfigurable input/output modules of claim 8, wherein at least one of the input/output modules is configured to removably attach to a plurality of different input controls.

10. The set of reconfigurable input/output modules of claim 9, wherein the plurality of different input controls include a four-way input control, a button input control, a tactile input control, an optical sensor input control, a capacitive sensor input control, and a joystick input control.

11. The set of reconfigurable input/output modules of claim 1, wherein each input/output module includes an input control, and wherein the set of reconfigurable input/output modules is configured to concurrently receive user input from more than one user.

12. The set of reconfigurable input/output modules of claim 11, wherein the at least two input/output modules are configured as a first pair of input/output modules configured to receive user input from a first user, and wherein the set of reconfigurable input/output modules further comprises a second pair of input/output modules configured to receive user input from a second user.

13. A set of reconfigurable input/output modules comprising at least two input/output modules, at least one of the input/output modules comprising:

a processor configured to receive a reconfiguration signal including reconfiguration instructions for changing at least one of the signals indicative of user inputs that are generated by at least one of the input/output modules in response to input to the input control, and implement the reconfiguration instructions based on the input control;

an attachment mechanism for attaching the module to a position on a portion of a computing device including a touch screen;

an input control for providing user input to the computing device;

a depth camera configured to capture depth images usable for gesture detection; and

a wireless communication element configured to communicate with at least one of the computing device or another input/output module, wherein the wireless communication element is configured to transmit signals indicative of user inputs received via the input control and depth images captured by the depth camera to at least one of the computing device or another input/output module.

14. The set of reconfigurable input/output modules of claim 13, wherein the processor is configured to implement the reconfiguration instructions by changing the at least one of the signals indicative of user inputs to a signal expected by a target program being executed on the computing device.

15. The set of reconfigurable input/output modules of claim 14, wherein the wireless communication element is configured to transmit the signal expected by the target program to the computing device in response to input to the input control.

16. A set of reconfigurable input/output modules comprising at least two input/output modules, at least one of the input/output modules comprising:

an attachment mechanism for attaching the module to a position on a portion of a computing device including a touch screen;

an input control for providing user input to the computing device, wherein the input control is configured to be removably attachable to at least one of the input/output modules;

a depth camera configured to capture depth images usable for gesture detection; and

a wireless communication element configured to communicate with at least one of the computing device or another input/output module, wherein the wireless communication element is configured to transmit signals indicative of user inputs received via the input control and depth images captured by the depth camera to at least one of the computing device or another input/output module.

17. The set of reconfigurable input/output modules of claim 16, wherein at least one of the input/output modules is configured to removably attach to a plurality of different input controls.

18. The set of reconfigurable input/output modules of claim 17, wherein the plurality of different input controls include a four-way input control, a button input control, a tactile input control, an optical sensor input control, a capacitive sensor input control, and a joystick input control.