AUDIO AND POSITION CONTROL OF USER INTERFACE

• US 20100313133A1
• Filed: 06/08/2009
• Published: 12/09/2010
• Est. Priority Date: 06/08/2009
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Ma, Jeffrey, Tom, Dennis, Arthur, Erik, Green, Adam, Craig, Robert Matthew
• Application Number:
  US12/480,430
• Publication Number:
  US 20100313133A1
• Time in Patent Office: Days
• US Class Current: 715/728
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

A method is provided for using a wireless controller to interact with a user interface presented on a display. The method includes receiving an audio signal and a position signal from the wireless controller. The audio signal is based on an audio input applied to the wireless controller, while the position signal is based on a position input applied to the wireless controller. The method includes selecting a user interface item displayed on the display, based on the audio signal and the position signal. One or more position signals from the wireless controller may also be received and processed to cause navigation of the user interface to highlight a user interface item for selection.

Claims

1. A method of selecting a user interface item via a wireless controller, the method comprising:

displaying the user interface item on a display;

receiving an audio signal from the wireless controller, the audio signal being based on an audio input detected by the wireless controller;

receiving a position signal from the wireless controller, the position signal being based on a position input detected by the wireless controller;

recognizing a selection command based on the audio signal and the position signal; and

selecting the user interface item in response to recognition of the selection command.

2. The method of claim 1, where the position signal is an accelerometer output of the wireless controller and where the audio signal is a microphone output of the wireless controller.

3. The method of claim 1, where the selection command is defined by at least one of the audio signal and the position signal including a peak that exceeds a threshold value.

4. The method of claim 1, where the selection command is defined by frequency characteristics of the audio signal.

5. The method of claim 1, where the selection command is defined by the audio signal and the position signal occurring relative to one another within a predetermined time interval.

6. A method of navigating a user interface via a wireless controller, the method comprising:

displaying a plurality of user interface items on a display;

receiving a first position signal from the wireless controller, the first position signal being based on a first position input detected by the wireless controller;

recognizing a navigation command based on the first position signal;

displaying on the display a navigation action in response to recognizing the navigation command, where the navigation action includes moving a selection indicator to highlight one of the plurality of user interface items;

receiving an audio signal from the wireless controller, the audio signal being based on an audio input detected by the wireless controller;

receiving a second position signal from the wireless controller, the second position signal being based on a second position input detected by the wireless controller;

recognizing a selection command based on the audio signal and the second position signal; and

selecting said one of the plurality of user interface items in response to recognition of the selection command.

7. The method of claim 6, where the first position signal is a first accelerometer output of the wireless controller and the second position signal is a second accelerometer output of the wireless controller.

8. The method of claim 7, where the first accelerometer output indicates a positioning of the wireless controller at an angle, and where the navigation action is a vertical scrolling action that is based on the angle.

9. The method of claim 8, where if the angle is within a first range of values the vertical scrolling action includes upward scrolling and where if the angle is within a second range of values the vertical scrolling action includes downward scrolling.

10. The method of claim 7, where the navigation action is a horizontal scrolling operation controlled in response to the first accelerometer output.

11. The method of claim 7, where the second accelerometer output indicates motion in a direction axial to the wireless controller.

12. The method of claim 6, where the audio signal includes a peak and where the selection command is defined by the peak exceeding a threshold value.

13. The method of claim 6, where the second position signal includes a peak and where the selection command is defined by the peak exceeding a threshold value.

14. The method of claim 6, where the selection command is defined by the audio signal and the second position signal occurring relative to one another within a predetermined time interval.

15. A computing system including:

a display device configured to display a user interface having a plurality of user interface items;

a wireless controller including an accelerometer configured to detect one or more position inputs indicating a position of the wireless controller and output the position inputs as one or more position signals, the wireless controller further configured to detect one or more audio inputs into the wireless controller and output the audio inputs as one or more audio signals; and

an interface module implemented via executable instructions on a data-holding subsystem, the interface module being operatively coupled with the display device and the wireless controller, and configured to;

recognize a navigation command based on a first position signal received from the wireless controller, and in response, to display on the display a navigation action, the navigation action moving a selection indicator to highlight one of the plurality of user interface items; and

recognize a selection command based on an audio signal received from the wireless controller and a second position signal received from the wireless controller, and in response, select said one of the plurality of user interface items.

16. The computing system of claim 15, where the accelerometer is a three-axis accelerometer and where the wireless controller has a form factor of a handheld microphone.

17. The computing system of claim 15, where the first position signal is based on a first position output indicating a positioning of the wireless controller at an angle, and where the navigation action is a vertical scrolling action that is based on the angle.

18. The computing system of claim 17, where if the angle is within a first range of values the vertical scrolling action includes upward scrolling and where if the angle is within a second range of values the vertical scrolling action includes downward scrolling.

19. The computing system of claim 15, where the second position signal is based on a second position output indicating motion in a direction axial to the wireless controller.

20. The computing system of claim 15, where the selection command is defined by the audio signal and the second position signal occurring relative to one another within a predetermined time interval.