THREE-STATE TOUCH INPUT SYSTEM

• US 20110138284A1
• Filed: 12/03/2009
• Published: 06/09/2011
• Est. Priority Date: 12/03/2009
• Status: Active Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Wigdor, Daniel John, Perkins, Annuska Zolyomi, Lombardo, Jarrod, Hayes, Sean
• Application Number:
  US12/630,381
• Publication Number:
  US 20110138284A1
• Time in Patent Office: Days
• US Class Current: 715/727
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G09B 21/006 using audible presentation of the information

Abstract

A touch screen input device is provided which simulates a 3-state input device such as a mouse. One of these states is used to preview the effect of activating a graphical user interface element when the screen is touched. In this preview state touching a graphical user interface element on the screen with a finger or stylus does not cause the action associated with that element to be performed. Rather, when the screen is touched while in the preview state audio cues are provided to the user indicating what action would arise if the action associated with the touched element were to be performed.

Claims

1. A method of providing a user interface for a mobile device, comprising:

displaying one or more graphical user interface elements on a touch-screen;

receiving a first touch on the touch-screen at a location of the graphical user interface element; and

responding to receipt of the first touch by entering a preview state in which an audio cue is rendered indicating a function performed by the graphical user interface element.

2. The method of claim 1 further comprising:

receiving a second touch on the touch-screen while continuing to receive the first touch; and

responding to receipt of the second touch by entering a second state associated with the graphical user interface element that is different from the preview state.

3. The method of claim 2 wherein the second state allows the graphical user interface element to be dragged on the touch screen in response to movement of the first touch along the touch screen while in the second state.

4. The method of claim 2 wherein the second state is only entered if the second touch is received on a predefined portion of the touch-screen.

5. The method of claim 2 wherein the second state is only entered if the second touch is received on a portion of the touch screen that is less than a predefined distance away from the location at which the first touch is received.

6. The method of claim 1 wherein the graphical user interface element represents a portion of a user interface to an application that is executed on an electronic device and the function performed by the graphical user interface element causes the application to respond in a predefined manner.

7. The method of claim 6 wherein entering the preview state does not cause the application to respond in accordance with the function performed graphical user interface element.

8. The method of claim 2 further comprising:

detecting an absence of the second touch; and

in response to the absence of the second touch, returning to the preview state.

9. A touch screen display system for use in an electronic device, comprising:

a touch screen configured to receive user input and display one or more graphical user interface elements; and

an audio preview component configured to respond to receipt of a first touch on the touch screen at a location of the graphical user interface element by entering a preview state in which an audio cue is rendered indicating a function performed by the graphical user interface element.

10. The touch screen display system of claim 9 further comprising an application residing on the electronic device, the application having a user interface that includes the graphical user interface element, and wherein the audio preview component includes a text-to-speech converter component for converting text associated with the graphical user interface element into the audio cue, said text being exposed to the audio preview component by the application.

11. The touch screen display system of claim 9 further comprising a touch screen controller configured to respond to receipt of a second touch on the touch screen while continuing to receive the first touch by entering a second state associated with the graphical user interface element that is different from the preview state.

12. The touch screen display system of claim 11 wherein the second state allows the graphical user interface element to be dragged on the touch screen in response to movement of the first touch along the touch screen.

13. The touch screen display system of claim 11 wherein the second state is only entered if the second touch is received on a predefined portion of the touch-screen.

14. The touch screen display system of claim 11 wherein the second state is only entered if the second touch is received on a portion of the touch screen that is less than a predefined distance away from the location at which the first touch is received.

15. The touch screen display system of claim 9 further comprising an application residing on the electronic device, the application having a user interface that includes the graphical user interface element, wherein a function performed by the graphical user interface element causes the application to respond in a predefined manner.

16. A medium comprising instructions executable by a computing system, wherein the instructions configure the computing system to perform a method of interpreting a user contact on a touch screen, comprising:

presenting on a touch screen a graphical user interface element associated with the application; and

in response to user contact with a portion of the touch screen at which the graphical user interface element is located, generating an audio response that indicates an action performed by the application in response to selection of the graphical user interface element.

17. The medium of claim 16 wherein the audio response includes speech.

18. The medium of claim 17 wherein the speech identifies a function performed by activation of the graphical user interface element.

19. The medium of claim 16 wherein the graphical user interface element represents a portion of a user interface to an application that is executed on an electronic device and the function performed by the graphical user interface element causes the application to respond in a predefined manner.

20. The medium of claim 19 wherein the user contact does not cause the application to respond in accordance with the function performed by the graphical user interface element.