Spoken interfaces

• US 8,744,852 B1
• Filed: 12/20/2006
• Issued: 06/03/2014
• Est. Priority Date: 10/01/2004
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Seymour, Eric T., Fabrick, Richard W. II, Louch, John O., Yeh, Patti P.
• Primary Examiner(s): SAINT CYR, LEONARD
• Application Number:
  US11/643,389
• Time in Patent Office: 2,722 Days
• Field of Search: 704/258, 704/260, 704/270, 704/271
• US Class Current: 704/260
• CPC Class Codes: G06F 2203/04805 Virtual magnifying lens, i.e. window or frame movable on top of displayed information to enlarge it for better reading or selection
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04855 Interaction with scrollbars
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems

Abstract

A spoken interface is described for assisting a visually impaired user to obtain audible information and interact with elements displayed on a display screen. The spoken interface also enables access and control of other elements that are hidden by other windows. The interface receives user input data representing user inputs received by an input device and uses a movable selector to select an element of an application. The element selected by the selector may be either an editing type element or non-editing type element. The interface provides audio information regarding the selected editing or non-editing element and enables interaction with the selected element.

Claims

1. A method, comprising:

at a computing device with a display;

providing a plurality of user interface objects on a desktop, the plurality of user interface objects including an active application window and a first user interface object that is completely visually obscured by the active application window;

providing a pointer cursor and an accessibility cursor that is distinct from the pointer cursor;

while the first user interface object is completely visually obscured by the active application window, detecting a user input accessing the first user interface object with the accessibility cursor, independently of the pointer cursor; and

while the accessibility cursor is accessing the first user interface object, visually revealing the first user interface element from behind the active application window.

2. The method of claim 1, wherein visually revealing the first user interface element from behind the active application window is temporary.

3. The method of claim 2, wherein temporarily revealing the visual appearance of the first user interface element that is hidden behind the active application window lasts for a duration that a predetermined keyboard input is maintained by a user.

4. The method of claim 2, wherein temporarily revealing the visual appearance of the first user interface element that is hidden behind the active application window includes temporarily presenting a magnified view of the first user interface element over the active application window.

5. The method of claim 1, further comprising:

while the accessibility cursor is accessing the first user interface object, providing an audible description of the first user interface element.

6. The method of claim 1, wherein the user input accessing the first user interface object with the accessibility cursor is a user input that moves the accessibility cursor within one or more background applications.

7. A computing device, comprising:

a display;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

providing a plurality of user interface objects on a desktop, the plurality of user interface objects including an active application window and a first user interface object that is completely visually obscured by the active application window;

providing a pointer cursor and an accessibility cursor that is distinct from the pointer cursor;

while the first user interface object is completely visually obscured by the active application window, detecting a user input accessing the first user interface object with the accessibility cursor, independently of the pointer cursor; and

while the accessibility cursor is accessing the first user interface object, visually revealing the first user interface element from behind the active application window.

8. The device of claim 7, wherein visually revealing the first user interface element from behind the active application window is temporary.

9. The device of claim 8, wherein temporarily revealing the visual appearance of the first user interface element that is hidden behind the active application window lasts for a duration that a predetermined keyboard input is maintained by a user.

10. The device of claim 8, wherein temporarily revealing the visual appearance of the first user interface element that is hidden behind the active application window includes temporarily presenting a magnified view of the first user interface element over the active application window.

11. The device of claim 7, wherein the one or more programs further include instructions for:

while the accessibility cursor is accessing the first user interface object, providing an audible description of the first user interface element.

12. The device of claim 7, wherein the user input accessing the first user interface object with the accessibility cursor is a user input that moves the accessibility cursor within one or more background applications.

13. A non-transitory computer readable medium having stored therein instructions, which when executed by a device with a touch screen display, cause the device to:

provide a plurality of user interface objects on a desktop, the plurality of user interface objects including an active application window and a first user interface object that is completely visually obscured by the active application window;

provide a pointer cursor and an accessibility cursor that is distinct from the pointer cursor;

while the first user interface object is completely visually obscured by the active application window, detect a user input accessing the first user interface object with the accessibility cursor, independently of the pointer cursor; and

while the accessibility cursor is accessing the first user interface object, visually reveal the first user interface element from behind the active application window.

14. The non-transitory computer readable medium of claim 13, wherein visually revealing the first user interface element from behind the active application window is temporary.

15. The non-transitory computer readable medium of claim 14, wherein temporarily revealing the visual appearance of the first user interface element that is hidden behind the active application window lasts for a duration that a predetermined keyboard input is maintained by a user.

16. The non-transitory computer readable medium of claim 14, wherein temporarily revealing the visual appearance of the first user interface element that is hidden behind the active application window includes temporarily presenting a magnified view of the first user interface element over the active application window.

17. The non-transitory computer readable medium of claim 13, wherein the instructions further cause the device to:

while the accessibility cursor is accessing the first user interface object, provide an audible description of the first user interface element.

18. The non-transitory computer readable medium of claim 13, wherein the user input accessing the first user interface object with the accessibility cursor is a user input that moves the accessibility cursor within one or more background applications.

19. A graphical user interface on a computing device with a touch screen display, comprising:

a desktop;

a plurality of user interface objects provided on the desktop, the plurality of user interface objects including an active application window and a first user interface object that is completely visually obscured by the active application window;

a pointer cursor; and

an accessibility cursor that is distinct from the pointer cursor, wherein;

while the first user interface object is completely visually obscured by the active application window, a user input accessing the first user interface object with the accessibility cursor independently of the pointer cursor is detected; and

while the accessibility cursor is accessing the first user interface object, the first user interface element is visually revealed from behind the active application window.