Method and apparatus for interacting with a visually displayed document on a screen reader

• US 20070211071A1
• Filed: 12/20/2006
• Published: 09/13/2007
• Est. Priority Date: 12/20/2005
• Status: Abandoned Application

• Current Assignee: Benjamin Slotznick
• Original Assignee: Benjamin Slotznick
• Inventors: Slotznick, Benjamin, Sheetz, Stephen
• Application Number:
  US11/642,247
• Publication Number:
  US 20070211071A1
• Time in Patent Office: Days
• US Class Current: 345/594
• CPC Class Codes: G06F 16/957 Browsing optimisation, e.g. caching or content distillation
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems

Abstract

User interaction of a visually displayed document is provided via a graphical user interface (GUI). The document includes, and is parsed into, a plurality of text-based grammatical units. An input device modality is selected from a plurality of input device modalities which determines the type of input device in which a user interacts with to make a selection. One or more grammatical units of the document are then selected using the selected type of input device. Each grammatical unit that is selected is read aloud to the user by loading the grammatical unit into a text-to-speech engine. The text of the grammatical unit is thereby automatically spoken. Furthermore, a switching modality is selected from a plurality of switching modalities. The switching modality determines the manner in which one or more switches are used to make a selection. Using the selected switching modality, a user steps through at least some of the grammatical units in an ordered manner by physically activating one or more switches associated with the GUI. Each activation steps through one grammatical unit. Each grammatical unit that is stepped through is read aloud by loading the grammatical unit into a text-to-speech engine, thereby causing the text of the grammatical unit to be automatically spoken.

Claims

1. A method of interacting with a visually displayed document via a graphical user interface (GUI), wherein the document includes, and is parsed into, a plurality of text-based grammatical units, the method comprising:

(a) selecting a switching modality from a plurality of switching modalities, the switching modality determining the manner in which one or more switches are used to make a selection;

(b) using the selected switching modality, stepping through at least some of the grammatical units in an ordered manner by a user physically activating one or more switches associated with the GUI, each activation stepping through one grammatical unit; and

(c) reading aloud to the user each grammatical unit that is stepped through, each grammatical unit being read by loading the grammatical unit into a text-to-speech engine, the text of the grammatical unit thereby being automatically spoken.

2. The method of claim 1 wherein the document further includes one or more objects having associated text, wherein the objects have a predefined positional relationship to the grammatical units, and

step (b) further includes stepping through at least some of the grammatical units and the objects in an ordered manner by a user physically activating one or more switches associated with the GUI, each activation stepping through one grammatical unit or object;

and

step (c) further includes reading each grammatical unit or object that is stepped through, each grammatical unit or object being read by loading the grammatical unit or the associated text of the object into a text-to-speech engine, the text of the grammatical unit or object thereby being automatically spoken.

3. The method of claim 2 wherein one of the switching modalities uses a plurality of switches associated with the GUI, including a switch for activating the one or more objects.

4. The method of claim 1 wherein each switching modality has a plurality of document modes.

5. The method of claim 1 wherein each switching modality has a control mode with a plurality of controls.

6. The method of claim 1 further comprising:

(d) highlighting each grammatical unit when the grammatical unit is stepped to.

7. The method of claim 1 wherein one of the switching modalities uses at least three switches associated with the GUI, including a forward step switch, a backward step switch, and a repeat step switch, and step (b) allows for stepping through the grammatical units forwards, backwards, or by repeating.

8. The method of claim 1 wherein the grammatical units are sentences.

9. The method of claim 1 wherein the switching modality defines the number of switches used.

10. The method of claim 1 wherein the document is a web page.

11. An article of manufacture for interacting with a visually displayed document via a graphical user interface (GUI), wherein the document includes, and is parsed into, a plurality of text-based grammatical units, the article of manufacture comprising a computer-readable medium holding computer-executable instructions for performing a method comprising:

(a) selecting a switching modality from a plurality of switching modalities, the switching modality determining the manner in which one or more switches are used to make a selection;

(b) using the selected switching modality, stepping through at least some of the grammatical units in an ordered manner by a user physically activating one or more switches associated with the GUI, each activation stepping through one grammatical unit; and

(c) reading aloud to the user each grammatical unit that is stepped through, each grammatical unit being read by loading the grammatical unit into a text-to-speech engine, the text of the grammatical unit thereby being automatically spoken.

12. The article of manufacture of claim 11 wherein the document further includes one or more objects having associated text, wherein the objects have a predefined positional relationship to the grammatical units, and

step (b) further includes stepping through at least some of the grammatical units and the objects in an ordered manner by a user physically activating one or more switches associated with the GUI, each activation stepping through one grammatical unit or object;

and

step (c) further includes reading each grammatical unit or object that is stepped through, each grammatical unit or object being read by loading the grammatical unit or the associated text of the object into a text-to-speech engine, the text of the grammatical unit or object thereby being automatically spoken.

13. The article of manufacture of claim 12 wherein one of the switching modalities uses a plurality of switches associated with the GUI, including a switch for activating the one or more objects.

14. The article of manufacture of claim 11 wherein each switching modality has a plurality of document modes.

15. The article of manufacture of claim 11 wherein each switching modality has a control mode with a plurality of controls.

16. The article of manufacture of claim 11 wherein the computer-executable instructions perform a method further comprising:

(d) highlighting each grammatical unit when the grammatical unit is stepped to.

17. The article of manufacture of claim 11 wherein one of the switching modalities uses at least three switches associated with the GUI, including a forward step switch, a backward step switch, and a repeat step switch, and step (b) allows for stepping through the grammatical units forwards, backwards, or by repeating.

18. The article of manufacture of claim 11 wherein the grammatical units are sentences.

19. The article of manufacture of claim 11 wherein the switching modality defines the number of switches used.

20. The article of manufacture of claim 11 wherein the document is a web page.

21. An apparatus for interacting with a visually displayed document via a graphical user interface (GUI), wherein the document includes, and is parsed into, a plurality of text-based grammatical units, the apparatus comprising:

(a) means for selecting a switching modality from a plurality of switching modalities, the switching modality determining the manner in which one or more switches are used to make a selection;

(b) means for stepping through at least some of the grammatical units in an ordered manner by a user physically activating one or more switches associated with the GUI, each activation stepping through one grammatical unit, wherein the selected switching modality is used by the means for stepping; and

(c) means for reading aloud to the user each grammatical unit that is stepped through, each grammatical unit being read by loading the grammatical unit into a text-to-speech engine, the text of the grammatical unit thereby being automatically spoken.

22. The apparatus of claim 21 wherein the document further includes one or more objects having associated text, wherein the objects have a predefined positional relationship to the grammatical units, and

the means for stepping further includes means for stepping through at least some of the grammatical units and the objects in an ordered manner by a user physically activating one or more switches associated with the GUI, each activation stepping through one grammatical unit or object;

and

the means for reading further includes reading each grammatical unit or object that is stepped through, each grammatical unit or object being read by loading the grammatical unit or the associated text of the object into a text-to-speech engine, the text of the grammatical unit or object thereby being automatically spoken.

23. The apparatus of claim 22 wherein one of the switching modalities uses a plurality of switches associated with the GUI, including a switch for activating the one or more objects.

24. The apparatus of claim 21 wherein each switching modality has a plurality of document modes.

25. The apparatus of claim 21 wherein each switching modality has a control mode with a plurality of controls.

26. The apparatus of claim 21 further comprising:

(d) means for highlighting each grammatical unit when the grammatical unit is stepped to.

27. The apparatus of claim 21 wherein one of the switching modalities uses at least three switches associated with the GUI, including a forward step switch, a backward step switch, and a repeat step switch, and the means for stepping allows for stepping through the grammatical units forwards, backwards, or by repeating.

28. The apparatus of claim 21 wherein the grammatical units are sentences.

29. The apparatus of claim 21 wherein the switching modality defines the number of switches used.

30. The method of claim 21 wherein the document is a web page.

31. A method of interacting with a visually displayed document via a graphical user interface (GUI), wherein the document includes, and is parsed into, a plurality of text-based grammatical units, the method comprising:

(a) selecting an input device modality from a plurality of input device modalities which determines the type of input device in which a user interacts with to make a selection;

(b) using the selected type of input device, selecting one or more grammatical units of the document; and

(c) reading aloud to the user each grammatical unit that is selected, each grammatical unit being read by loading the grammatical unit into a text-to-speech engine, the text of the grammatical unit thereby being automatically spoken.

32. The method of claim 31 wherein the input device modality includes a pointing device modality and a modality that uses one or more switches.

33. The method of claim 31 wherein the grammatical units are sentences.

34. The method of claim 31 wherein the document is a web page.

43. The method of claim 32 wherein the input device modality operates non-exclusively.

35. An article of manufacture for interacting with a visually displayed document via a graphical user interface (GUI), wherein the document includes, and is parsed into, a plurality of text-based grammatical units, the article of manufacture comprising a computer-readable medium holding computer-executable instructions for performing a method comprising:

(a) selecting an input device modality from a plurality of input device modalities which determines the type of input device in which a user interacts with to make a selection;

(b) using the selected type of input device, selecting one or more grammatical units of the document; and

(c) reading aloud to the user each grammatical unit that is selected, each grammatical unit being read by loading the grammatical unit into a text-to-speech engine, the text of the grammatical unit thereby being automatically spoken.

36. The article of manufacture of claim 35 wherein the input device modality includes a pointing device modality and a modality that uses one or more switches.

37. The article of manufacture of claim 35 wherein the grammatical units are sentences.

38. The article of manufacture of claim 35 wherein the document is a web page.

44. The article of manufacture of claim 36 wherein the input device modality operates non-exclusively.

39. An apparatus for interacting with a visually displayed document via a graphical user interface (GUI), wherein the document includes, and is parsed into, a plurality of text-based grammatical units, the method comprising:

(a) means for selecting an input device modality from a plurality of input device modalities which determines the type of input device in which a user interacts with to make a selection;

(b) means for selecting one or more grammatical units of the document using the selected type of input device; and

(c) means for reading aloud to the user each grammatical unit that is selected, each grammatical unit being read by loading the grammatical unit into a text-to-speech engine, the text of the grammatical unit thereby being automatically spoken.

40. The apparatus of claim 39 wherein the input device modality includes a pointing device modality and a modality that uses one or more switches.

41. The apparatus of claim 39 wherein the grammatical units are sentences.

42. The apparatus of claim 39 wherein the document is a web page.

45. The method of claim 40 wherein the input device modality operates non-exclusively.