Method of displaying web pages to enable user access to text information that the user has difficulty reading

• US 7,194,411 B2
• Filed: 02/25/2002
• Issued: 03/20/2007
• Est. Priority Date: 02/26/2001
• Status: Active Grant

• Current Assignee: Smartsheet Inc.
• Original Assignee: Benjamin Slotznick
• Inventors: Sheetz, Stephen C., Slotznick, Benjamin
• Primary Examiner(s): Dorvil, Richemond
• Assistant Examiner(s): Shortledge, Thomas E.
• Application Number:
  US10/084,582
• Publication Number:
  US 20020178007A1
• Time in Patent Office: 1,849 Days
• Field of Search: 704/1, 704/9, 704/260, 704/270, 704/271, 704/270.1
• US Class Current: 704/271
• CPC Class Codes: G09B 5/06 with both visual and audible presentation of the material to be studied
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems

Abstract

Web pages and other text documents displayed on a computer are reformatted to allow a a user who has difficulty reading to navigate between and among such documents and to have such documents, or portions of them, read aloud by the computer using a text-to-speech engine in their original or translated form while preserving the original layout of the document. A “point-and-read” paradigm allows a user to cause the text to be read solely by moving a pointing device over graphical icons or text without requiring the user to click on anything in the document. Hyperlink navigation and other program functions are accomplished in a similar manner.

Claims

1. A method of translating an original web page to a visiually displayable text-to-speech enabled web page, the original web page being defined by source code including at least text designated for display, the method comprising:

(a) parsing the text of the source code designated for display into one or more grammatical units;

(b) associating a tag with each of the grammatical units;

(c) associating an event handler with each of the tags, the event handler invokes text-to-speech software code; and

(d) reassembling the original web page source code with the associated tags and event handlers to form visually displayable text-to-speech enabled web page source code, wherein when an event associated with an event handler occurs during user interaction with a display of a text-to-speech enabled web page, the text-to-speech software code causes the grammatical unit associated with the tag of the event handler to be automatically spoken.

2. The method of claim 1 wherein the user interacts with the display via a pointing device, and the event is a MouseOver event associated with the pointing device.

3. The method of claim 2 wherein each tag has an active region and the event handler delays invoking the text-to-speech software code until the pointing device persists in the active region of a tag for greater than a preset time period.

4. The method of claim 3 wherein the preset time period is a human perceivable time period.

5. The method of claim 1 wherein the source code further includes one or more images designated for display, one or more of the images including an associated text message, step (c) further comprising associating an event handler that invokes text-to-speech software code with each of the images that have an associated text message, and step (d) further comprising reassembling the original web page source code with the image-related event handlers, wherein when an event associated with an image-related event handler occurs during user interaction with an image in a display of a text-to-speech enabled web page, the text-to-speech software code causes the associated text message of the image to be automatically spoken.

6. The method of claim 1 wherein the grammatical units are sentences.

7. The method of claim 1 wherein the tag is a span tag.

8. The method of claim 1 wherein in step (c), the event handler invokes the text-to-speech software code by calling a function associated with a scipting language that executes text-to-speech software code.

9. The method of claim 1 wherein at least one of the grammatical units is a link having an associated address, the method further comprising:

(e) replacing the associated address of any links with a new address that invokes a software program, the software program retrieving the source code at the associated address and then causing steps (a)–

(e) to be repeated for the retrieved source code, wherein the new address becomes part of the text-to-speech enabled web page source code.

10. A method of translating an original document to a visually displayable text-to-speech enabled document, the original document including at least text, the method comprising:

(a) parsing the text of the original document into one or more grammatical units;

(b) associating a tag with each of the grammatical units;

(c) associating an event handler with each of the tags, the event handler invokes text-to-speech software code; and

(d) reassembling the original document with the associated tags and event handlers to form a visually displayable text-to-speech enabled document, wherein when an event associated with an event handler occurs during user interaction with a display of a text-to-speech enabled document, the text-to-speech software code causes the grammatical unit associated with the tag of the event handler to be automatically spoken.

11. The method of claim 10 wherein the grammatical units are sentences.

12. A method of allowing a user to interact with a web page displayed on a display device, wherein the web page includes one or more links that have an associated text message, the method comprising:

(a) positioning a pointing device over a link, the link being automatically highlighted whenever the pointing device is over the link;

(b) automatically loading the associated text message of the link into a text-to-speech engine, the associated text message thereby being automatically spoken; and

(c) automatically navigating to the address of the link, wherein steps (a), (b) and (c) occur sequentially and without requiring any further user manipulation of the pointing device or any other user interfaces associated with display device.

13. The method of claim 12 wherein step (c) occurs only if the pointing device persists over the link for greater than a preset time period.

14. The method of claim 13 wherein the preset time period is a human perceivable time period.

15. The method of claim 13 wherein the preset time period is at least about one second.

16. The method of claim 12 wherein the link is hypertext and the associated text message is the text of the hypertext.

17. The method of claim 12 wherein the link is an image and the associated text message is alternate text of the image.

18. An article of manufacture for translating an original web page to a visually displayable text-to-speech enabled web page, the original web page being defined by source code including at least text designated for display, the article of manufacture comprising a computer-readable medium holding computer-executable instructions for performing a method comprising:

(a) parsing the text of the source code designated for display into one or more grammatical units;

(b) associating a tag with each of the grammatical units;

(c) associating an event handler with each of the tags, the event handler invokes text-to-speech software code; and

(d) reassembling the original web page source code with the associated tags and event handlers to form visually displayable text-to-speech enabled web page source code, wherein when an event associated with an event handler occurs during user interaction with a display of a text-to-speech enabled web page, the text-to-speech software code causes the grammatical unit associated with the tag of the event handler to be automatically spoken.

19. The article of manufacture of claim 18 wherein the user interacts with the display via a pointing device, and the event is a MouseOver event associated with the pointing device.

20. The article of manufacture of claim 19 wherein each tag has an active region and the event handler delays invoking the text-to-speech software code until the pointing device persists in the active region of a tag for greater than a preset time period.

21. The article of manufacture of claim 20 wherein the preset time period is a human perceivable time period.

22. The article of manufacture of claim 18 wherein the source code further includes one or more images designated for display, one or more of the images including an associated text message, step (c) further comprising associating an event handler that invokes text-to-speech software code with each of the images that have an associated text message, and step (d) further comprising reassembling the original web page source code with the image-related event handlers, wherein when an event associated with an image-related event handler occurs during user interaction with an image in a display of a text-to-speech enabled web page, the text-to-speech software code causes the associated text message of the image to be automatically spoken.

23. The article of manufacture of claim 18 wherein the grammatical units are sentences.

24. The article of manufacture of claim 18 wherein the tag is a span tag.

25. The article of manufacture of claim 18 wherein in step (c), the event handler invokes the text-to-speech software code by calling a function associated with a scripting language that executes text-to-speech software code.

26. The article of manufacture of claim 18 wherein at least one of the grammatical units is a link having an associated address, and the computer-executable instructions perform a method further comprising:

(e) replacing the associated address of any links with a new address that invokes a software program, the software program retrieving the source code at the associated address and then causing steps (a)–

(e) to be repeated for the retrieved source code, wherein the new address becomes part of the text-to-speech enabled web page source code.

27. An article of manufacture for translating an original document to a visually displayable text-to-speech enabled document, the original document including at least text, the article of manufacture comprising a computer-readable medium holding computer-executable instructions for performing a method comprising:

(a) parsing the text of the original document into one or more grammatical units;

(b) associating a tag with each of the grammatical units;

(c) associating an event handler with each of the tags, the event handler invokes text-to-speech software code; and

(d) reassembling the original document with the associated tags and event handlers to form a visually displayable text-to-speech enabled document, wherein when an event associated with an event handler occurs during user interaction with a display of a text-to-speech enabled document, the text-to-speech software code causes the grammatical unit associated with the tag of the event handler to be automatically spoken.

28. The article of manufacture of claim 27 wherein the grammatical units are sentences.

29. An article of manufacture for allowing a user to interact with a web page displayed on a display device, wherein the web page includes one or more links that have an associated text message, the article of manufacture comprising a computer-readable medium holding computer-executable instructions for performing a method comprising:

(a) positioning a pointing device over a link, the link being automatically highlighted whenever the pointing device is over the link;

(b) automatically loading the associated text message of the link into a text-to-speech engine, the associated text message thereby being automatically spoken; and

(c) automatically navigating to the address of the link, wherein steps (a), (b) and (c) occur sequentially and without requiring any further user manipulation of the pointing device or any other user interfaces associated with display device.

30. The article of manufacture of claim 29 wherein step (c) occurs only if the pointing device persists over the link for greater than a preset time period.

31. The article of manufacture of claim 30 wherein the preset time period is a human perceivable time period.

32. The article of manufacture of claim 30 wherein the preset time period is at least about one second.

33. The article of manufacture of claim 29 wherein the link is hypertext and the associated text message is the text of the hypertext.

34. The article of manufacture of claim 29 wherein the link is an image and the associated text message is alternate text of the image.