Modular systems and methods for selectively enabling cloud-based assistive technologies

• US 10,444,934 B2
• Filed: 03/18/2016
• Issued: 10/15/2019
• Est. Priority Date: 03/18/2016
• Status: Active Grant

• Current Assignee: AudioEye, Inc.
• Original Assignee: AudioEye, Inc.
• Inventors: Bradley, Sean D., Baker, Mark D., Jones, Jeffrey O., Hefner, Kenny P., Finkelstein, Adam, Gilormo, Douglas J., Bodnar, Taylor R., Pinckney, David C., Blevins, Charlie E., Jones, Trevor C., Laymon, Helena
• Primary Examiner(s): Zuberi, Mohammed H
• Application Number:
  US15/074,818
• Publication Number:
  US 20170269816A1
• Time in Patent Office: 1,306 Days
• Field of Search: 715234
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06F 40/117 Tagging; Marking up details of markup languages G06F40/143; Designating a block; Setting of attributes style sheets, e.g. eXtensible Stylesheet Language Transformation [XSLT], G06F40/154
• CPC Class Codes: G06F 40/14 Tree-structured documents parsing G06F40/205; validation G06F40/226
• CPC Class Codes: G06F 40/143 Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]
• CPC Class Codes: G10L 13/02 Methods for producing synthetic speech; Speech synthesisers
• CPC Class Codes: G10L 13/027 Concept to speech synthesisers; Generation of natural phrases from machine-based concepts generation of parameters for speech synthesis out of text G10L13/08
• CPC Class Codes: G10L 15/02 Feature extraction for speech recognition; Selection of recognition unit
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2015/221 Announcement of recognition results
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34

Abstract

Methods and systems for manual and programmatic remediation of websites. JavaScript code is accessed by a user device and optionally calls TTS, ASR, and RADAE modules from a remote server to thereby facilitate website navigation by people with diverse abilities.

Claims

1. A computer-implemented method of programmatically assigning descriptive alt text to an element on a web page to provide an audio description of the element, the web page having an associated document object model (DOM), the method comprising:

crawling, by a computer system, the DOM associated with the web page;

detecting one or more compliance issues relating to web accessibility standards in the DOM, wherein at least one of the one or more compliance issues comprises an untagged element having an associated hyperlink; and

mapping the one or more compliance issues to one or more pre-existing remediation scripts, wherein the one or more pre-existing remediation scripts comprise at least;

determining, by the computer system, a file path associated with the hyperlink; and

assigning, by the computer system, an alt text description to the untagged element based on the determined file path,

wherein the computer system comprises a computer processor and an electronic storage medium.

2. The computer-implemented method of claim 1, wherein the untagged element comprises a user prompt to “

Like Us on Facebook,” and

the file path comprises a link to a Facebook Like Us landing page.

3. The computer-implemented method of claim 1, wherein the untagged element comprises a user prompt to “

Follow Us on Twitter,” and

the file path comprises a link to a Twitter Follow Us landing page.

4. The computer-implemented method of claim 1, wherein the untagged element comprises a tracking pixel to count clicks.

5. The computer-implemented method of claim 1, wherein the untagged element comprises an advertisement.

6. The computer-implemented method of claim 1, wherein the computer system comprises a heuristics engine.

7. The computer-implemented method of claim 1, further comprising injecting, by the computer system, the assigned alt text description into the DOM when the web page renders.

8. The computer-implemented method of claim 1, further comprising periodically reevaluating, by the computer system, the assigned alt text description.

9. The computer-implemented method of claim 1, wherein the method is processed within the web page.

10. The computer-implemented method of claim 1, further comprising speaking, by the computer system, the alt text description to a user using an assistive technology.

15. The computer-implemented method of claim 10, wherein the assistive technology comprises a native screen reader.

16. The computer-implemented method of claim 10, wherein the assistive technology comprises an audio player embedded in JavaScript remediation code.

11. A computer-implemented method of programmatically assigning descriptive alt text to an image on a web page to provide an audio description of the image, the web page having an associated document object model (DOM), the method comprising:

crawling, by a computer system, associated with the web page;

detecting one or more compliance issues relating to web accessibility standards in the DOM, wherein at least one of the one or more compliance issues comprises an untagged image lacking an adequate alt text;

mapping the one or more compliance issues to one or more pre-existing remediation scripts, wherein the one or more pre-existing remediation scripts comprise at least;

sending, by the computer system, the image to a remote image recognition server to determine a nature of the image;

assigning, by the computer system, an alt text description to the image based on the determined nature of the image; and

speaking, by the computer system, the alt text description to a user using an assistive technology,

wherein the computer system comprises a computer processor and an electronic storage medium.

12. The computer-implemented method of claim 11, wherein the assistive technology comprises a native screen reader.

13. The computer-implemented method of claim 11, wherein the image recognition server comprises an image database and a recognition module for comparing the image to contents of the image database.

14. The computer-implemented method of claim 11, wherein the nature of the image comprises one or more of:

a landmark;

a location;

the name of an object;

or name of a person.

17. The computer-implemented method of claim 11, further comprising injecting, by the computer system, the assigned alt text description into the DOM when the web page renders.

18. The computer-implemented method of claim 11, further comprising periodically reevaluating, by the computer system, the assigned alt text description.

19. The computer-implemented method of claim 11, wherein the assistive technology comprises an audio player embedded in JavaScript remediation code.

20. The computer-implemented method of claim 11, wherein the computer system comprises a heuristics engine.

21. The computer-implemented method of claim 11, wherein the method is processed within the web page.