Modular systems and methods for selectively enabling cloud-based assistive technologies

• US 10,896,286 B2
• Filed: 08/12/2020
• Issued: 01/19/2021
• Est. Priority Date: 03/18/2016
• Status: Active Grant

• Current Assignee: AudioEye, Inc.
• Original Assignee: AudioEye, Inc.
• Inventors: Bradley, Sean D., Baker, Mark D., Jones, Jeffrey O., Hefner, Kenny P., Finkelstein, Adam, Gilormo, Douglas J., Bodnar, Taylor R., Pinckney, David C., Blevins, Charlie E., Laymon, Helena, Jones, Trevor C., Carrillo, Damien M.
• Primary Examiner(s): Zuberi, Mohammed H
• Application Number:
  US16/991,671
• Publication Number:
  US 20200372205A1
• Time in Patent Office: 160 Days
• CPC Class Codes: G06F 16/22 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9577 Optimising the visualization of content, e.g. distillation of HTML documents
• CPC Class Codes: G06F 16/986 Document structures and storage, e.g. HTML extensions
• CPC Class Codes: G06F 21/101 by binding digital rights to specific entities
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06F 40/103 Formatting, i.e. changing of presentation of documents automatic justification G06F40/189; automatic line break hyphenation G06F40/191
• CPC Class Codes: G06F 40/134 Hyperlinking
• CPC Class Codes: G06F 40/137 Hierarchical processing, e.g. outlines
• CPC Class Codes: G06F 40/14 Tree-structured documents parsing G06F40/205; validation G06F40/226
• CPC Class Codes: G06F 40/174 Form filling; Merging
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06N 5/022 Knowledge engineering; Knowledge acquisition
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems

Abstract

Systems and methods are disclosed for manually and programmatically remediating websites to thereby facilitate website navigation by people with diverse abilities. For example, an administrator portal is provided for simplified, form-based creation and deployment of remediation code, and a machine learning system is utilized to create and suggest remediations based on past remediation history. Voice command systems and portable document format (PDF) remediation techniques are also provided for improving the accessibility of such websites.

Claims

1. A computer-implemented method of programmatically assigning a descriptive attribute to an untagged element on a web page to enable an audible description of the untagged element, the web page having an associated document object model (DOM), the computer-implemented method comprising:

accessing, by a computer system, a code associated with the web page, the code comprising at least HTML or the DOM;

identifying, by the computer system, a set of compliance issues relating to web accessibility standards in the code, wherein the set of compliance issues are associated with an untagged set of elements on the web page;

generating, by the computer system applying a machine learning algorithm, one or more remediation code that are applicable to remediate a compliance issue of the set of compliance issues, wherein the machine learning algorithm is configured to;

compare the compliance issue with previously resolved issues to identify a previously resolved issue;

identify a remediation code from a remediation data storage medium, wherein the remediation code was applied to the previously resolved issue; and

modify the remediation code based on the compliance issue;

storing the generated one or more remediation code in the remediation data storage medium; and

retrieving the generated one or more remediation code from the remediation data storage medium and transmitting the generated one or more remediation code through an electronic network to a user computer, the user computer configured to execute the generated one or more remediation code to remediate the compliance issue in the web page being accessed by the user computer.

2. The computer-implemented method of claim 1, wherein execution of at least one of the generated one or more remediation code causes an assignment of a descriptive attribute to an untagged element on the web page.

3. The computer-implemented method of claim 2, wherein the assignment comprises changing HTML code or the DOM associated with the web page.

4. The computer-implemented method of claim 1, wherein the one or more remediation code is javascript.

5. The computer-implemented method of claim 1, wherein the remediation data storage medium comprises one or more electronic storage mediums.

6. The computer-implemented method of claim 1, wherein the computer system comprises one or more computer systems connected via an electronic network.

7. The computer-implemented method of claim 1, wherein identifying the set of compliance issues is performed using a scanning and detection system.

8. The computer-implemented method of claim 1, wherein the machine learning algorithm is associated with a heuristics engine, and wherein the heuristics engine is used to identify the remediation code from the remediation data storage medium.

9. The computer-implemented method of claim 1, wherein the machine learning algorithm is further configured to determine a confidence level associated with the generated one or more remediation code.

10. The computer-implemented method of claim 1, wherein the machine learning algorithm compares the compliance issue with previously resolved issues based on an unsupervised learning technique.

11. The computer-implemented method of claim 1, wherein the machine learning algorithm performs classification to compare the compliance issue with previously resolved issues.

12. The computer-implemented method of claim 1, further comprising:

determining a confidence level associated with each of the one or more remediation code; and

automatically applying the one or more remediation code if the confidence level associated with each of the one or more remediation code is over a predetermined threshold.

13. A computer-implemented method of programmatically assigning a descriptive attribute to an untagged element on a web page to enable an audible description of the element, the web page having an associated document object model (DOM), the computer-implemented method comprising:

accessing, by a computer system, a code associated with the web page, the code comprising at least HTML or the DOM;

identifying, by the computer system, a set of compliance issues relating to web accessibility standards in the code, wherein the set of compliance issues are associated with an untagged set of elements on the web page;

suggesting, by the computer system applying a machine learning algorithm, a remediation code that is applicable to remediate a compliance issue of the set of compliance issues, wherein the machine learning algorithm is configured to;

compare the compliance issue with previously resolved issues to identify a previously resolved issue; and

identify the remediation code from a remediation data storage medium, wherein the remediation code was applied to the previously resolved issue;

storing the suggested remediation code in the remediation data storage medium; and

retrieving the suggested remediation code from the remediation data storage medium and transmitting the suggested remediation code through an electronic network to a user computer, the user computer configured to execute the suggested remediation code to remediate the compliance issue in the web page being accessed by the user computer.

14. The computer-implemented method of claim 13, wherein execution of the remediation code causes an assignment of a descriptive attribute to an untagged element on the web page.

15. The computer-implemented method of claim 14, wherein the assignment comprises changing HTML code or the DOM associated with the web page.

16. The computer-implemented method of claim 13, wherein the remediation code is javascript.

17. The computer-implemented method of claim 13, the remediation data storage medium comprising one or more electronic storage mediums.

18. The computer-implemented method of claim 13, wherein the computer system comprises one or more computer systems connected via an electronic network.

19. The computer-implemented method of claim 13, wherein identifying the set of compliance issues is performed using a scanning and detection system.

20. The computer-implemented method of claim 13, wherein the machine learning algorithm is associated with a heuristics engine, and wherein the heuristics engine is used to identify the remediation code from the remediation data storage medium.