Modular systems and methods for selectively enabling cloud-based assistive technologies

• US 11,061,532 B2
• Filed: 02/05/2021
• Issued: 07/13/2021
• Est. Priority Date: 03/18/2016
• Status: Active Grant

• Current Assignee: AudioEye, Inc.
• Original Assignee: AudioEye, Inc.
• Inventors: Bradley, Sean D., Baker, Mark D., Jones, Jeffrey O., Hefner, Kenny P., Finkelstein, Adam, Gilormo, Douglas J., Bodnar, Taylor R., Pinckney, David C., Blevins, Charlie E., Jones, Trevor C., Laymon, Helena
• Primary Examiner(s): Zuberi, Mohammed H
• Application Number:
  US17/169,229
• Publication Number:
  US 20210157473A1
• Time in Patent Office: 158 Days
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06F 40/117 Tagging; Marking up details of markup languages G06F40/143; Designating a block; Setting of attributes style sheets, e.g. eXtensible Stylesheet Language Transformation [XSLT], G06F40/154
• CPC Class Codes: G06F 40/14 Tree-structured documents parsing G06F40/205; validation G06F40/226
• CPC Class Codes: G06F 40/143 Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]
• CPC Class Codes: G10L 13/02 Methods for producing synthetic speech; Speech synthesisers
• CPC Class Codes: G10L 13/027 Concept to speech synthesisers; Generation of natural phrases from machine-based concepts generation of parameters for speech synthesis out of text G10L13/08
• CPC Class Codes: G10L 15/02 Feature extraction for speech recognition; Selection of recognition unit
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2015/221 Announcement of recognition results
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34

Abstract

Methods and systems for manual and programmatic remediation of websites. JavaScript code is accessed by a user device and optionally calls TTS, ASR, and RADAE modules from a remote server to thereby facilitate website navigation by people with diverse abilities.

Claims

1. A computer-implemented method of programmatically assigning a descriptive attribute to an untagged element on a web page to enable an audible description of the untagged element, the web page having an associated document object model (DOM), the method comprising:

dynamically analyzing, by a computer system, code associated with the web page, the code comprising at least the DOM or HTML code;

detecting, by the computer system, one or more compliance issues relating to web accessibility standards in the code, wherein at least one of the one or more compliance issues comprises the untagged element lacking an adequate descriptive attribute;

applying, by the computer system, one or more pre-existing remediations to the one or more compliance issues, wherein the one or more pre-existing remediations is generated by a remote server system performing at least;

accessing the code associated with the web page;

receiving, by the remote server system, via a remediation interface input from a user, the input comprising a remediation action to manually remediate a non-programmatically-fixable compliance issue associated with the web page;

generating, by the remote server system, the one or more pre-existing remediations based on the input comprising the remediation action to manually remediate a non-programmatically-fixable compliance issue;

storing, by the remote server system, the one or more pre-existing remediations in an electronic data storage medium; and

assigning, by the computer system, a descriptive attribute to the untagged element in the code of the web page based on the one or more pre-existing remediations, the descriptive attribute assigned to the untagged element adapted to enable an assistive technology to speak the descriptive attribute to a user.

2. The computer-implemented method of claim 1, wherein the one or more pre-existing remediations are javascript.

3. The computer-implemented method of claim 1, wherein the untagged element is an input field.

4. The computer-implemented method of claim 1, wherein the untagged element is an image.

5. The computer-implemented method of claim 1, wherein the untagged element is a title element.

6. The computer-implemented method of claim 1, wherein the untagged element lacks the adequate descriptive attribute when one or more descriptive attributes of the untagged element are erroneous.

7. The computer-implemented method of claim 1, wherein the assigning comprises changing the DOM or HTML code associated with the web page.

8. The computer-implemented method of claim 1, wherein the descriptive attribute is an HTML label.

9. The computer-implemented method of claim 1, wherein the descriptive attribute is an alt-text label.

10. The computer-implemented method of claim 1, wherein the computer system comprises one or more computing systems.

11. A non-transitory electronic storage medium with computer code stored thereon, the computer code configured to programmatically assign a descriptive attribute to an element on a web page to enable an audible description of the element, the web page having an associated document object model (DOM), and the computer code configured to perform, when executed by a computer processor, the steps of:

dynamically analyzing, by a computer system, code associated with the web page, the code comprising at least the DOM or HTML code;

detecting, by the computer system, one or more compliance issues relating to web accessibility standards in the code, wherein at least one of the one or more compliance issues comprises the element lacking an adequate descriptive attribute;

applying, by the computer system, one or more pre-existing remediations to the one or more compliance issues, wherein the one or more pre-existing remediations is generated by a remote server system performing at least;

accessing the code associated with the web page;

receiving, by the remote server system, via a remediation interface input from a user, the input comprising a remediation action to manually remediate a non-programmatically-fixable compliance issue associated with the web page;

generating, by the remote server system, the one or more pre-existing remediations based on the input comprising the remediation action to manually remediate a non-programmatically-fixable compliance issue;

storing, by the remote server system, the one or more pre-existing remediations in an electronic data storage medium; and

assigning, by the computer system, a descriptive attribute to the element in the code of the web page based on the one or more pre-existing remediations, the descriptive attribute assigned to the element adapted to enable an assistive technology to speak the descriptive attribute to a user.

12. The non-transitory electronic storage medium with computer code stored thereon of claim 11, wherein the one or more pre-existing remediations are javascript.

13. The non-transitory electronic storage medium with computer code stored thereon of claim 11, wherein the element is an input field.

14. The non-transitory electronic storage medium with computer code stored thereon of claim 11, wherein the element is an image.

15. The non-transitory electronic storage medium with computer code stored thereon of claim 11, wherein the element is a title element.

16. The non-transitory electronic storage medium with computer code stored thereon of claim 11, wherein the element lacks the adequate descriptive attribute when one or more descriptive attributes of the element are erroneous.

17. The non-transitory electronic storage medium with computer code stored thereon of claim 11, wherein the assigning comprises changing the DOM or HTML code associated with the web page.

18. The non-transitory electronic storage medium with computer code stored thereon of claim 11, wherein the descriptive attribute is an HTML label.

19. The non-transitory electronic storage medium with computer code stored thereon of claim 11, wherein the descriptive attribute is an alt-text label.

20. The non-transitory electronic storage medium with computer code stored thereon of claim 11, wherein the computer system comprises one or more computing systems.