MODULAR SYSTEMS AND METHODS FOR SELECTIVELY ENABLING CLOUD-BASED ASSISTIVE TECHNOLOGIES

• US 20200371670A1
• Filed: 08/12/2020
• Published: 11/26/2020
• Est. Priority Date: 03/18/2016
• Status: Active Grant

• Current Assignee: AudioEye, Inc.
• Original Assignee: AudioEye, Inc.
• Inventors: Bradley, Sean D., Baker, Mark D., Jones, Jeffrey O., Hefner, Kenny P., Finkelstein, Adam, Gilormo, Douglas J., Bodnar, Taylor R., Pinckney, David C., Blevins, Charlie E., Laymon, Helena, Jones, Trevor C.
• Granted Patent: US 10,845,946 B1
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06F 40/117 Tagging; Marking up details of markup languages G06F40/143; Designating a block; Setting of attributes style sheets, e.g. eXtensible Stylesheet Language Transformation [XSLT], G06F40/154
• CPC Class Codes: G06F 40/14 Tree-structured documents parsing G06F40/205; validation G06F40/226
• CPC Class Codes: G06F 40/143 Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]
• CPC Class Codes: G10L 13/02 Methods for producing synthetic speech; Speech synthesisers
• CPC Class Codes: G10L 13/027 Concept to speech synthesisers; Generation of natural phrases from machine-based concepts generation of parameters for speech synthesis out of text G10L13/08
• CPC Class Codes: G10L 15/02 Feature extraction for speech recognition; Selection of recognition unit
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2015/221 Announcement of recognition results
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34

Abstract

Methods and systems for manual and programmatic remediation of websites. JavaScript code is accessed by a user device and optionally calls TTS, ASR, and RADAE modules from a remote server to thereby facilitate website navigation by people with diverse abilities.

Claims

1. A computer-implemented method of programmatically assigning a descriptive attribute to a graphic on a web page to enable an audible description of the graphic, the web page having an associated document object model (DOM), the method comprising:

accessing, by a computer system, a code associated with the web page;

detecting one or more compliance issues relating to web accessibility standards in the code, wherein at least one of the one or more compliance issues comprises a graphic lacking an adequate descriptive attribute; and

mapping the one or more compliance issues to one or more pre-existing remediation code, wherein the one or more pre-existing remediation code comprise at least;

accessing, by the computer system, the graphic to determine a subject matter of the graphic;

obtaining, by the computer system, the subject matter of the graphic from an artificial intelligence algorithm;

generating a descriptive attribute for the graphic based on at least the subject matter of the graphic; and

assigning, by the computer system, the descriptive attribute to the graphic.

2. The computer-implemented method of claim 1, wherein the graphic lacks the adequate descriptive attribute when one or more descriptive attributes of the graphic is erroneous.

3. The computer-implemented method of claim 1, wherein the code is the DOM or HTML for the web page.

4. The computer-implemented method of claim 1, wherein the one or more pre-existing remediation code is javascript.

5. The computer-implemented method of claim 1, wherein assigning the descriptive attribute to the graphic enables changing the DOM.

6. The computer-implemented method of claim 1, wherein assigning the descriptive attribute to the graphic enables changing HTML for the web page.

7. The computer-implemented method of claim 1, wherein the computer system comprises one or more computing systems.

8. The computer-implemented method of claim 1, further comprising:

assigning, by the computer system, a title attribute to the graphic based on at least the subject matter of the graphic.

9. The computer-implemented method of claim 1, wherein the computer-implemented method is performed on a periodic basis.

10. The computer-implemented method of claim 1, further comprising:

storing, by the computer system, the assignment of the descriptive attribute to the graphic in an electronic data storage medium for future remediation by a user accessing the web page.

11. The computer-implemented method of claim 1, wherein the artificial intelligence algorithm is applied by the computer system.

12. The computer-implemented method of claim 1, wherein the artificial intelligence algorithm is applied by a remote server, and wherein obtaining the subject matter of the graphic comprises receiving the subject matter of the graphic from the remote server.

13. The computer-implemented method of claim 1, further comprising:

storing, by the computer system, the assignment of the descriptive attribute to the graphic in an electronic data storage medium for future remediation by a user accessing the web page;

receiving, by the computer system, a remediation request from the user accessing the web page; and

returning, by the computer system, to the user, the assignment of the descriptive attribute to the graphic based on the remediation request.

14. A computer-implemented method of programmatically assigning a descriptive attribute to a graphic on a web page to enable an audible description of the graphic, the web page having an associated document object model (DOM), the method comprising:

executing, via a browser operating on a user computer, code embedded in the web page;

sending, by the user computer, a remediation request over an electronic network to a remote server, wherein the remediation request is for remediating the web page;

receiving, by the user computer from the remote server via the electronic network, at least one remediation code for remediating the web page;

executing, by the user computer, the at least one remediation code to remediate the web page to enable an audible description for an untagged graphic of the web page,

wherein the remote server generates the at least one remediation code by;

accessing, by the remote server, a code associated with the web page;

detecting one or more compliance issues relating to web accessibility standards in the code, wherein at least one of the one or more compliance issues comprises an untagged graphic; and

mapping the one or more compliance issues to one or more remediation code, wherein the one or more remediation code comprise at least;

instructing an image recognition server to determine a subject matter of the untagged graphic;

receiving, from the image recognition server, the subject matter of the untagged graphic;

generating a descriptive attribute for the untagged graphic based on the received subject matter of the untagged graphic; and

assigning, by the remote server, the descriptive attribute to the untagged graphic.

15. The computer-implemented method of claim 14, wherein the code is the DOM.

16. The computer-implemented method of claim 14, wherein the code is HTML for the web page.

17. The computer-implemented method of claim 14, wherein assigning the descriptive attribute to the untagged graphic enables revising the DOM.

18. The computer-implemented method of claim 14, wherein assigning the descriptive attribute to the untagged graphic enables revising HTML for the web page.

19. The computer-implemented method of claim 14, wherein the descriptive attribute is an alt text tag.

20. The computer-implemented method of claim 14, wherein the code embedded in the web page is javascript.

21. The computer-implemented method of claim 14, wherein the descriptive attribute is a title attribute.

22. The computer-implemented method of claim 14, wherein one or more descriptive attributes of the untagged graphic is erroneous.

23. The computer-implemented method of claim 14, wherein the image recognition server is separate from the remote server.

24. The computer-implemented method of claim 14, wherein the remote server generates the at least one remediation code on a periodic basis.

25. The computer-implemented method of claim 14, wherein the remote server generates the at least one remediation code by further storing, by the remote server, the assignment of the descriptive attribute to the untagged graphic in an electronic data storage medium for future remediation of the web page.

26. The computer-implemented method of claim 14, the remediation request comprises a unique identifier associated with the web page, the remediation request generated by the code embedded in the web page operating in the browser.

27. The computer-implemented method of claim 14, wherein instructing the image recognition server to return the subject matter of the untagged graphic comprises:

sending, to the image recognition server, a link to the untagged graphic.

28. The computer-implemented method of claim 14, wherein instructing the image recognition server to return the subject matter of the untagged graphic comprises:

sending, to the image recognition server, a file of the untagged graphic.

29. The computer-implemented method of claim 14, wherein the untagged graphic is a video.

30. The computer-implemented method of claim 14, wherein the at least one remediation code is javascript.