Assistive technology notifications for relevant metadata changes in a document

• US 10,452,414 B2
• Filed: 06/30/2016
• Issued: 10/22/2019
• Est. Priority Date: 06/30/2016
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Hayes, Edward Sean, Burg, Stephanie Lyn, Reid, Paul James, Fox, Seth David
• Primary Examiner(s): Ries, Laurie A
• Application Number:
  US15/199,841
• Publication Number:
  US 20180004547A1
• Time in Patent Office: 1,209 Days
• CPC Class Codes: G06F 16/1873 Versioning file systems, temporal file systems, e.g. file system supporting different historic versions of files
• CPC Class Codes: G06F 16/2358 Change logging, detection, and notification replication G06F16/27
• CPC Class Codes: G06F 16/93 Document management systems
• CPC Class Codes: G06F 40/166 Editing, e.g. inserting or deleting
• CPC Class Codes: G06F 40/226 Validation
• CPC Class Codes: G06F 40/232 Orthographic correction, e.g. spell checking or vowelisation
• CPC Class Codes: G06F 40/253 Grammatical analysis; Style critique
• CPC Class Codes: G06F 9/453 Help systems
• CPC Class Codes: G06F 9/542 Event management; Broadcasting; Multicasting; Notifications

Abstract

User interface information related to relevant events of interest is provided. Events can occur anywhere in a document, and may or may not be relevant to a user utilizing an assistive technology (AT) application, such as a screen reader. A provider-side signaling system component determines whether raised events are relevant to the user. In some examples, when an application makes a plurality of attribute changes in a document at once, the signaling provider batches the related events as a single transaction, and generates a generalized annotation describing the changes. The signaling provider further packages the event notification, and sends the event notification to a client-side signaling system component. The signaling client receives the notification, and determines whether to alert the user of the event(s) based on verbosity settings. The AT application is enabled to interpret the event notification and alert the user in a meaningful way.

Claims

1. A computer-implemented method for providing a signaling system for notifying a user of an assistive technology (AT) application of metadata changes in a document authored by a productivity application, comprising:

receiving, at the AT application, an event notification of an attribute change in the document from the productivity application, the attribute change determined by the productivity application to be relevant to the user;

determining whether to alert the user of the attribute change based on verbosity settings; and

when a determination is made to alert the user of the attribute change, generating an alert for notifying the user of the attribute change.

2. The computer-implemented method of claim 1, wherein the attribute change is determined to be relevant to the user when a location of the attribute change is within a text range that is considered relevant to the user based on a type of the attribute change.

3. The computer-implemented method of claim 1, further comprising:

receiving, at the AT application, a string describing the attribute change.

4. The computer-implemented method of claim 3, wherein when the attribute change comprises a plurality of attribute changes:

the plurality of attribute changes are aggregated; and

a string describing the plurality of attribute changes is received at the AT application for enabling the AT application to communicate a general summary of the plurality of attribute changes.

5. The computer-implemented method of claim 3, wherein receiving the event notification further comprises receiving a payload with the event notification, the payload comprising:

an identifier for the attribute change; and

the string describing the attribute change.

6. The computer-implemented method of claim 5, wherein determining whether to alert the user of the attribute change based on the verbosity settings comprises determining whether to alert the user of the attribute change based on whether the user has selected one of:

a quiet verbosity setting;

a discreet verbosity setting; and

a full verbosity setting.

7. The computer-implemented method of claim 6, wherein when the quiet verbosity setting is selected, making a determination to not alert the user of the attribute change.

8. The computer-implemented method of claim 6, wherein when the discreet verbosity setting is selected, making a determination to provide an audible alert based on a type of attribute change on a parallel audio channel mixed over text narration by the AT application.

9. The computer-implemented method of claim 6, wherein when the full verbosity setting is selected, making a determination to provide an announcement of the string describing the attribute change.

10. The computer-implemented method of claim 1, wherein determining whether to alert the user of the attribute change based on the verbosity settings further comprises determining when to alert the user.

11. The computer-implemented method of claim 10, wherein determining when to alert the user comprises determining to alert the user after a space or other word-breaking opportunity character is identified and echoed by the AT application.

12. A system for notifying a user of an assistive technology (AT) application of metadata changes in a document authored by a productivity application, the system comprising a computing device, the computing device comprising:

at least one processing device; and

at least one computer readable data storage device storing instructions for the productivity application that, when executed by the at least one processing device, are operative to;

receive, at the productivity application, an indication of a change of an attribute on a text range in the document;

determine whether the attribute change is relevant to the user; and

when a determination is made that the attribute change is relevant to the user, send an event notification of the attribute change to the AT application to enable an alert notifying the user of the attribute change to be generated and provided to the user based on verbosity settings.

13. The system of claim 12, wherein in determining whether the attribute change is relevant to the user, the instructions are operative to:

identify a type of the attribute change and a location of the attribute change; and

make a determination as to whether the location of the attribute change is within a text range that is considered relevant to the user based on the type of the attribute change.

14. The system of claim 12, wherein the instructions are further operative to generate a string describing the attribute change.

15. The system of claim 14, wherein when the attribute change comprises a plurality of attribute changes, the instructions are operative to:

aggregate the plurality of attribute changes; and

generate a string describing the plurality of attribute changes for enabling the AT application to communicate a general summary of the plurality of attribute changes.

16. The system of claim 14, wherein in sending the event notification of the attribute change to the AT application to enable the alert notifying the user of the attribute change to be generated and provided to the user based on the verbosity settings, the instructions are further operative to include a payload with the event notification, the payload comprising:

an identifier for the attribute change; and

the string describing the attribute change.

17. The system of claim 16, wherein the verbosity settings are selected by the user and include one of:

a quiet verbosity setting;

a discreet verbosity setting; and

a full verbosity setting.

18. The system of claim 17, wherein:

when the quiet verbosity setting is selected, an alert is not provided to the user;

when the discreet verbosity setting is selected, an audible alert based on a type of the attribute change is provided on a parallel audio channel mixed over text narration by the AT application; and

when the full verbosity setting is selected, an announcement of the string describing the attribute change is provided.

19. A computer readable storage device including computer readable instructions, which when executed by a processing unit is operative to:

receive, at a productivity application, an indication of a change of an attribute on a text range in a document authored by the productivity application;

determine whether the attribute change is relevant to a user of an assistive technology (AT) application; and

when a determination is made that the attribute change is relevant to the user, send an event notification of the attribute change to the AT application to enable an alert notifying the user of the attribute change to be generated and provided to the user based on verbosity settings.

20. The computer readable storage device of claim 19, further comprising when the attribute change comprises a plurality of attribute changes, aggregate the plurality of attribute changes;

generate a string describing the plurality of attribute changes for enabling the AT application to communicate a general summary of the plurality of attribute changes; and

send the event notification including a payload comprising;

an identifier for the attribute change; and

the string describing the attribute change.