Custom narration of a control list via data binding

• US 9,817,632 B2
• Filed: 02/19/2013
• Issued: 11/14/2017
• Est. Priority Date: 02/19/2013
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Canitz, James Andrew
• Primary Examiner(s): Gaffin, Jeffrey A
• Assistant Examiner(s): Brahmachari, Mandrita
• Application Number:
  US13/769,826
• Publication Number:
  US 20140237370A1
• Time in Patent Office: 1,729 Days
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G09B 21/006 using audible presentation of the information

Abstract

In one embodiment, a user interface narrator may use data binding to associate an item control label 404 with a control list item 402. The user interface narrator may use a narration control 212 of an operating system 210 to vocalize a user interface 222 of an application module 220. The user interface narrator may receive from the application module 220 a control list item 402 associated with an item control label 404 via an item data binding. The user interface narrator may vocalize the item control label 404 with the narration control 212.

Claims

1. A machine-implemented method, comprising:

using a narration control of an operating system to vocalize a user interface of an application module;

receiving from the application module a control list describing user interface items of the user interface;

receiving in the control list a control list item representing a user interface item;

establishing a connection between the control list item and business logic via an item data binding having an item data converter;

converting the control list item with the item data converter into a format readable in an item control label containing a set of text to be vocalized by the narration control; and

vocalizing the set of text described by the item control label with the narration control to override a default narration of the user interface item.

2. The method of claim 1, further comprising:

receiving the control list item via an application binary interface.

3. The method of claim 1, further comprising:

converting a control list label based on a list data converter of the list data binding.

4. The method of claim 1, further comprising:

reading a control list label associated with the control list via a list data binding.

5. The method of claim 1, further comprising:

determining a user view of the user interface.

6. The method of claim 1, further comprising:

selecting the item control label based on a user view of the user interface.

7. The method of claim 1, further comprising:

associating the control list item with multiple labels via the item data binding.

8. The method of claim 1, further comprising:

vocalizing for the control data item a control list label associated with a control list containing the control data item via a list data binding.

9. The method of claim 1, further comprising:

narrating the item control label upon input control focus of the control list item.

10. The method of claim 1, further comprising:

re-narrating the item control label if input control focus remains on the control list item.

11. The method of claim 1, further comprising:

receiving a label update for the item control label.

12. A tangible machine-readable medium having a set of instructions detailing a method stored thereon that when executed by one or more processors cause the one or more processors to perform the method, the method comprising:

collecting a control list describing a user interface of an application module;

describing in a control list item of the control list a user interface item of the user interface;

creating a connection between the control list item and business logic via an item data binding having an item data converter;

converting the control list item with the item data converter into a format readable in an item control label containing a set of text to be vocalized by a narration control of an operating system; and

presenting the set of text described by the item control label to a narration control to override a default narration of the control list item.

13. The tangible machine-readable medium of claim 12, wherein the method further comprises:

providing the control list item to the narration control via an application binary interface.

14. The tangible machine-readable medium of claim 12, wherein the method further comprises:

associating the control list item with multiple labels via the item data binding.

15. The tangible machine-readable medium of claim 12, wherein the method further comprises:

creating a list data binding between a control list label and a control list.

16. The tangible machine-readable medium of claim 12, wherein the method further comprises:

converting the control list with a list data converter into a format readable in a list control label.

17. The tangible machine-readable medium of claim 12, wherein the method further comprises:

updating the item control label.

18. The tangible machine-readable medium of claim 12, wherein the method further comprises:

using extensible application markup language to create the item data binding.

19. A user interface narrator, comprising:

a memory configured to store an application module having a user interface an operating system having a narration control to vocalize the user interface of the application module;

a processor configured to execute;

the application module to collect a control list describing a user interface of an application module, to create a connection between the control list and business logic via a list data binding having a list data converter, and to convert the control list with the list data converter into a format readable in a control list label containing a set of text to be vocalized by the narration control, and

the narration control to vocalize the set of text described by the control list label to override a default narration of the user interface; and

an audio output configured to vocalize the set of text described by the control list label with the narration control to override a default narration of the control list item.

20. The user interface narrator of claim 19, wherein the application module creates an item data binding having a item data converter between a control list item of the control list and an item control label.