IMPLICIT NARRATION FOR AURAL USER INTERFACE

• US 20180143801A1
• Filed: 11/22/2016
• Published: 05/24/2018
• Est. Priority Date: 11/22/2016
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Stucker, Brian S., Lu, David, Ussher, Allen L., Bost, Jennifer L.
• Granted Patent: US 10,489,110 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/345 Summarisation for human users
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06Q 10/107 Computer-aided management of electronic mailing [e-mailing]
• CPC Class Codes: G06Q 50/01 Social networking
• CPC Class Codes: G10L 13/08 Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination

Abstract

A computing device and a method for controlling narration. The computing device comprises a display device displaying a visual user interface including textual information and an electronic processor configured to map the textual information to an implicit audio narration, wherein mapping textual information to the implicit audio narration has a scalable level of precision to the textual information depending on the visual user interface, and the electronic processor further configured to output the implicit audio narration.

Claims

1. A computing device comprising:

a display device displaying a visual user interface including textual information;

an electronic processor configured to;

map the textual information to an implicit audio narration, wherein mapping textual information to the implicit audio narration has a scalable level of precision to the textual information depending on the visual user interface, and

output the implicit audio narration.

2. The computing device of claim 1, wherein the electronic processor is further configured to

analyze the visual user interface, and

determine the scalable level of precision of mapping textual information to the implicit audio narration.

3. The computing device of claim 1, wherein the electronic processor is further configured to

map a first field of the textual information including a time-stamp to a first segment of the implicit audio narration, the first segment of the implicit audio narration including a relative indication of a duration associated with the time-stamp with respect to a reference time.

4. The computing device of claim 1, wherein the textual information is selected from a group consisting of an email, a text message, and a notification from a software application.

5. The computing device of claim 1, wherein the visual user interface including graphical information and the electronic processor is further configured to map the graphical information to the implicit audio narration.

6. The computing device of claim 1, wherein the electronic processor is further configured to

map a first field of the textual information to a first segment of the implicit audio narration, the first segment of the implicit audio narration including a variation of at least one of a vocabulary and grammar associated with the first field of the textual information.

7. The computing device of claim 1, wherein the electronic processor is further configured to

determine a fuzzy time grouping for a plurality of time-stamps associated with the textual information;

and

output the implicit audio narration including the fuzzy time grouping.

8. A method for controlling narration, the method comprising:

receiving a textual information from a visual user interface;

mapping, with an electronic processor, the textual information to an implicit audio narration, wherein the mapping of textual information to the implicit audio narration has a scalable level of precision to the textual information depending on the visual user interface, and

outputting the implicit audio narration.

9. The method of claim 8, further comprising:

analyzing, with the electronic processor, the textual information received from the visual user interface, and

determining the scalable level of precision of the mapping of each of the textual information to the implicit audio narration.

10. The method of claim 8, further comprising:

mapping, with the electronic processor, a first field of the textual information including a time-stamp to a first segment of the implicit audio narration, the first segment of the implicit audio narration including a relative indication of a time associated with the time-stamp with respect to a reference time.

11. The method of claim 8, further comprising:

mapping, with the electronic processor, a first field of the textual information to a first segment of the implicit audio narration, the first segment of the implicit audio narration including a variation of at least one of a vocabulary and a grammar associated with the first field of the textual information.

12. The method of claim 8, wherein the textual information is selected from a group consisting of an email, a text message, and a notification from a software application.

13. The method of claim 8, the method comprising:

receiving a graphical information from a visual user interface; and

mapping the graphical information to the implicit audio narration.

14. The method of claim 8, further comprising:

determining a fuzzy time grouping for a plurality of time-stamps associated with the plurality of textual information; and

outputting the implicit audio narration including the fuzzy time grouping.

19. The tangible machine-readable medium of claim 8, wherein the textual information is selected from a group consisting of an email, a text message, and a notification from a software application.

20. The tangible machine-readable medium of claim 8, wherein the method further comprising:

receiving a graphical information from a visual user interface; and

mapping the graphical information to the implicit audio narration.

15. A tangible machine-readable medium containing computer-executable instructions that when executed by one or more processors cause the one or more processors to perform a method for controlling narration, the method comprising:

receiving textual information from a visual user interface,

mapping the textual information to an implicit audio narration, wherein mapping textual information to the implicit audio narration has a scalable level of precision to the textual information depending on the visual user interface, and

outputting the implicit audio narration.

16. The tangible machine-readable medium of claim 15, wherein the method further comprises:

analyzing the visual user interface, and

determining the scalable level of precision of mapping textual information to the implicit audio narration.

17. The tangible machine-readable medium of claim 15, wherein the method further comprises:

mapping a first field of the textual information including a time-stamp to a first segment of the implicit audio narration, the first segment of the implicit audio narration including a relative indication of a time associated with the time-stamp.

18. The tangible machine-readable medium of claim 15, wherein the method further comprises:

mapping a first field of the textual information to a first segment of the implicit audio narration, the first segment of the implicit audio narration including a variation of at least one of a vocabulary and grammar associated with the first field of the textual information.