Conveying the importance of display screen data using audible indicators

• US 7,336,256 B2
• Filed: 01/30/2004
• Issued: 02/26/2008
• Est. Priority Date: 01/30/2004
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: International Business Machines Corporation
• Inventors: Parzygnat, Kenneth James, Uthe, Robert Thomas
• Primary Examiner(s): Hjerpe; Richard
• Assistant Examiner(s): Said; Mansour M.
• Application Number:
  US10/768,906
• Publication Number:
  US 20050168436A1
• Time in Patent Office: 1,488 Days
• Field of Search: 345156-170, 345172-175, 345179-184, 345 87- 88, 345/98, 345/214, 345700-701, 345/710, 715/858, 715/862
• US Class Current: 345/156
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

An audible indicator such as an audio tone is associated with the importance of data elements displayed on a visual display screen of data processing apparatus such as a personal computer or work station. At least one characteristic of the audible indicator, for example its pitch or frequence of a tone, is associated with the importance of the data elements. When a user selects a particular date element on the screen, for example using a computer mouse, the audible indicator conveys the importance of the selected data element to the user. This enables visually impaired users to readily locate important data elements on a display screen without reading the entire screen using a screen reader.

Claims

1. A method for conveying the importance of display screen data, comprising the steps of:

identifying a data element selected by a user on a visual display screen;

determining the importance of the identified data element; and

providing an audible indicator to convey the importance of the identified data element to the users;

wherein the audible indicator is selected from the set of audible indicators that consists of an audio tone whose pitch varies in dependence upon the importance of the identified data element, a periodic train of audible clicks with a period that varies in dependence upon the importance of the identified data element, an audio signal that varies between a plurality of audible tones at a rate that depends upon the importance of the identified data element, and an audio signal that varies between two audible tones at a rate that depends upon the importance of the identified data element wherein one of the two tones is essentially silent and the other is not, so as to convey a periodic train of audible beeps to the user with a period that varies in dependence upon the importance of the data element.

2. The method of claim 1, wherein the data element is identified according to a screen location indicated by a computer mouse operated by the user.

3. The method of claim 1, wherein the data element is identified according to a screen location indicated by a computer track ball operated by the user.

4. The method of claim 1, wherein the data element is identified according to a screen location indicated by a computer touch pad operated by the user.

5. The method of claim 1, wherein the data element is identified according to a tab key operated by the user.

6. The method of claim 1, wherein the data element is identified according to position keys operated by the user.

7. The method of claim 1, wherein the data element is identified according to instructions spoken by the user.

8. The method of claim 1, wherein the data element is a form field that accepts input from the user.

9. The method of claim 1, wherein the importance of the data element is determined by reading an encoding that explicitly gives the importance.

10. The method of claim 1, wherein the importance of the data element is determined by reading an encoding and deducing the importance from the read encoding.

11. The method of claim 10, wherein the encoding indicates a display color.

12. A program storage device readable by a computer, tangibly embodying a program of instructions executed by the computer to impart functionality to the computer to perform method steps for conveying the importance of display screen data, said method steps comprising:

identifying a data element selected by a user on a visual display screen;

determining the importance of the identified data element; and

providing an audible indicator to convey the importance of the identified data element to the user;

wherein the audible indicator is selected from the set of audible indicators that consists of an audio tone whose pitch varies in dependence upon the importance of the identified data element, a periodic train of audible clicks with a period that varies in dependence upon the importance of the identified data element, an audio signal that varies between a plurality of audible tones at a rate that depends upon the importance of the identified data element, and an audio signal that varies between two audible tones at a rate that depends upon the importance of the identified data element wherein one of the two tones is essentially silent and the other is not, so as to convey a periodic train of audible beeps to the user with a period that varies in dependence upon the importance of the data element.

13. The program storage device of claim 12, wherein the data element is identified according to a screen location indicated by a computer mouse operated by the user.

14. The program storage device of claim 12, wherein the data element is identified according to a screen location indicated by a computer track ball operated by the user.

15. The program storage device of claim 12, wherein the data element is identified according to a screen location indicated by a computer touch pad operated by the user.

16. The program storage device of claim 12, wherein the data element is identified according to a tab key operated by the user.

17. The program storage device of claim 12, wherein the data element is identified according to position keys operated by the user.

18. The program storage device of claim 12, wherein the data element is identified according to instructions spoken by the user.

19. The program storage device of claim 12, wherein the data element is a form field that accepts input from the user.

20. The program storage device of claim 12, wherein the importance of the data element is determined by reading an encoding that explicitly gives the importance.

21. The program storage device of claim 12, wherein the importance of the data element is determined by reading an encoding and deducing the importance from the read encoding.

22. The program storage device of claim 21, wherein the encoding indicates a display color.