Method and apparatus for detecting and presenting client side image map attributes including sound attributes using page layout data strings

• US 5,991,781 A
• Filed: 09/27/1996
• Issued: 11/23/1999
• Est. Priority Date: 09/27/1996
• Status: Expired due to Term

• Current Assignee: Oracle America, Inc. (Oracle Corporation)
• Original Assignee: Sun Microsystems Incorporated (Oracle Corporation)
• Inventors: Nielsen, Jakob
• Primary Examiner(s): Trammell, James P.
• Assistant Examiner(s): YOUNG, JOHN L
• Application Number:
  US08/722,757
• Time in Patent Office: 1,152 Days
• Field of Search: 707/513, 434/114, 434/450, 340/825.19, 345/349
• US Class Current: 715/236
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G09B 21/001 Teaching or communicating with blind persons G09B21/02 - G09B21/06 take precedence
• CPC Class Codes: G09B 21/006 using audible presentation of the information

Abstract

Apparatus, methods, systems and computer program products are disclosed that provide enhancements to client-side image maps in HTML based documents. These enhancements provide audio feedback to a user of a HTML capable application as to the hyperlinks associated with an area in an image. These enhancements also provide a visual representation of the areas defined by a client-side image map when the image is not available.

Claims

1. A computer controlled method for enhancing human-computer interactions comprising steps of:

(a) detecting, from a page layout description an image map which identifies at least one selectable area of an image, said image map having an audio attribute associated with said selectable area;

(b) detecting a preselection condition on said selectable area within said image; and

(c) presenting a first sound associated with said audio attribute through a sound production facility.

2. The computer controlled method of claim 1 wherein step (b) further comprises:

(b1) detecting a hit condition on a relevant active area of said image; and

(b2) detecting existence of said hit condition for longer than a predetermined period of time.

3. The computer controlled method of claim 2 wherein said hit condition exists when activation of a cursor will cause selection of said relevant active area.

4. The computer controlled method of claim 1 wherein said audio attribute is a string defined within said image map.

5. The computer controlled method of claim 4 wherein step (c) further comprises processing said string by a speech synthesis facility to create said first sound representing said string through said sound production facility.

6. The computer controlled method of claim 1 wherein said audio attribute is a reference to sound data, said reference defined within said image map.

7. The computer controlled method of claim 6 wherein step (c) further comprises playing said sound data using said sound production facility to create said first sound.

8. The computer controlled method of claim 6 wherein step (a) further comprises loading said sound data into a memory using said reference.

9. The computer controlled method of claim 8 wherein step (c) further comprises:

(c1) detecting unavailability of said sound data in said memory; and

(c2) presenting an error sound through said sound production facility.

10. The computer controlled method of claim 9 wherein step (c) further comprises:

(c3) detecting availability of said sound data in said memory;

(c4) terminating presentation of said error sound; and

(c5) playing said sound data through said sound production facility to create said first sound.

11. An information display system for enhancing human-computer interactions comprising:

an image map detection mechanism configured to detect, from a page layout description, an image map which identifies at least one selectable area of an image, said image map having an audio attribute associated with said selectable area;

a preselection condition detection mechanism configured to detect a preselection condition on said selectable area within said image; and

a sound presentation mechanism configured to present a first sound associated with said audio attribute through a sound production facility upon detection of said preselection condition.

12. The information display system of claim 11 wherein the preselection condition detection mechanism further comprises:

a hit detection mechanism configured to detect a hit condition on a relevant active area of said image; and

a delay completion mechanism configured to detect existence of said hit condition for longer than a predetermined period of time.

13. The information display system of claim 12 wherein said hit condition exists when activation of a cursor will cause selection of said relevant active area.

14. The information display system of claim 11 wherein said audio attribute is a string defined within said image map.

15. The information display system of claim 14 wherein the sound presentation mechanism further comprises a speech synthesis facility mechanism configured to process said string to create said first sound.

16. The information display system of claim 11 wherein said audio attribute is a reference to sound data, said reference defined within said image map.

17. The information display system of claim 16 wherein the sound presentation mechanism further comprises a play mechanism configured to play said sound data using said sound production facility to create said first sound.

18. The information display system of claim 16 wherein the image map detection mechanism further comprises a load mechanism configured to load said sound data into a memory using said reference.

19. The information display system of claim 18 wherein the sound presentation mechanism further comprises an error sound presentation mechanism configured to present an error sound through said sound production facility if said sound data in said memory is unavailable after a period of time.

20. The information display system of claim 19 wherein the sound presentation mechanism further comprises:

a sound load complete detection mechanism configured to detect availability of said sound data in said memory;

an error sound termination mechanism configured to terminate presentation of said error sound; and

a sound playback mechanism configured to play said sound data through said sound production facility to create said first sound.

21. An information display apparatus for enhancing human-computer interactions having a central processing unit (CPU), a memory, and comprising:

an image map detection mechanism configured to detect, from a page layout description, an image map which identifies at least one selectable area of an image, said image map having an audio attribute associated with said selectable area;

a preselection condition detection mechanism configured to detect a preselection condition on said selectable area within said image; and

a sound presentation mechanism configured to present a first sound associated with said audio attribute through a sound production facility upon detection of said preselection condition.

22. The information display apparatus of claim 21 wherein the preselection condition detection mechanism further comprises:

a hit detection mechanism configured to detect a hit condition on a relevant active area of said image; and

a delay completion mechanism configured to detect existence of said hit condition for longer than a sufficient period of time.

23. The information display apparatus of claim 22 wherein said hit condition exists when activation of a cursor will cause selection of said relevant active area.

24. The information display apparatus of claim 21 wherein said audio attribute is a string defined within said image map.

25. The information display apparatus of claim 24 wherein the sound presentation mechanism further comprises a speech synthesis facility mechanism configured to process said string to create said first sound.

26. The information display apparatus of claim 21 wherein said audio attribute is a reference to sound data, said reference defined within said image map.

27. The information display apparatus of claim 26 wherein the sound presentation mechanism further comprises a play mechanism configured to play said sound data using said sound production facility to create said first sound.

28. The information display apparatus of claim 26 wherein the image map detection mechanism further comprises a load mechanism configured to load said sound data into said memory using said reference.

29. The information display apparatus of claim 28 wherein the sound presentation mechanism further comprises an error sound presentation mechanism configured to present an error sound through said sound production facility if said sound data in said memory is unavailable after a period of time.

30. The information display apparatus of claim 29 wherein the sound presentation mechanism further comprises:

a sound load complete detection mechanism configured to detect availability of said sound data in said memory;

an error sound termination mechanism configured to terminate presentation of said error sound; and

a sound playback mechanism configured to play said sound data through said sound production facility to create said first sound.

31. A computer program product comprising:

a computer usable storage medium;

computer controlling instructions, stored on said storage medium, providing an image map detection mechanism configured to detect an image map which identifies at least one selectable area of an image, said image map having an audio attribute associated with said selectable area;

computer controlling instructions, stored on said storage medium, providing a preselection condition detection mechanism configured to detect a preselection condition on said selectable area within said image; and

computer controlling instructions, stored on said storage medium, providing a sound presentation mechanism configured to present a first sound associated with said audio attribute through a sound production facility upon detection of said preselection condition.

32. The computer program product of claim 31 wherein the preselection condition detection mechanism further comprises:

a hit detection mechanism configured to detect a hit condition on a relevant active area of said image; and

a delay completion mechanism configured to detect existence of said hit condition for longer than a predetermined period of time.

33. The computer program product of claim 32 wherein said hit condition exists when activation of a cursor will cause selection of said relevant active area.

34. The computer program product of claim 31 wherein said audio attribute is a string defined within said image map.

35. The computer program product of claim 34 wherein the sound presentation mechanism further comprises a speech synthesis facility mechanism configured to process said string to create said first sound.

36. The computer program product of claim 31 wherein said audio attribute is a reference to sound data, said reference defined within said image map.

37. The computer program product of claim 36 wherein the sound presentation mechanism further comprises a play mechanism configured to play said sound data using said sound production facility to create said first sound.

38. The computer program product of claim 36 wherein the image map detection mechanism further comprises a load mechanism configured to load said sound data into a computer memory using said reference.

39. The computer program product of claim 38 wherein the sound presentation mechanism further comprises an error sound presentation mechanism configured to present an error sound through said sound production facility if said sound data in said memory is unavailable after a period of time.

40. The computer program product of claim 39 wherein the sound presentation mechanism further comprises:

a sound load complete detection mechanism configured to detect availability of said sound data in said memory;

an error sound termination mechanism configured to terminate presentation of said error sound; and

a sound playback mechanism configured to play said sound data through said sound production facility to create said first sound.

41. A computer controlled method of enhancing human-computer interactions, said method comprising steps of:

(a) detecting in a page layout an image map which identifies at least one selectable area of an image;

(b) detecting in said page layout a height attribute and a width attribute for an image area; and

(c) displaying a border around said image area when said image is not available, said border having a first status representation.

42. The computer controlled method of claim 41 wherein said selectable area is a default area having a link and said first status representation is a color that indicates whether said link has been visited.

43. The computer controlled method of claim 41 wherein said image map does not include a default area element and first status representation is a color that indicates whether a link defined in said at least one selectable area has not been visited.

44. The computer controlled method of claim 41 further comprising:

(d) displaying in said image area said at least one selectable area having a second status representation, said at least one selectable area having a link.

45. The computer controlled method of claim 44 wherein said second status representation is a color that indicates whether said link has been visited.

46. An information display system for enhancing human-computer interactions, said system comprising:

an image map detection mechanism configured to detect in a page layout an image map which identifies at least one selectable area of an image;

an image size detection mechanism configured to detect in said page layout a height attribute and a width attribute for an image area; and

a border display mechanism configured to display a border around said image area when said image is not available, said border having a first status representation.

47. The information display system of claim 46 wherein said selectable area is a default area having a link and said first status representation is a color that indicates whether said link has been visited.

48. The information display system of claim 46 wherein said image map does not include a default area element and first status representation is a color that indicates whether a link defined in said at least one selectable area has not been visited.

49. The information display system of claim 46 further comprising a display mechanism configured to display in said image area said at least one selectable area having a second status representation, said at least one selectable area having a link.

50. The information display system of claim 49 wherein said second status representation is a color that indicates whether said link has been visited.

51. An information display apparatus for enhancing human-computer interactions, said apparatus having a central processing unit (CPU), a memory, and comprising:

an image map detection mechanism configured to detect in a page layout an image map which identifies at least one selectable area of an image;

an image size detection mechanism configured to detect in said page layout a height attribute and a width attribute for an image area; and

a border display mechanism configured to display a border around said image area when said image is not available, said border having a first status representation.

52. The information display apparatus of claim 51 wherein said selectable area is a default area having a link and said first status representation is a color that indicates whether said link has been visited.

53. The information display apparatus of claim 51 wherein said image map does not include a default area element and first status representation is a color that indicates whether a link defined in said at least one selectable area has not been visited.

54. The information display apparatus of claim 51 further comprising a display mechanism configured to display in said image area said at least one selectable area having a second status representation, said at least one selectable area having a link.

55. The information display apparatus of claim 54 wherein said second status representation is a color that indicates whether said link has been visited.

56. A computer program product comprising:

a computer usable storage medium;

computer controlling instructions, stored on said storage medium, providing an image map detection mechanism configured to detect in a page layout an image map which identifies at least one selectable area of an image;

computer controlling instructions, stored on said storage medium, providing an image size detection mechanism configured to detect in said page layout a height attribute and a width attribute for an image area of said image; and

computer controlling instructions, stored on said storage medium, providing a border display mechanism configured to display a border around said image area when said image is not available, said border having a first status representation.

57. The computer program product of claim 56 wherein said selectable area is a default area having a link and said first status representation is a color that indicates whether said link has been visited.

58. The computer program product of claim 56 wherein said image map does not include a default area element and first status representation is a color that indicates whether a link defined in said at least one selectable area has not been visited.

59. The computer program product of claim 56 further comprising:

computer controlling instructions, stored on said storage medium, providing a display mechanism configured to display in said image area said at least one selectable area having a second status representation, said at least one selectable area having a link.

60. The computer program product of claim 59 wherein said second status representation is a color that indicates whether said link has been visited.