Directional focus navigation

• US 20040090463A1
• Filed: 11/13/2002
• Published: 05/13/2004
• Est. Priority Date: 11/13/2002
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Pettit, Bradley R., Celik, Tantek, Chan, Ada Y.
• Granted Patent: US 7,134,089 B2
• Time in Patent Office: Days
• US Class Current: 715/767
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance

Abstract

A rendering engine that supports directional focus navigation, in response to a directional input, shifts the focus to an appropriate focusable element. The rendering engine determines one or more focusable elements that are candidates to receive the focus based on the received directional input and based on the relative display locations of the focusable elements. The rendering engine selects the most appropriate candidate focusable element based on each candidate element'"'"'s display location in relation to the display location of the element that currently has focus.

Claims

1. A method comprising:

identifying a first element associated with a rendered document, the first element having focus;

receiving an indication of a horizontal directional input;

identifying a second focusable element that is within a display area of the document;

determining a display midpoint of the first element;

determining a display midpoint of the second focusable element;

determining whether the display midpoint of the second focusable element is at a horizontal distance in a direction indicated by the directional input from the display midpoint of the first element; and

in an event that the display midpoint of the second focusable element is at a horizontal distance in a direction indicated by the directional input from the display midpoint of the first element, identifying the second focusable element as a candidate to receive focus in response to the directional input.

2. The method as recited in claim 1 wherein the horizontal directional input indicates moving focus to the right.

3. The method as recited in claim 1 wherein the horizontal directional input indicates moving focus to the left.

4. The method as recited in claim 1, further comprising:

determining that a bottom point of the second focusable element is at the same level or below a bottom point of the first element.

5. The method as recited in claim 1, further comprising:

determining that a top point of the second focusable element is above a top point of the first element such that the vertical distance between the top point of the second focusable element and the top point of the first element is less than or equal to a tolerance value.

6. The method as recited in claim 5 wherein the tolerance value is based on a comparison of a height of the second focusable element and a height of the first element.

7. The method as recited in claim 5 wherein the tolerance value comprises:

a height of the first element divided by four.

8. The method as recited in claim 5 wherein the tolerance value comprises:

a height of the second focusable element divided by four.

9. A method comprising:

identifying a first element associated with a rendered document, the first element having focus;

receiving an indication of a vertical directional input;

identifying a second focusable element that is within a display area of the document;

determining a display midpoint of the first element;

determining a display midpoint of the second focusable element;

determining whether the display midpoint of the second focusable element is at a vertical distance in a direction indicated by the directional input from the display midpoint of the first element; and

in an event that the display midpoint of the second focusable element is at a vertical distance in a direction indicated by the directional input from the display midpoint of the first element, identifying the second focusable element as a candidate to receive focus in response to the directional input.

10. The method as recited in claim 9 wherein the vertical directional input indicates moving focus down.

11. The method as recited in claim 9 wherein the vertical directional input indicates moving focus up.

12. The method as recited in claim 9, further comprising:

determining that a top point of the second focusable element is below a bottom point of the first element.

13. The method as recited in claim 9, further comprising:

determining that a top point of the second focusable element is above a bottom point of the first element such that the vertical distance between the top point of the second focusable element and the bottom point of the first element is less than or equal to a tolerance value.

14. The method as recited in claim 13 wherein the tolerance value is based on a comparison of a height of the second focusable element and a height of the first element.

15. The method as recited in claim 9, further comprising:

determining that a bottom point of the second focusable element is above a top point of the first element.

16. The method as recited in claim 9, further comprising:

determining that a bottom point of the second focusable element is below a top point of the first element such that the vertical distance between the bottom point of the second focusable element and the top point of the first element is less than or equal to a tolerance value.

17. The method as recited in claim 16 wherein the tolerance value is based on a comparison of a height of the second focusable element and a height of the first element.

18. A browser application configured to perform the method as recited in claim 9.

19. A rendering engine configured to perform the method as recited in claim 9.

20. One or more computer-readable media comprising computer executable instructions that, when executed, direct a computing system to perform the method as recited in claim 9.

21. A method comprising:

identifying a first element associated with a rendered document, the first element having focus;

receiving an indication of a directional input;

identifying a second focusable element that is within a display area of the document;

determining a right display point of the first element;

determining a right display point of the second focusable element;

determining whether the right display point of the second focusable element is to the right of the right display point of the first element; and

in an event that the right display point of the second focusable element is to the right of the right display point of the first element, identifying the second focusable element as a candidate to receive focus in response to the directional input.

22. The method as recited in claim 21 further comprising:

determining that a horizontal distance between the right display point of the second focusable element and the right display point of the first element is greater than a tolerance value.

23. The method as recited in claim 22 wherein the tolerance value is based on a comparison of a width of the second focusable element and a width of the first element.

24. A browser application configured to perform the method as recited in claim 21.

25. A rendering engine configured to perform the method as recited in claim 21.

26. One or more computer-readable media comprising computer executable instructions that, when executed, direct a computing system to perform the method as recited in claim 21.

27. A method comprising:

identifying a first element associated with a rendered document, the first element having focus;

receiving an indication of a directional input;

identifying a second focusable element that is within a display area of the document;

determining a left display point of the first element;

determining a left display point of the second focusable element;

determining whether the left display point of the second focusable element is to the left of the left display point of the first element; and

in an event that the left display point of the second focusable element is to the left of the left display point of the first element, identifying the second focusable element as a candidate to receive focus in response to the directional input.

28. The method as recited in claim 27 further comprising:

determining that a horizontal distance between the left display point of the second focusable element and the left display point of the first element is greater than a tolerance value.

29. The method as recited in claim 28 wherein the tolerance value is based on a comparison of a width of the second focusable element and a width of the first element.

30. A browser application configured to perform the method as recited in claim 27.

31. A rendering engine configured to perform the method as recited in claim 27.

32. One or more computer-readable media comprising computer executable instructions that, when executed, direct a computing system to perform the method as recited in claim 27.

33. A method comprising:

identifying a first element associated with a rendered document, the first element having focus;

receiving an indication of a directional input;

identifying a second focusable element that is within a display area of the document;

determining a bottom display point of the first element;

determining a bottom display point of the second focusable element;

determining whether the bottom display point of the second focusable element is below the bottom display point of the first element; and

in an event that the bottom display point of the second focusable element is below the bottom display point of the first element, identifying the second focusable element as a candidate to receive focus in response to the directional input.

34. The method as recited in claim 33 wherein the determining further comprises:

determining that a vertical distance between the bottom display point of the second focusable element and the bottom display point of the first element is greater than a tolerance value.

35. The method as recited in claim 34 wherein the tolerance value is based on a comparison of a height of the second focusable element and a height of the first element.

36. A browser application configured to perform the method as recited in claim 33.

37. A rendering engine configured to perform the method as recited in claim 33.

38. One or more computer-readable media comprising computer executable instructions that, when executed, direct a computing system to perform the method as recited in claim 33.

39. A method comprising:

identifying a first element associated with a rendered document, the first element having focus;

receiving an indication of a directional input;

identifying a second focusable element that is within a display area of the document;

determining a top display point of the first element;

determining a top display point of the second focusable element;

determining whether the top display point of the second focusable element is above the top display point of the first element; and

in an event that the top display point of the second focusable element is above the top display point of the first element, identifying the second focusable element as a candidate to receive focus in response to the directional input.

40. The method as recited in claim 39 further comprising:

determining that a vertical distance between the top display point of the second focusable element and the top display point of the first element is greater than a tolerance value.

41. The method as recited in claim 40 wherein the tolerance value is based on a comparison of a height of the second focusable element and a height of the first element.

42. A browser application configured to perform the method as recited in claim 39.

43. A rendering engine configured to perform the method as recited in claim 39.

44. One or more computer-readable media comprising computer executable instructions that, when executed, direct a computing system to perform the method as recited in claim 39.

45. A method for selecting an element to receive focus in response to a directional input comprising:

identifying multiple focusable elements that are candidates to receive focus based on the directional input;

performing only a single analysis of display locations associated with each of the multiple focusable elements; and

selecting, from the multiple focusable elements, a most appropriate element to receive the focus based on the single analysis of the display locations.

46. A method for selecting an element to receive focus in response to a horizontal directional input comprising:

identifying first and second focusable elements that are candidates to receive focus based on the directional input;

determining whether a display location of the first focusable element vertically overlaps a display location of an element having focus;

determining whether a display location of the second focusable element vertically overlaps the display location of the element having focus; and

in an event that the display location of the first focusable element vertically overlaps a display location of the element having focus and the display location of the second focusable element does not vertically overlap the display location of the element having focus, selecting the first focusable element.

47. A rendering engine configured to perform the method as recited in claim 46.

48. One or more computer-readable media comprising computer executable instructions that, when executed, direct a computing system to perform the method as recited in claim 46.

49. A method for selecting an element to receive focus in response to a horizontal directional input comprising:

identifying first and second focusable elements that are candidates to receive focus based on the directional input;

determining whether a display location of the first focusable element vertically overlaps a display location of an element having focus;

determining whether a display location of the second focusable element vertically overlaps the display location of the element having focus;

determining whether the display location of the first focusable element is vertically closer to the display location of the element having focus than the display location of the second focusable element is to the display location of the element having focus; and

in an event that the display location of the first focusable element does not vertically overlap the display location of the element having focus and the display location of the second focusable element does not vertically overlap the display location of the element having focus and the display location of the first focusable element is vertically closer to the display location of the element having focus than the display location of the second focusable element is to the display location of the element having focus, selecting the first focusable element.

50. A rendering engine configured to perform the method as recited in claim 49.

51. One or more computer-readable media comprising computer executable instructions that, when executed, direct a computing system to perform the method as recited in claim 49.

52. A method for selecting an element to receive focus in response to a horizontal directional input comprising:

identifying first and second focusable elements that are candidates to receive focus based on the directional input;

determining whether a display location of the first focusable element vertically overlaps a display location of the element having focus;

determining whether a display location of the second focusable element vertically overlaps the display location of the element having focus;

determining whether a top display point of the first focusable element is closer to a bottom display point of the element having focus than a top display point of the second focusable element is to the bottom display point of the element having focus; and

in an event that the display location of the first focusable element does not vertically overlap the display location of the element having focus and the display location of the second focusable element does not vertically overlap the display location of the element having focus and the top display point of the first focusable element is closer to the bottom display point of the element having focus than the top display point of the second focusable element is to the bottom display point of the element having focus, selecting the first focusable element.

53. A rendering engine configured to perform the method as recited in claim 52.

54. One or more computer-readable media comprising computer executable instructions that, when executed, direct a computing system to perform the method as recited in claim 52.

55. A method for selecting an element to receive focus in response to a horizontal directional input comprising:

identifying first and second focusable elements that are candidates to receive focus based on the directional input;

determining whether a display location of the first focusable element vertically overlaps a display location of the element having focus;

determining whether a display location of the second focusable element vertically overlaps the display location of the element having focus;

determining whether a bottom display point of the first focusable element is closer to a top display point of the element having focus than a bottom display point of the second focusable element is to the top display point of the element having focus; and

in an event that the display location of the first focusable element does not vertically overlap the display location of the element having focus and the display location of the second focusable element does not vertically overlap the display location of the element having focus and the bottom display point of the first focusable element is closer to the top display point of the element having focus than the bottom display point of the second focusable element is to the top display point of the element having focus, selecting the first focusable element.

56. A rendering engine configured to perform the method as recited in claim 55.

57. One or more computer-readable media comprising computer executable instructions that, when executed, direct a computing system to perform the method as recited in claim 55.

58. A method for selecting an element to receive focus in response to a horizontal directional input comprising:

identifying first and second focusable elements that are candidates to receive focus based on the directional input;

determining an amount to which the first focusable element vertically overlaps an element having focus;

determining an amount to which the second focusable element vertically overlaps the element having focus;

determining whether the first focusable element is horizontally closer to the element having focus than the second focusable element is to the element having focus; and

in an event that an amount to which the first focusable element vertically overlaps the element having focus is similar to the amount to which the second focusable element vertically overlaps the element having focus and the first focusable element is horizontally closer to the element having focus than the second focusable element is to the element having focus, selecting the first focusable element.

59. The method as recited in claim 58 further comprising:

determining whether a difference between the amount to which the first focusable element vertically overlaps an element having focus and the amount to which the second focusable element vertically overlaps the element having focus is less than a tolerance value.

60. The method as recited in claim 59 wherein the tolerance value is based on a comparison between a height of the first focusable element, a height of the second focusable element, and a height of the element having focus.

61. The method as recited in claim 58 wherein the determining whether the first focusable element is horizontally closer to the element having focus than the second focusable element is to the element having focus comprises:

determining whether a left display point of the first focusable element is to the left of a left display point of the second focusable element.

62. The method as recited in claim 58 wherein the determining whether the first focusable element is horizontally closer to the element having focus than the second focusable element is to the element having focus comprises:

determining whether a right display point of the first focusable element is to the right of a right display point of the second focusable element.

63. A rendering engine configured to perform the method as recited in claim 58.

64. One or more computer-readable media comprising computer executable instructions that, when executed, direct a computing system to perform the method as recited in claim 58.

65. A method for selecting an element to receive focus in response to a horizontal directional input comprising:

identifying first and second focusable elements that are candidates to receive focus based on the directional input;

determining an amount to which the first focusable element vertically overlaps an element having focus;

determining an amount to which the second focusable element vertically overlaps the element having focus;

determining whether the first focusable element is horizontally closer to the element having focus than the second focusable element is to the element having focus; and

in an event that the first focusable element vertically overlaps an element having focus more than the second focusable element vertically overlaps the element having focus and the first focusable element is horizontally closer to the element having focus than the second focusable element is to the element having focus, selecting the first focusable element.

66. The method as recited in claim 65 further comprising:

determining whether a difference between the amount to which the first focusable element vertically overlaps an element having focus and the amount to which the second focusable element vertically overlaps the element having focus is greater than a tolerance value.

67. The method as recited in claim 66 wherein the tolerance value is based on a comparison between a height of the first focusable element, a height of the second focusable element, and a height of the element having focus.

68. The method as recited in claim 65 wherein the determining whether the first focusable element is horizontally closer to the element having focus than the second focusable element is to the element having focus comprises:

determining whether a left display point of the first focusable element is to the left of a left display point of the second focusable element.

69. The method as recited in claim 65 wherein the determining that the first focusable element is horizontally closer to the element having focus than the second focusable element is to the element having focus comprises:

determining whether a right display point of the first focusable element is to the right of a right display point of the second focusable element.

70. A rendering engine configured to perform the method as recited in claim 65.

71. One or more computer-readable media comprising computer executable instructions that, when executed, direct a computing system to perform the method as recited in claim 65.

72. A method for selecting an element to receive focus in response to a horizontal directional input comprising:

identifying first and second focusable elements that are candidates to receive focus based on the directional input;

determining a first value that represents a percentage of a display height of an element having focus that is vertically overlapped by a display area of the first focusable;

determining a second value that represents a percentage of the display height of the element having focus that is vertically overlapped by a display area of the second focusable element;

determining whether the first value is greater than the second value; and

in an event that the first value is greater than the second value, selecting the first focusable element.

73. The method as recited in claim 72 wherein the determining whether the first value is greater than the second value comprises:

determining whether a difference between the first value and the second value is greater than a tolerance value.

74. The method as recited in claim 73 wherein the tolerance value is based on a comparison between a height of the first focusable element, a height of the second focusable element, and a height of the element having focus.

75. The method as recited in claim 72 further comprising:

determining whether the first focusable element vertically overlaps the element having focus more than the second focusable element vertically overlaps the element having focus.

76. The method as recited in claim 72 further comprising:

determining whether the first focusable element is horizontally closer to the element having focus than the second focusable element is to the element having focus.

77. The method as recited in claim 76 wherein the determining whether the first focusable element is horizontally closer to the element having focus than the second focusable element is to the element having focus comprises:

determining whether a left display point of the first focusable element is to the left of a left display point of the second focusable element.

78. The method as recited in claim 76 wherein the determining whether the first focusable element is horizontally closer to the element having focus than the second focusable element is to the element having focus comprises:

determining whether a right display point of the first focusable element is to the right of a right display point of the second focusable element.

79. A rendering engine configured to perform the method as recited in claim 72.

80. One or more computer-readable media comprising computer executable instructions that, when executed, direct a computing system to perform the method as recited in claim 72.

81. A method for selecting a most appropriate element to receive focus in response to a directional input, the most appropriate element selected from first and second focusable elements, the method comprising:

determining a first distance value that represents a distance between a representative point associated with the first focusable element and a representative point associated with an element having focus;

determining a second distance value that represents a distance between a representative point associated with the second focusable element and the representative point associated with the element having focus;

determining whether the distance represented by the first distance value is shorter than the distance represented by the second distance value; and

in an event that the distance represented by the first distance value is shorter than the distance represented by the second distance value, selecting the first focusable element.

82. The method as recited in claim 81 wherein the representative point associated with the first focusable element comprises:

a horizontal coordinate that is an average of horizontal coordinates of points associated with the first focusable element; and

a vertical coordinate that is an average of vertical coordinates of points associated with the first focusable element.

83. The method as recited in claim 81 wherein the representative point associated with the second focusable element comprises:

a horizontal coordinate that is an average of horizontal coordinates of points associated with the second focusable element; and

a vertical coordinate that is an average of vertical coordinates of points associated with the second focusable element.

84. The method as recited in claim 81 wherein the representative point associated with the element having focus comprises:

a horizontal coordinate that is an average of horizontal coordinates of points associated with the element having focus; and

a vertical coordinate that is an average of vertical coordinates of points associated with the element having focus.

85. The method as recited in claim 81 wherein the representative point associated with the element having focus comprises:

a horizontal coordinate that is an average of horizontal coordinates of points associated with the element having focus; and

a vertical coordinate that is an average of vertical coordinates of points associated with an element that last previously received focus not in response to a horizontal directional input.

86. The method as recited in claim 81 wherein the representative point associated with the element having focus comprises:

a horizontal coordinate that is an average of horizontal coordinates of points associated with an element that last previously received focus not in response to an vertical directional input; and

a vertical coordinate that is an average of vertical coordinates of points associated with the element having focus.

87. The method as recited in claim 81 wherein the representative point associated with the element having focus comprises:

a horizontal coordinate that is an average of horizontal coordinates of points associated with an element that last previously received focus not in response to an vertical directional input; and

a vertical coordinate that is an average of vertical coordinates of points associated with the element that last previously received focus not in response to an vertical directional input.

88. A rendering engine configured to perform the method as recited in claim 81.

89. One or more computer-readable media comprising computer executable instructions that, when executed, direct a computing system to perform the method as recited in claim 81.

90. A method for selecting an element to receive focus in response to a vertical directional input comprising:

determining a hierarchical tree structure that defines relationships between focusable elements in a document;

identifying first and second focusable elements associated with the document that are candidates to receive focus based on the directional input; and

selecting a most appropriate element from the first and second focusable elements.

91. The method as recited in claim 90 wherein the selecting comprises:

determining, based on the hierarchical tree structure, a first ancestor element that is common between the first focusable element and an element having focus, and a second ancestor element that is common between the second focusable element and the element having focus;

determining a first value that represents a distance between the first ancestor element and the element having focus and a second value that represents a distance between the second ancestor element and the element having focus;

determining whether the first value is smaller than the second value; and

in an event that the first value is smaller than the second value, indicating that the first focusable element has a closer ancestor element in common with the element having focus than does the second focusable element, selecting the first focusable element.

92. The method as recited in claim 90 wherein the selecting comprises:

determining, based on the hierarchical tree structure, a first ancestor element that is common between the first focusable element and an element having focus, and a second ancestor element that is common between the second focusable element and the element having focus;

determining a first value that represents a distance between the first ancestor element and the element having focus and a second value that represents a distance between the second ancestor element and the element having focus;

determining whether the first value is equal to the second value;

determining whether a display location of the first focusable element is vertically closer to a display location of the element having focus than is a display location of the second focusable element; and

in an event that the first value is equal to the second value, indicating that the first focusable element and the second focusable element are structurally equal, and a display location of the first focusable element is vertically closer to a display location of the element having focus than is a display location of the second focusable element, then selecting the first focusable element.

93. The method as recited in claim 92 further comprising:

determining whether the display location of the first focusable element is horizontally closer to a display location of an element that last previously received focus not in response to a vertical directional input than is the display location of the second focusable element.

94. The method as recited in claim 92 further comprising:

determining whether the display area of the second focusable element is wider than or equal to the display area of the first focusable element; and

determining whether a left display point of the second focusable element is at an equal horizontal position or to the left of a left display point of the first focusable element.

95. The method as recited in claim 92 further comprising:

determining whether the display area of the first focusable element is wider than or equal to the display area of the second focusable element; and

determining whether a left display point of the first focusable element is at an equal horizontal position or to the left of a left display point of the second focusable element.

96. A browser application configured to perform the method as recited in claim 90.

97. A rendering engine configured to perform the method as recited in claim 90.

98. One or more computer-readable media comprising computer executable instructions that, when executed, direct a computing system to perform the method as recited in claim 90.

99. A method comprising:

rendering a first document in a first frame and a second document in a second frame;

identifying an element associated with the first document, the element having focus;

receiving an indication of a directional input;

determining whether there is another focusable element associated with the first document that is appropriate to receive focus based on the directional input;

determining whether the first document is scrollable in a direction indicated by the directional input;

determining whether the second document is displayed at a location that is in a direction that in relation to a display location associated with the first document is indicated by the directional input;

determining a focusable element associated with the second document; and

in an event that there is not another focusable element associated with the first document that is appropriate to receive focus based on the directional input, the first document is not scrollable in a direction indicated by the directional input, and the second document is displayed at a location that is in a direction that in relation to a display location associated with the first document is indicated by the directional input, then setting focus to the focusable element associated with the second document.

100. One or more computer-readable media comprising computer executable instructions that, when executed, direct a computing system to:

visually render a first document in a first frame;

visually render a second document in a second frame;

set focus to a focusable element associated with the first document;

receive an indication of a directional input;

determine whether there is associated with the first document a focusable element appropriate to receive focus based on the directional input;

determine whether the first document is scrollable in a direction indicated by the directional input;

determine whether the second frame is displayed in a location that is related, in a direction indicated by the directional input, to a location of the first frame; and

in an event that there is not associated with the first document a focusable element appropriate to receive focus based on the directional input, the first document is not scrollable in a direction indicated by the directional input, and the second frame is displayed in a location that is related, in a direction indicated by the directional input, to a location of the first frame, then set focus to a focusable element associated with the second document.