Systems and methods for displaying linked information in a sorted context

• US 7,562,085 B2
• Filed: 05/24/2005
• Issued: 07/14/2009
• Est. Priority Date: 05/24/2005
• Status: Expired due to Fees

• Current Assignee: Palo Alto Research Center, Inc. (Xerox Holdings Corp.)
• Original Assignee: Palo Alto Research Center, Inc. (Xerox Holdings Corp.)
• Inventors: Perer, Adam, Bier, Eric Allan
• Primary Examiner(s): Corrielus; Jean M
• Assistant Examiner(s): Uddin; Mohammed R
• Application Number:
  US11/136,255
• Publication Number:
  US 20060271883A1
• Time in Patent Office: 1,512 Days
• Field of Search: 707101-102
• US Class Current: 1/1
• CPC Class Codes: G06F 16/954 Navigation, e.g. using categorised browsing
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: Y10S 707/99942 Manipulating data structure, e.g. compression, compaction, compilation

Abstract

Techniques are presented for determining a first set of display elements, each display element associated with a first display characteristic. An interesting element in the first set of display elements is determined. A second set of elements related to the interesting element is determined. A third set of elements based on the first and second set of elements is determined using intersection, union, subtraction addition and other logical operations. A third set of elements not yet added to the element collection is determined. The elements in the third set are associated with a second or ghosted display characteristic. The elements in the third set are inserted within the sorted context of the visualization based on spatial distortion rules which help to preserve spatial memory cues in the visualization of the element collection. The elements may be documents in an information repository, linked contact information, linked information records in a database or other types of information.

Claims

1. A computer-implemented method of displaying linked information in a sorted context comprising the steps of:

determining an initial set of display elements in a document;

selecting a display element from the initial set of display elements;

determining a display characteristic associated with the initial set of display elements;

identifying an additional set of display elements in the document that are each linked to the selected display element, comprising;

selecting at least one similarity measure comprising a computed relatioship shared by the selected display element and the additional set of display elements; and

quantitatively comparing the at least one similarity measure to a threshold; and

creating a combined set of display elements comprising the initial and the additional sets of display elements when the at least one similarity measure exceeds the threshold;

preserving spatial relationships between the initial and the additional sets of display elements in the document, wherein the spatial relationships comprise each initial set of display elements sharing its row with neither more nor less than the same set of initial set of display elements as before;

sorting the initial and the combined sets of display elements into sections based on spatial distortion rules for each section; and

displaying the sections comprising the combined set of display elements with the initial set of display elements in a single composite sorted display.

2. The method of claim 1, wherein the combined set of display elements is a subset of the union of the initial and the additional sets of display elements.

3. The method of claim 1, wherein the combined set of display elements is the additional set of display elements minus the initial set of display elements.

4. The method of claim 1, further comprising the steps of determining a fourth set of display elements based on the intersection of the initial and the additional sets of display elements and associating a combined display characteristic with the fourth set of display elements.

5. The method of claim 1, wherein the selected display element is selected based on at least one of:

an indicator;

a voice indicator;

a visual indicator;

a mouse click;

a user interest dwell time;

a voice selection, a pen click, a selection gesture, a pen gesture, dragging with a lasso, a bounding area and a rubber band rectangle.

6. The method of claim 1, further comprising:

determining an additional display characteristic associated with the set of additional display elements, wherein the additional display characteristic is at least one of;

a conditional, a tentative and a less salient attribute associated with the combined set of display elements.

7. The method of claim 6, wherein the additional display characteristic is at least one of:

reduced color saturation;

reduced intensity;

italics, reduced internal contrast, reduced contrast from the background;

blurring, reduced high frequencies and increased transparency.

8. The method of claim 1, wherein the specific spatial relationships includes the horizontal position of display elements from the initial set of display elements, relative to the left edge of a background rectangle over which the initial set of display elements is displayed.

9. The method of claim 1, wherein the specific spatial relationships includes a left to right ordering of all initial set of display elements on any given row.

10. The method of claim 1, wherein the specific spatial relationships includes the horizontal displacement between any pair of initial set of display elements on a given row.

11. The method of claim 1, wherein the specific spatial relationships includes the vertical position of display elements from the initial set, relative to the top edge of a background rectangle over which the initial set of display elements is displayed.

12. The method of claim 1, wherein the specific spatial relationships includes a top to bottom ordering of all initial set of display elements on any given column.

13. The method of claim 1, wherein the specific spatial relationships includes the vertical displacement between any pair of initial set of display elements on a given column.

14. The method of claim 1, wherein the specific spatial relationships includes each initial set of display elements sharing its colunm with neither more nor less than the same set of initial set of display elements as before.

15. The method of claim 1, wherein the initial set of display elements is comprised of at least one of:

icons, windows, thumbnails, tiles and rectangles.

16. The method of claim 15, wherein the additional set of display elements represent at least one of:

a linked item, a document, a uniform resource locator and a citation.

17. The method of claim 1, wherein the additional set of display elements is comprised of at least one of:

icons, windows, thumbnails, tiles and rectangles.

18. The method of claim 17, wherein the display elements represent at least one of:

a linked item, a document, a uniform resource locator and a citation.

19. The method of claim 1, wherein the initial set of display elements is not the same as the additional set of display elements.

20. The method of claim 1, wherein the display elements of the combined set are selectable and the selected display elements are added to the initial set of display elements.

21. The method of claim 20, wherein the added display elements are associated with the initial display characteristic.

22. The method of claim 1, wherein the display elements are sorted based on meta-data.

23. The method of claim 1, wherein the transition from the initial display to the composite sorted display is presented with an animation.

24. The method of claim 23, wherein at the beginning of the animation each display element representing one of the combined set of display elements is initially positioned coincident with a selected display element.

25. The method of claim 1, wherein a display element from the additional set of display elements is selectable and changes set membership in at least one of these ways:

becomes a member of the initial set of display elements and ceases to be a member of the initial set of display elements based on the selection.

26. The method of claim 1, wherein the sorted context is determined by sorting display elements into categories, assigning an order to the categories, and displaying the categories in non-overlapping rectangles on at least one of:

a screen, a display buffer and a virtual canvas.

27. The method of claim 26, wherein at least one information item is associated with a plurality of categories, with one display element for each category to which the information item is assigned.

28. The method of claim 26, further comprising:

determining the categories by meta-data attributes of the information item associated with each display elements.

29. The method of claim 28, wherein the meta data attributes are at least one of:

a title, an author, a publication date and a file nam.

30. The method of claim 26, wherein the sorted context additionally consists of sorting the display elements within each section according to metadata attributes of the associated information item.

31. The method of claim 30, wherein the meta-data attributes are at least one of:

a title, an author, a publication date and a file name.

56. A computer readable storage medium storing code for execution on a computer system to perform the method of claim 1.

32. A computer-implemented system for displaying linked information in a sorted context comprising:

an information respository comprising a document; and

a processor, comprising;

a set determination circuit configured to determine an initial set of display elements in the document and to select a display element from the initial set of display elements;

a display characteristic determination circuit configured to determine a display characteristic associated with the initial set of display elements;

a related elements determination circuit configured to identify an additional set of display elements in the document that are each linked to the selected display element comprising a selection of at least one similarity measure comprising a computed relationship shared by the selected display element and the additional set of display elements, a quantitative comparison of the at least one similarity measure to a threshold and a creation of a combined set of display elements comprising the initial and the additional sets of display elements when the at least one similarity measure exceeds the threshold;

an element layout circuit configured to preserve spatial relationships between the initial and the additional sets of display elements in the document, wherein the spatial relationships comprise each initial set of display elements sharing its row with neither more nor less than the same set of initial set of display elements as before, and to sort the initial and the combined sets of display elements into sections based on spatial distortion rules for each section; and

a display circuit configured to display the sections comprising the combined set of display elements with the initial set of display elements in a single composite sorted display.

33. The system of claim 32, wherein the combined set of display elements is a subset of the union of the initial and the additional sets of display elements.

34. The system of claim 32, wherein the combined set of display elements is the additional sets of display elements minus the initial set of display elements.

35. The system of claim 32, wherein the set determination circuit is further configured to determine a fourth set of display elements based on the intersection of the initial and the additional sets of display elements and to determine a combined display characteristic with the fourth set of display elements.

36. The system of claim 32, wherein the selected display element is selected based on at least one of:

an indicator;

a voice indicator;

a visual indicator;

a mouse click;

a user interest dwell time;

a voice selection, a pen click, a selection gesture, a pen gesture, dragging with a lasso, a bounding area and a rubber band rectangle.

37. The system of claim 32, wherein the set determination circuit is further configured to determine an additional display characteristic associated with the set of additional display elements, and the additional display characteristic is at least one of:

a conditional, a tentative and a less salient attribute associated with the combined set of display elements.

38. The system of claim 37, wherein the additional display characteristic is at least one of:

reduced color saturation;

reduced intensity;

italics, reduced internal contrast, reduced contrast from the background;

blurring, reduced high frequencies and increased transparency.

39. The system of claim 32, wherein the specific spatial relationships includes the horizontal position of display elements from the initial set of display elements, relative to the left edge of a background rectangle over which the initial set of display elements is displayed.

40. The system of claim 32, wherein the specific spatial relationships includes a left to right ordering of all initial set of display elements on any given row.

41. The system of claim 32, wherein the specific spatial relationships includes the horizontal displacement between any pair of initial set of display elements on a given row.

42. The system of claim 32, wherein the specific spatial relationships includes the vertical position of display element from the initial set, relative to the top edge of a background rectangle over which the initial set of display elements is displayed.

43. The system of claim 32, wherein the specific spatial relationships includes a top to bottom ordering of all initial set of display elements on any given column.

44. The system of claim 32, wherein the specific spatial relationships includes the vertical displacement between any pair of initial set of display elements on a given column.

45. The system of claim 32, wherein the specific spatial relationships includes each initial set of display element sharing its column with neither more nor less than the same set of initial set of display elements as before.

46. The system of claim 32, wherein the initial set of display elements is comprised of at least one of:

icons, windows, thumbnails, tiles and rectangles.

47. The system of claim 32, wherein the additional set of display elements is comprised of at least one of:

icons, windows, thumbnails, tiles and rectangles.

48. The system of claim 47, wherein the additional set of display elements represent at least one of:

a linked display element, a document, a uniform resource locator and a citation.

49. The system of claim 32, wherein the initial set of display elements is not the same as the additional set of display elements.

50. The system of claim 32, wherein the display elements of the combined set are selectable and the selected display elements are added to the initial set of display elements.

51. The system of claim 50, wherein the added display elements are associated with the initial display characteristic.

52. The system of claim 32, wherein the display elements are sorted based on meta-data.

53. The system of claim 32, wherein the transition from the initial display to the composite sorted display is presented with an animation.

54. The system of claim 53, wherein at the beginning of the animation each display element representing one of the combined set of display elements is initially positioned coincident with a selected display element.

55. The system of claim 32, wherein a display element from the additional set of display elements is selectable and changes set membership in at least one of these ways:

becomes a member of the initial set of display elements and ceases to be a member of the initial set of display elements based on the selection.

57. The system of claim 32, wherein the sorted context is determined by sorting display elements into categories, assigning an order to the categories, and displaying the categories in non-overlapping rectangles on at least one of:

a screen, a display buffer and a virtual canvas.

58. The system of claim 57, wherein at least one information item is associated with a plurality of categories, with one display element for each category to which the information item is assigned.

59. The system of claim 57, wherein the set determination circuit is further configured to determine the categories by metadata attributes of the information item associated with each display elements.

60. The system of claim 59, wherein the meta-data attributes are at least one of:

a title, an author, a publication date and a file name.

61. The system of claim 57, wherein the sorted context additionally consists of sorting the display elements within each section according to metadata attributes of the associated information item.

62. The system of claim 61, wherein the meta-data attributes are at least one of:

a title, an author, a publication date and a file name.

63. The system of claim 46, wherein the display elements represent at least one of:

a linked item, a document, a uniform resource locator and a citation.

64. A user interface comprising:

an input/output circuit for receiving a user query;

a search system that searches an information repository for display elements stored in the information repository matching the user query;

a display system that displays the matching display elements based on the system for displaying linked information of claim 32.

65. The user interface of claim 64, wherein the information repository is at least one of:

a database;

a file system;

a server; and

a document collection.