System for visually exploring coordinated relationships in data

• US 10,521,445 B2
• Filed: 06/01/2017
• Issued: 12/31/2019
• Est. Priority Date: 06/01/2017
• Status: Active Grant

• Current Assignee: Fujifilm Business Innovation Corp. (Fujifilm Holdings Corporation)
• Original Assignee: Fuji Xerox Company Limited (Xerox Holdings Corp.)
• Inventors: Zhao, Jian, Chen, Francine, Chiu, Patrick
• Primary Examiner(s): Peach, Polina G
• Application Number:
  US15/611,602
• Publication Number:
  US 20180349448A1
• Time in Patent Office: 943 Days
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 16/287 Visualization; Browsing
• CPC Class Codes: G06F 16/358 Browsing; Visualisation therefor
• CPC Class Codes: G06F 16/906 Clustering; Classification
• CPC Class Codes: G06F 18/23 Clustering techniques
• CPC Class Codes: G06F 18/2413 based on distances to training or reference patterns
• CPC Class Codes: G06F 2216/03 Data mining

Abstract

A method of visualizing relationship data is illustrated. The method includes receiving relationship data comprising a first type of entities, a second type of entities, and data representative of relationships between an entity of the first type and an entity of the second type, generating, based on the data representative of relationships, a bicluster connecting the entity of the first type to the entity of the second type, and generating a visualization based on the bicluster generated, wherein the visualization includes a first column representative of the first type of entities, and a second column representative of the second type of entities, wherein each row of the visualization corresponds to the generated bicluster.

Claims

1. A method of visualizing relationship data, the method comprising:

Receiving, from a database, stored relationship data comprising a first type of entities, a second type of entities, and data representative of relationships between an entity of the first type and an entity of the second type, wherein the data representative of relationships comprises data representing a plurality of relationships between a plurality of entities of the first type and a plurality of entities of the second type, and additional data representative of relationships between another plurality of entities of the first type and a plurality of entities of the third type;

generating, by a processor implemented biclustering engine, based on the data representative of relationships, a bicluster connecting the entity of the first type to the entity of the second type;

generating, based on the additional data representative of relationships, another bicluster connecting each of the another plurality of first type of entities to each of the plurality of third type of entities;

generating a bicluster chain connecting the bicluster to the generated other bicluster; and

generating a visualization based on the bicluster generated, the other bicluster generated and the bicluster chain connecting the bicluster to the generated other bicluster, and

controlling a display device to display and dynamically update the visualization in real time, wherein the visualization comprises;

a first column representative of the first type of entities; and

a second column representative of the second type of entities, wherein each row of the visualization corresponds to the generated bicluster;

a third column representative of the third type of entities; and

a visual element representative of the bicluster chain connecting entities of the third type to entities of the second type based on connections to entities of the first type;

a weighted visual representation of a relationship between the entity of the first type and the entity of the second type comprising;

a first type of visual element extending in a first direction between the first column and the second column representing the bicluster connecting the first type of entities to the second type of entities; and

a plurality of visual elements of a second type arranged in the first direction, each element of the second type extending in a second direction perpendicular to the first direction,

wherein the plurality of visual elements of the second type are positioned within the first type of visual element, each of the plurality of visual elements of the second type being associated with one of the plurality of relationships between the plurality of entities of the first type and the plurality of entities of the second type, and

wherein the positioning of the each second type of visual element between the first column and the second column corresponds to a strength value associated with the relationship associated with the second type of visual element.

2. The method of claim 1,

wherein the generated bicluster connects each of the plurality of entities of the first type to each of the plurality of entities of the second type;

and

wherein the generated visualization further comprises;

the first column representative of the plurality of entities of the first type; and

the second column representative of the plurality of entities of the second type,

wherein the weighted visual representation is positioned between the first column and the second column.

3. The method of claim 2,

wherein the generating the visualization comprises additionally generating:

a weighted visual representation of a relationship between the other plurality of the first type of entities and the plurality of the third type of entities; and

a weighted visual representation of a relationship between the bicluster and the other bicluster.

4. The method of claim 3, wherein the generating the bicluster chain comprises:

calculating a similarity value between the plurality of first type of entities of the bicluster and other plurality of first type of entities of the other bicluster;

determining whether the calculated similarity value is greater than or equal to a threshold value; and

in response to a determination that the calculated similarity value is greater than or equal to the threshold value, connecting the bicluster with the other bicluster based on the plurality of first type entities and the other plurality of first type of entities.

5. The method of claim 3, further comprising:

generating, based on the additional data representative of relationships, a third bicluster connecting each of the third plurality of first type of entities to each of a third plurality of third type of entities;

wherein the generating the bicluster chain comprises;

calculating a first similarity value between the plurality of first type of entities of the bicluster and the other plurality of first type of entities of the other bicluster;

calculating a second similarity value between the third plurality of first type of entities of the bicluster and the third plurality of first type of entities of the third bicluster;

determining whether either the calculated first similarity value and the second similarity value is greater than or equal to a threshold value; and

in response to a determination that both the calculated first similarity value and the second similarity value is greater than or equal to the threshold value;

connecting the bicluster with the other bicluster based on the plurality of first type entities and the other plurality of first type of entities to form a first bicluster chain;

connecting the bicluster with the third bicluster based on the third plurality of first type entities and the third plurality of first type of entities to form a second bicluster chain;

ranking the first bicluster chain and the second bicluster chain based on the first similarity value and the second similarity value.

6. The method 4, wherein the threshold value is a user set threshold value.

7. A non-transitory computer readable medium having stored therein a program for making a computer execute a method of visualizing relationship data, the method comprising:

receiving, from a database, stored relationship data comprising a first type of entities, a second type of entities, and data representative of relationships between an entity of the first type and an entity of the second type, wherein the data representative of relationships comprises data representing a plurality of relationships between a plurality of entities of the first type and a plurality of entities of the second type, and additional data representative of relationships between another plurality of entities of the first type and a plurality of entities of the third type;

generating, by a processor implemented biclustering engine, based on the data representative of relationships, a bicluster connecting the entity of the first type to the entity of the second type;

generating, based on the additional data representative of relationships, another bicluster connecting each of the another plurality of first type of entities to each of the plurality of third type of entities;

generating a bicluster chain connecting the bicluster to the generated other bicluster; and

generating a visualization based on the bicluster generated, the other bicluster generated and the bicluster chain connecting the bicluster to the generated other bicluster, and

controlling a display device to display and dynamically update the visualization in real time, wherein the visualization comprises;

a first column representative of the first type of entities; and

a second column representative of the second type of entities, wherein each row of the visualization corresponds to the generated bicluster;

a third column representative of the third type of entities; and

a visual element representative of the bicluster chain connecting entities of the third type to entities of the second type based on connections to entities of the first type;

a weighted visual representation of a relationship between the entity of the first type and the entity of the second type comprising;

a first type of visual element extending in a first direction between the first column and the second column representing the bicluster connecting the first type of entities to the second type of entities; and

a plurality of visual elements of a second type arranged in the first direction, each element of the second type extending in a second direction perpendicular to the first direction,

wherein the plurality of visual elements of the second type are positioned within the first type of visual element, each of the plurality of visual elements of the second type being associated with one of the plurality of relationships between the plurality of entities of the first type and the plurality of entities of the second type, and

wherein the positioning of the each second type of visual element between the first column and the second column corresponds to a strength value associated with the relationship associated with the second type of visual element.

8. The non-transitory computer readable medium of claim 7,

wherein the generated bicluster connects each of the plurality of entities of the first type to each of the plurality of entities of the second type;

and

wherein the generated visualization further comprises;

the first column representative of the plurality of entities of the first type; and

the second column representative of the plurality of entities of the second type, wherein the weighted visual representation is positioned between the first column and the second column.

9. The non-transitory computer readable medium of claim 8,

wherein the generating the visualization comprises additionally generating:

a weighted visual representation of a relationship between the other plurality of the first type of entities and the plurality of the third type of entities; and

a weighted visual representation of a relationship between the bicluster and the other bicluster.

10. The non-transitory computer readable medium of claim 9, wherein the generating the bicluster chain comprises:

calculating a similarity value between the plurality of first type of entities of the bicluster and other plurality of first type of entities of the other bicluster;

determining whether the calculated similarity value is greater than or equal to a threshold value; and

in response to a determination that the calculated similarity value is greater than or equal to the threshold value, connecting the bicluster with the other bicluster based on the plurality of first type entities and the other plurality of first type of entities.

11. The non-transitory computer readable medium of claim 9, further comprising:

generating, based on the additional data representative of relationships, a third bicluster connecting each of the third plurality of first type of entities to each of a third plurality of third type of entities;

wherein the generating the bicluster chain comprises;

calculating a first similarity value between the plurality of first type of entities of the bicluster and the other plurality of first type of entities of the other bicluster;

calculating a second similarity value between the third plurality of first type of entities of the bicluster and the third plurality of first type of entities of the third bicluster;

determining whether either the calculated first similarity value and the second similarity value is greater than or equal to a threshold value; and

in response to a determination that both the calculated first similarity value and the second similarity value is greater than or equal to the threshold value;

connecting the bicluster with the other bicluster based on the plurality of first type entities and the other plurality of first type of entities to form a first bicluster chain;

connecting the bicluster with the third bicluster based on the third plurality of first type entities and the third plurality of first type of entities to form a second bicluster chain;

ranking the first bicluster chain and the second bicluster chain based on the first similarity value and the second similarity value.

12. A computer apparatus configured to visualize relationship data, the computer apparatus comprising:

a memory storing relationship data comprising a first type of entities, a second type of entities, and data representative of relationships between an entity of the first type and an entity of the second type, wherein the data representative of relationships comprises data representing a plurality of relationships between a plurality of entities of the first type and a plurality of entities of the second type, and additional data representative of relationships between another plurality of entities of the first type and a plurality of entities of the third type;

a processor implementing a biclustering engine and executing a process comprising;

generating, based on the data representative of relationships, a bicluster connecting the entity of the first type to the entity of the second type; and

generating, based on the additional data representative of relationships, another bicluster connecting each of the another plurality of first type of entities to each of the plurality of third type of entities;

generating a bicluster chain connecting the bicluster to the generated other bicluster; and

generating a visualization based on the bicluster generated, the other bicluster generated and the bicluster chain connecting the bicluster to the generated other bicluster, and

controlling a display device to display and dynamically update the visualization in real time, wherein the visualization comprises;

a first column representative of the first type of entities; and

a second column representative of the second type of entities, wherein each row of the visualization corresponds to the generated bicluster;

a third column representative of the third type of entities; and

a visual element representative of the bicluster chain connecting entities of the third type to entities of the second type based on connections to entities of the first type;

a weighted visual representation of a relationship between the entity of the first type and the entity of the second type comprising;

a first type of visual element extending in a first direction between the first column and the second column representing the bicluster connecting the first type of entities to the second type of entities; and

a plurality of visual elements of a second type arranged in the first direction, each element of the second type extending in a second direction perpendicular to the first direction,

wherein the plurality of visual elements of the second type are positioned within the first type of visual element, each of the plurality of visual elements of the second type being associated with one of the plurality of relationships between the plurality of entities of the first type and the plurality of entities of the second type, and

wherein the positioning of the each second type of visual element between the first column and the second column corresponds to a strength value associated with the relationship associated with the second type of visual element.

13. The computer apparatus of claim 12;

wherein the generated bicluster connects each of the plurality of entities of the first type to each of the plurality of entities of the second type; and

wherein the generated visualization further comprises;

the first column representative of the plurality of entities of the first type; and

the second column representative of the plurality of entities of the second type,

wherein the weighted visual representation is positioned between the first column and the second column.

14. The computer apparatus of claim 13,

wherein the generating the visualization comprises additionally generating:

a weighted visual representation of a relationship between the other plurality of the first type of entities and the plurality of the third type of entities; and

a weighted visual representation of a relationship between the bicluster and the other bicluster.

15. The computer apparatus of claim 14, wherein the generating the bicluster chain comprises:

calculating a similarity value between the plurality of first type of entities of the bicluster and other plurality of first type of entities of the other bicluster;

determining whether the calculated similarity value is greater than or equal to a threshold value; and

in response to a determination that the calculated similarity value is greater than or equal to the threshold value, connecting the bicluster with the other bicluster based on the plurality of first type entities and the other plurality of first type of entities.

16. The computer apparatus of claim 14, wherein the process further comprises:

generating, based on the additional data representative of relationships, a third bicluster connecting each of the third plurality of first type of entities to each of a third plurality of third type of entities;

wherein the generating the bicluster chain comprises;

calculating a first similarity value between the plurality of first type of entities of the bicluster and the other plurality of first type of entities of the other bicluster;

calculating a second similarity value between the third plurality of first type of entities of the bicluster and the third plurality of first type of entities of the third bicluster;

determining whether either the calculated first similarity value and the second similarity value is greater than or equal to a threshold value; and

in response to a determination that both the calculated first similarity value and the second similarity value is greater than or equal to the threshold value;

connecting the bicluster with the other bicluster based on the plurality of first type entities and the other plurality of first type of entities to form a first bicluster chain;

connecting the bicluster with the third bicluster based on the third plurality of first type entities and the third plurality of first type of entities to form a second bicluster chain;

ranking the first bicluster chain and the second bicluster chain based on the first similarity value and the second similarity value.