Method and system for data transformation in a heterogeneous computer system

• US 7,065,588 B2
• Filed: 08/10/2001
• Issued: 06/20/2006
• Est. Priority Date: 08/10/2001
• Status: Expired due to Fees

• Current Assignee: Chaavi Incorporated
• Original Assignee: Chaavi Incorporated
• Inventors: Collins, Michael, Konda, Suresh L., Nag, Pranab K.
• Primary Examiner(s): Walsh, John B.
• Application Number:
  US09/928,256
• Publication Number:
  US 20030041095A1
• Time in Patent Office: 1,775 Days
• Field of Search: None
• US Class Current: 709/246
• CPC Class Codes: G06F 16/258 Data format conversion from or to a database
• CPC Class Codes: H04L 67/56 Provisioning of proxy services store-and-forward switching systems in data switching networks H04L12/54
• CPC Class Codes: H04L 67/565 Conversion or adaptation of application format or content adding application control or application functional data H04L67/561

Abstract

A data transformation system includes clients, which initiate requests for transformation of data between first and second data formats. The system also includes peer transformation servers having data converters and graphs of available transformations between input and output data formats of such servers. The graph includes unidirectional edges, which extend between corresponding pairs of the formats. The servers collectively include one or more converters for each of the edges. The servers receive the requests and select plural intermediate transformations from the first format to plural intermediate formats, and a final transformation from an intermediate format to the second format. Each of the intermediate and final transformations is associated with a corresponding one of the edges. The servers initiate the converters corresponding to the selected transformations, in order to obtain and dispose the data in the second format. A communication network provides communication among the client and servers.

Claims

1. A data transformation system for use in a heterogeneous computer system, said data transformation system comprising:

at least one client adapted to initiate a request for transformation of data in a first data format to data in a second data format;

a plurality of peer transformation servers, each of said transformation servers including a plurality of data converters and a representation of available data transformations between a plurality of input data formats associated with at least some of said transformation servers and a plurality of output data formats associated with at least some of said transformation servers, said representation including a plurality of unidirectional edges, with each one of said edges extending from one of said input and output data formats to another of said input and output data formats, said transformation servers collectively including at least one of said data converters for each of said edges, at least one of said transformation servers adapted to receive said request for transformation of data, select at least one intermediate data format from a plurality of different intermediate data formats and select at least one intermediate data transformation from said first data format to said selected at least one intermediate data format and a final data transformation from a final one of said selected at least one intermediate data format to said second data format, with each of said intermediate and final data transformations being associated with a corresponding one of said edges, said at least one of said transformation servers adapted to initiate a plurality of said data converters corresponding to said selected intermediate and final data transformations, in order to obtain said data in the second data format, and dispose said data in the second data format; and

a communication network adapted to provide communication among said transformation servers and said client.

4. The data transformation system of claim 1 wherein said one of said transformation servers employs a breadth-first search to select said intermediate and final data transformations.

5. The data transformation system of claim 4 wherein said one of said transformation servers includes an adjacency matrix having said input data formats, said output data formats and a value for each pair of said input and output data formats, said value representing whether a data transformation directly from said input data format to said output data format of said pair is possible;

and wherein said one of said transformation servers further includes a routine to convert said adjacency matrix to said reachability matrix.

6. The data transformation system of claim 1 wherein said transformation servers further collectively include a plurality of said data converters for at least one of said edges;

and wherein said one of said transformation servers selects and initiates one of said plurality of data converters for said at least one of said edges.

7. The data transformation system of claim 6 wherein said transformation servers include a first transformation server and a second transformation server, said first transformation server includes a first data converter for one of said edges, said second transformation server includes a second data converter for said one of said edges;

and wherein said one of said transformation servers includes an algorithm to evaluate and select one of said first and second data converters for said one of said edges.

8. The data transformation system of claim 7 wherein each of said first and second data converters has a cost associated with said one of said edges;

and wherein said algorithm evaluates the costs of said first and second data converters to select one of said first and second data converters for said one of said edges.

9. The data transformation system of claim 7 wherein each of said first and second data converters has a time duration associated with said one of said edges;

and wherein said algorithm evaluates the time durations of said first and second data converters to select one of said first and second data converters for said one of said edges.

10. The data transformation system of claim 7 wherein each of said first and second data converters has a quality value associated with said one of said edges;

and wherein said algorithm evaluates the quality values of said first and second data converters to select one of said first and second data converters for said one of said edges.

11. The data transformation system of claim 7 wherein each of said first and second data converters has a conversion performance vector associated with said one of said edges;

and wherein said algorithm evaluates the conversion performance vectors of said first and second data converters to select one of said first and second data converters for said one of said edges.

12. The data transformation system of claim 11 wherein said conversion performance vector includes a plurality of attributes, which are selected from the list comprising:

a count of conversion failures by a corresponding one of said data converters, whether said corresponding one of said data converters is local or remote with respect to said one of said transformation servers, a value representing quality of conversion by said corresponding one of said data converters, and a size of a file to be converted by said corresponding one of said data converters.

13. The data transformation system of claim 11 wherein said conversion performance vector includes a direct cost attribute, a quality attribute and a time duration attribute, with each of said attributes having a weight value associated therewith.

14. The data transformation system of claim 13 wherein at least one of said attributes has a static value.

15. The data transformation system of claim 13 wherein at least one of said attributes has a dynamic value.

16. The data transformation system of claim 6 wherein said transformation servers include a first transformation server, a second transformation server and a third transformation server, said first transformation server includes a first data converter for one of said edges, said second transformation server includes a second data converter for said one of said edges, said third transformation server includes a third data converter for said one of said edges;

wherein said third transformation server is offline; and

wherein said one of said transformation servers includes an algorithm to evaluate and select one of said first and second data converters for said one of said edges.

17. The data transformation system of claim 1 wherein said client is a transformation server.

18. The data transformation system of claim 1 wherein said communication network is a computer network;

and wherein said client is a computer communicating on said computer network.

19. The data transformation system of claim 1 wherein said transformation servers include a first transformation server and a second transformation server, said first transformation server includes a set of data converters for at least some of said edges, said second transformation server includes a corresponding set of said data converters for said at least some of said edges;

and wherein said one of said transformation servers includes an algorithm to evaluate and select from the data converters of said set and the data converters of said corresponding set.

20. The data transformation system of claim 19 wherein each of said first and second data converters has a conversion performance vector associated with said one of said edges;

and wherein said algorithm evaluates the conversion performance vectors of said first and second data converters to select one of said first and second data converters for said one of said edges.

21. The data transformation system of claim 19 wherein said one of said transformation servers is said first transformation server;

and wherein said first transformation server includes a first routine to invoke a data converter of said first transformation server, and a second routine to invoke a data converter remote from said first transformation server and associated with said second transformation server.

22. The data transformation system of claim 1 wherein said first and second data formats are selected from the list comprising a file, facsimile data, scanned data, and image data.

23. The data transformation system of claim 1 wherein at least one of said first and second data formats is an application specific format.

24. The data transformation system of claim 1 wherein at least one of said first and second data formats is a hard copy.

25. The data transformation system of claim 1 wherein at least one of said first and second data formats is selected from the list comprising HTML, RTF, facsimile data, scanned data, image data, and printed data.

26. The data transformation system of claim 1 wherein said first and second data formats are selected from the list of data formats comprising a file, facsimile data, scanned data, image data, an application specific format, a hard copy, HTML, and RTF;

and wherein said one of said transformation servers acquires said data in said first data format in one of said data formats and disposes said data in said second data format in a different one of said data formats.

27. The data transformation system of claim 1 wherein said request includes a data file in said first data format, a definition of said second data format, and an instruction for disposing said data in the second data format.

28. The data transformation system of claim 27 wherein said instruction is selected from the list comprising:

holding said data in the second data format for a predetermined time for subsequent retrieval of said data in the second data format and opening a connection on said communication network between said client and said one of said transformation servers before returning said data in the second data format to said client, returning said data in the second data format by opening a connection between said one of said transformation servers and said client before returning said data in the second data format to said client, keeping a connection open on said communication network between said client and said one of said transformation servers until after receiving said data in the second data format, mailing said data in the second data format, and copying said data in the second data format.

29. The data transformation system of claim 28 wherein said instruction is mailing said data in the second data format in an electronic mail message over said communication network.

30. The data transformation system of claim 28 wherein said one of said transformation servers has disk storage;

and wherein said instruction is copying said data in the second data format to said disk storage.

31. The data transformation system of claim 28 wherein one of said transformation servers has disk storage;

and wherein said instruction is copying said data in the second data format to said disk storage over said communication network.

32. The data transformation system of claim 1 wherein said at least one client includes a plurality of client applications and a plurality of transformation servers;

and wherein said one of said transformation servers includes a routine for receiving requests from each of said client applications and transformation servers, and a queue for storing said received requests.

33. The data transformation system of claim 1 wherein said data in a first data format was created by an application;

and wherein said one of said transformation servers initiates at least one data converter including a corresponding application to obtain said data in the second data format.

34. The data transformation system of claim 1 wherein said data in a first data format was created by a first application;

and wherein said one of said transformation servers initiates at least one data converter including a different second application to obtain said data in the second data format.

35. The data transformation system of claim 1 wherein said data in a first data format was created by a first application;

wherein said one of said transformation servers initiates at least one data converter including a corresponding first application to obtain data in said selected at least one intermediate data format, and initiates at least one data converter including a second different application to obtain said data in said second data format.

36. The data transformation system of claim 35 wherein said one of said transformation servers includes an algorithm to evaluate and select said at least one data converter including a corresponding first application and said at least one data converter including a second different application.

37. The data transformation system of claim 35 wherein some of said data converters are remote from said one of said transformation servers;

and wherein said one of said transformation servers includes a routine to invoke said remote data converters.

38. The data transformation system of claim 35 wherein some of said data converters are local to said one of said transformation servers;

and wherein said one of said transformation servers includes a routine to invoke said local data converters.

39. The data transformation system of claim 35 wherein a first set of said data converters are remote from said one of said transformation servers, and a second set of said data converters are local to said one of said transformation servers;

and wherein said one of said transformation servers includes an algorithm to evaluate and select some of said first and second sets of said data converters, a routine to invoke one of the first set of said data converters, and a routine to invoke one of the second set of said data converters.

40. The data transformation system of claim 39 wherein said edges include a first edge, a second edge and a third edge;

wherein said transformation servers include a first transformation server having a first data converter for the first edge, and a second transformation server having a second data converter for the second edge, said first and second transformation servers being remote from said one of said transformation servers, which has a third data converter for the third edge; and

wherein said algorithm evaluates and selects the first data converter in the first transformation server, the second data converter in the second transformation server, and the third data converter in said one of said transformation servers.

2. A data transformation system for use in a heterogeneous computer system, said data transformation system comprising:

at least one client adapted to initiate a request for transformation of data in a first data format to data in a second data format;

a plurality of peer transformation servers, each of said transformation servers including a plurality of data converters and a representation of available data transformations between a plurality of input data formats associated with at least some of said transformation servers and a plurality of output data formats associated with at least some of said transformation servers, said representation including a plurality of unidirectional edges, with each one of said edges extending from one of said input and output data formats to another of said input and output data formats, said transformation servers collectively including at least one of said data converters for each of said edges, at least one of said transformation servers adapted to receive said request for transformation of data and select at least one intermediate data transformation from said first data format to at least one intermediate data format and a final data transformation from said intermediate data format to said second data format, with each of said intermediate and final data transformations being associated with a corresponding one of said edges, said at least one of said transformation servers adapted to initiate a plurality of said data converters corresponding to said selected intermediate and final data transformations, in order to obtain said data in the second data format, and dispose said data in the second data format; and

a communication network adapted to provide communication among said transformation servers and said client,

wherein each of said transformation servers further includes a matrix having said input data formats, said output data formats and a value for each pair of said input and output data formats, said value representing whether a data transformation from said input data format to said output data format of said pair is feasible; and

wherein said one of said transformation servers accesses said matrix of said one of said transformation servers to determine if said request for a transformation of data is feasible before selecting said intermediate and final data transformations.

3. The data transformation system of claim 2 wherein said matrix is a reachability matrix.

41. A method for transforming data in a heterogeneous computer system, said method comprising the steps of:

initiating a request for transformation of data in a first data format to data in a second data format;

communicating said request over a communication network;

receiving said request in one of a plurality of peer transformation servers;

including with each of said peer transformation servers a plurality of data converters and a representation of data transformations between a plurality of input data formats associated with at least some of said peer transformation servers and a plurality of output data formats associated with at least some of said peer transformation servers;

including with said representation a plurality of unidirectional edges, with each one of said edges extending from one of said input and output data formats to another of said input and output data formats;

providing at least one of said data converters for each of said edges;

selecting at least one intermediate data format from a plurality of different intermediate data formats;

selecting at least one intermediate data transformation from said first data format to said selected at least one intermediate data format;

selecting a final data transformation from a final one of said selected at least one intermediate data format to said second data format;

initiating a plurality of said data converters corresponding to said selected intermediate and final data transformations, in order to obtain said data in the second data format; and

disposing said data in the second data format.

42. The method of claim 41 further comprising:

including with each of said data converters a wrapper and at least one of an application and a device; and

employing a common application programming interface to a corresponding one of said peer transformation servers with each of said wrappers.

43. The method of claim 42 further comprising:

employing a script as one of said wrappers.

44. The method of claim 42 further comprising:

requesting interaction by a human being from one of said wrappers.

45. The method of claim 44 further comprising:

employing hard copy as said second data format;

printing said hard copy; and

requesting disposition of said hard copy by said human being.

46. The method of claim 41 further comprising:

employing a data file as said second data format; and

sending said data file over said communication network.

47. The method of claim 46 further comprising:

sending said data file as part of an electronic mail message.

48. The method of claim 46 further comprising:

receiving said sent data file from said communication network; and

displaying said received data file.

49. The method of claim 48 further comprising:

printing said received data file.

50. The method of claim 41 further comprising:

sending a status request regarding said request for transformation of data over said communication network;

receiving said status request; and

returning a current status of said requested transformation over said communication network.

51. The method of claim 41 further comprising:

sending a request to cancel said request for transformation of data over said communication network;

receiving said request to cancel; and

canceling said requested transformation.

52. The method of claim 41 further comprising:

including with said request for transformation of data a source type to define said first data format, a destination type to define to said second data format;

a file of said data in said first data format, and disposition instructions for said data in said second data format; and

communicating said source type, said destination type, said file, and said disposition instructions over said communication network.

53. The method of claim 41 further comprising:

including with each of said data converters a wrapper and at least one of an application and a device;

employing a configuration file in a local transformation server to define a plurality of remote transformation servers; and

polling at least some of said remote transformation servers to determine a list of available wrappers.

54. The method of claim 41 further comprising:

adding another data converter to one of said peer transformation servers for one of said edges;

maintaining a constant representation of said edges; and

defining for said one of said edges at least two edgelets corresponding to a previous data converter and said added data converter for said one of said edges.

55. The method of claim 54 further comprising:

evaluating costs associated with said at least two edgelets; and

selecting one of said data converters corresponding to one of said edgelets having the least cost.

56. The method of claim 41 further comprising:

detecting a failure of one of said data converters; and

invoking an alternative one of said data converters.

57. The method of claim 41 further comprising:

deleting one of said edges; and

recomputing said representation.

58. The method of claim 41 further comprising:

detecting a failure of one of said data converters;

reselecting at least one intermediate data transformation from said first data format to at least one intermediate data format;

reselecting a final data transformation from said reselected intermediate data format to said second data format; and

reinitiating a plurality of said data converters corresponding to said reselected intermediate and final data transformations, in order to obtain said data in the second data format.

59. The method of claim 41 further comprising:

detecting a failure of one of said data converters;

polling at least some of said peer transformation servers to locate a data converter corresponding to said failed one of said data converters;

reselecting at least one intermediate data transformation from said first data format to at least one intermediate data format;

reselecting a final data transformation from said reselected intermediate data format to said second data format; and

reinitiating a plurality of said data converters corresponding to said reselected intermediate and final data transformations, in order to obtain said data in the second data format.

60. The method of claim 41 further comprising:

employing a conversion performance vector associated with one of said edges;

including with said conversion performance vector a plurality of attributes and a plurality of weight values;

employing a file having a file-size and one of said input and output electronic formats;

employing as one of said attributes a cost which is a function of said file-size and the data converters for said one of said edges; and

evaluating the conversion performance vector to select one of said data converters for said one of said edges.

61. The method of claim 41 further comprising:

initiating a request for transformation of data in a third data format to data in a fourth data format;

selecting one data transformation from said third data format to said fourth data format;

initiating one of said data converters corresponding to said selected one data transformation, in order to obtain said data in the fourth data format; and

disposing said data in the fourth electronic format.

62. The method of claim 41 further comprising:

employing a first transformation server including a first data converter for one of said edges;

employing a second transformation server including a second data converter for another one of said edges; and

initiating said first and second data converters, in order to obtain said data in the second electronic format.

63. The method of claim 41 further comprising:

employing a first transformation server including a first data converter for one of said edges and a second data converter for another one of said edges; and

initiating said first and second data converters, in order to obtain said data in the second electronic format.

64. A method for transforming data in a heterogeneous computer system, said method comprising the steps of:

initiating a request for transformation of data in a first data format to data in a second data format;

communicating said request over a communication network;

receiving said request in one of a plurality of peer transformation servers;

including with each of said peer transformation servers a plurality of data converters and a representation of data transformations between a plurality of input data formats associated with at least some of said peer transformation servers and a plurality of output data formats associated with at least some of said peer transformation servers;

including with said representation a plurality of unidirectional edges, with each one of said edges extending from one of said input and output data formats to another of said input and output data formats;

providing at least one of said data converters for each of said edges;

selecting at least one intermediate data transformation from said first data format to at least one intermediate data format;

selecting a final data transformation from said intermediate data format to said second data format;

initiating a plurality of said data converters corresponding to said selected intermediate and final data transformations, in order to obtain said data in the second data format;

disposing said data in the second data format; and

determining if said request for a transformation of data is feasible before selecting said intermediate and final data transformations.

65. A method for transforming data in a heterogeneous computer system, said method comprising the steps of:

initiating a request for transformation of data in a first data format to data in a second data format;

communicating said request over a communication network;

receiving said request in one of a plurality of peer transformation servers;

including with each of said peer transformation servers a plurality of data converters and a representation of data transformations between a plurality of input data formats associated with at least some of said peer transformation servers and a plurality of output data formats associated with at least some of said peer transformation servers;

including with said representation a plurality of unidirectional edges, with each one of said edges extending from one of said input and output data formats to another of said input and output data formats;

providing at least one of said data converters for each of said edges;

selecting at least one intermediate data transformation from said first data format to at least one intermediate data format;

selecting a final data transformation from said intermediate data format to said second data format;

initiating a plurality of said data converters corresponding to said selected intermediate and final data transformations, in order to obtain said data in the second data format;

disposing said data in the second data format;

employing a file of voice data;

employing a unique identifier, which identifies a person, application or device which originated the voice data;

including said file of voice data and said unique identifier with said request for transformation of data;

accessing a voice profile based upon said unique identifier; and

employing said voice profile to convert said file of voice data to text data.