Flexible order of authoring for data integration solutions

• US 8,874,622 B2
• Filed: 03/28/2011
• Issued: 10/28/2014
• Est. Priority Date: 03/28/2011
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Clemente Filho, Sergio Silveira, Carroll, Matthew, McGuire, Kevin Thomas Edward, Ryan, Cimarron S
• Primary Examiner(s): MORRISON, JAY A
• Application Number:
  US13/073,212
• Publication Number:
  US 20120254259A1
• Time in Patent Office: 1,310 Days
• Field of Search: None
• US Class Current: 707/804
• CPC Class Codes: G06F 16/25 Integrating or interfacing systems involving database management systems

Abstract

A method includes connecting an integration process to a first set of inputs. The first set of inputs may include one or more inputs. The integration process includes one or more data transformation operations using the inputs. The method further includes receiving metadata about one or more of the inputs in the first set of inputs. The metadata about one or more of the inputs in the first set of inputs is cached. The integration process is then connected to a second set of inputs based on the cached metadata about one or more of the inputs in the first set of inputs.

Claims

1. In a computing environment, a method of performing development activities on a data flow, the method comprising:

receiving metadata about the data flow, wherein the data flow comprises information regarding a data type input data from a source device, definitions of data manipulation by the transformation component, and a data type of output data to a destination device;

caching, by a transform device, the metadata to form cached metadata, the cached metadata including the type of the input data and the type of the output data;

determining that the source device is not in communication with the transform device;

and after determining that the source device is not in communication with the transform device;

performing, by the transform device, development activities on the data flow by using the cached metadata to identify the type of at least one datum of the input data, wherein performing development activities includes altering data transform applied to the input data to form a new transform;

applying, by the transform device, the new transform to form transformed data;

transmitting the transformed data to the destination component; and

after determining that the source component is no longer in communication with the transform device, determining that the source component is again in communication with the source device.

2. The method of claim 1, wherein the metadata describes columns from the source device.

3. The method of claim 1, further comprising receiving a user selection to map the input data to the output data.

4. The method of claim 1, Wherein identifying a type of at least one datum of the input data occurs automatically.

5. The method of claim 4, further comprises automatically selecting the at least one datum of the input data and mapping the at least one datum to a destination of the destination device.

6. The method of claim 5, wherein the automatically selecting occurs by identifying the at least one datum as a type that matches a type of an at least one datum in the output data.

7. The method of claim 1, further comprising providing a user with information based on the metadata about the source device.

8. The method of claim 1, further comprising updating the cached metadata after determining that the source component is again in communication with the source device.

9. The method of claim 1 wherein the information regarding input data comprises data type.

10. The method of claim 1 wherein the information regarding out data comprises data type comprises metadata about data destination related to the one or more components in the data flow.

11. The method of claim 1 wherein the metadata comprises column header information.

12. One or more physical computer readable storage media comprising computer executable instructions that when executed by one or more processors cause the following to be performed:

receiving metadata about a data flow, wherein the data flow comprises information regarding input data from a source device, and further wherein the data flow comprises information regarding output data to a destination device;

caching the metadata to form cached metadata, the cached metadata including the type of the input data and the type of the output data;

determining that the source device is not in communication with the transform device;

performing development activities on the data flow by using the cached metadata to identify the type of the input data, wherein performing development activities includes altering a data transform applied to the input data to form a new transform;

applying, by the transform device, the new transform to form transformed data;

transmitting the transformed data to the destination component; and

after determining that the source component is no longer in communication with the transform device, determining that the source component is again in communication with the source device.

13. The one or more physical computer readable media of claim 12, wherein receiving metadata about one or more components in a data flow occurs as a result of connecting to the data flow.

14. The one or more physical computer readable media of claim 12, wherein receiving metadata is received through a network.

15. The one or more physical computer readable media of claim 12, wherein the metadata further comprises information related to a transform device.

16. The one or more physical computer readable media of claim 12, wherein the information related to a transform comprises transform outputs.

17. The one or more physical computer readable media of claim 12, wherein receiving metadata is performed by receiving metadata from an integration process developer.

18. The one or more physical computer readable media of claim 12, wherein receiving metadata is performed by receiving metadata about a placeholder column.

19. In a computing environment, a method of changing an integration process source, the method comprising:

receiving metadata about the data flow by traversing an upstream path of the data flow and returning available columns from the upstream path;

wherein the data flow comprises information regarding input data from a source device, and further wherein the data flow comprises information regarding output data to a destination device;

caching the metadata about one or more components in the data flow including information about the available columns;

determining that the source device is not in communication with the data flow;

after determining that the source device is not in communication with the data flow, adding at least one additional placeholder columns to the cached metadata based on a required column in a destination device; and

performing, by a transform device, development activities by using the cached added metadata about placeholder columns, wherein performing development activities includes altering a data transform applied to the input data to form a new transform;

transmitting the new transform to a destination component.