Supplemental system for business intelligence systems to provide visual identification of meaningful differences

• US 10,242,331 B2
• Filed: 07/28/2017
• Issued: 03/26/2019
• Est. Priority Date: 01/03/2006
• Status: Active Grant

• Current Assignee: Motio Incorporated (Peak6 LLC)
• Original Assignee: Motio Incorporated (Peak6 LLC)
• Inventors: Hankins, Lance W.
• Primary Examiner(s): Nguyen, Phong H
• Application Number:
  US15/662,898
• Publication Number:
  US 20170330115A1
• Time in Patent Office: 606 Days
• Field of Search: 707638, 707695, 707944
• CPC Class Codes: G06F 11/368 for test version control, e.g. updating test cases to a new software version
• CPC Class Codes: G06F 40/197 Version control for software G06F8/71
• CPC Class Codes: G06F 8/71 Version control security arrangements therefor G06F21/57; Configuration management
• CPC Class Codes: G06Q 10/0637 Strategic management or analysis, e.g. setting a goal or target of an organisation; Planning actions based on goals; Analysis or evaluation of effectiveness of goals
• CPC Class Codes: G06Q 10/067 Enterprise or organisation modelling
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: Y10S 707/944 Business related

Abstract

In various implementations, a supplemental system may be provided. The supplemental system may be coupled to business intelligence environment(s) to facilitate visual identification of meaningful differences. In some implementations, expressions to exclude may be identified and specifications associated with BI Artifacts may be instrumented based on the expressions to exclude. Enhanced Business Intelligence Artifact Outputs may be generated to visually identify differences between BI Artifact Outputs that are not associated with expressions to exclude.

Claims

1. A method comprising:

retrieving a first set of expressions;

retrieving a first specification associated with a first Business Intelligence Artifact in a first Business Intelligence Environment and a second specification associated with a second Business Intelligence Artifact, wherein the first Business Intelligence Artifact is deployed in a first Business Intelligence Environment, and wherein the second Business Intelligence Artifact is deployed in a second Business Intelligence Environment;

evaluating each expression in the first set of expressions to identify a set of matched elements in the first specification and to identify a set of matched elements in the second specification;

injecting one or more exclude specification markers proximate to each of the identified matched elements in the first specification to generate a first instrumented specification and proximate to each of the identified matched elements in the second specification to generate a second instrumented specification, wherein each exclude specification marker comprises an exclude style;

executing the first instrumented specification in the first Business Intelligence Environment to generate a first Business Intelligence Artifact Output and executing the second instrumented specification in the second Business Intelligence Environment to generate a second Business Intelligence Artifact Output, wherein the first Business Intelligence Artifact Output and the second Business Intelligence Artifact Output comprise one or more output markers associated with at least one of the injected exclude specification markers, and wherein each of the output markers is generated based on one or more visual formatting rules of at least one of the associated injected exclude specification markers; and

wherein each of the output markers include one or more visual characteristics rendered in the exclude style;

generating a first set of images which represent at least a portion of the content from the first Business Intelligence Artifact Output;

generating a second set of images which represent at least a portion of the content from the second Business Intelligence Artifact Output;

comparing at least a portion the first set of images to at least a portion of the second set of images;

determining a set of meaningful differences between the first Business Intelligence Artifact and the second Business Intelligence Artifact based on the comparison, wherein the set of meaningful differences comprise differences that occur in output regions that are not associated with one or more of the expressions in the first set of expressions; and

generating at least one of;

a first Enhanced Business Intelligence Artifact Output

or a second Enhanced Business Intelligence Artifact Output in which the determined set of meaningful differences are visually identified in a difference region style.

2. The method of claim 1 wherein the first Enhanced Business Intelligence Artifact Output comprises the first Business Intelligence Artifact Output combined with a first overlay, wherein the first overlay comprises a first visual identification in the difference region style of each of the output regions that contain one or more of the meaningful differences in the set of meaningful differences;

and wherein the second Enhanced Business Intelligence Artifact Output comprises the second Business Intelligence Artifact Output combined with a second overlay, wherein the second overlay comprises a second visual identification in the difference region style of each of the output regions that contain one or more of the meaningful differences in the set of meaningful differences.

3. The method of claim 1 wherein in at least one of the first Enhanced Business Intelligence Artifact Output or the second Enhanced Business Intelligence Artifact Output, a visual identification of one or more of the output regions associated with one or more of the expressions in the set of expressions to exclude is less visually apparent to a user than a visual identification of each of the output regions that contains one or more meaningful differences in the set of meaningful differences.

4. The method of claim 3 wherein the visual identification of the regions associated with one or more of the expressions in the set of expressions to exclude comprises the exclude style, and wherein the exclude style comprises a color that is similar to at least one of a first color of portion of the first Business Intelligence Artifact Output or a second color of a portion of the second Business Intelligence Artifact Output.

5. The method of claim 1 wherein determining the set of meaningful differences comprises:

comparing portions of the first set of images to portions of the second set of images; and

identifying the differences that occur in image regions not bounded by the exclude style.

6. The method of claim 1 wherein generating the first set of images comprises:

generating the first set of images which represent at least a portion of the content from the first Business Intelligence Artifact Output; and

modifying one or more of the images in the first set of images such that one or more regions in the exclude style in the one or more images of the first set of images are modified to include a suppress color;

and wherein generating the second set of images comprises;

generating the second set of images which represent at least a portion of the content from the second Business Intelligence Artifact Output; and

modifying one or more of the images in the second set of images such that one or more regions in the exclude style in the one or more images of the second set of images are modified to include the suppress color.

7. The method of claim 1 wherein visually identifying the determined set of meaningful differences comprises bounding via a first overlay one or more regions in at least a portion of the first Business Intelligence Artifact Output in the difference region style, and further comprising identifying one or more meaningful differences in a first region of the first set of images that are within a predetermined number of pixels from a second region including one or more other meaningful differences;

and bounding, via the first overlay, a third region in the first Business Intelligence Artifact Output of the first Enhanced Business Intelligence Artifact Output in the difference region style, wherein the third region includes a first region associated with the first region of the first set of images, a second region associated with the second region of the first set of images, and a fourth region associated with a fourth region in the first set of images, wherein the fourth region in the first set of images is disposed at least one of between or proximate the first region of the first set of images and second region of the first set of images, wherein the fourth region has a size less than the predetermined number of pixels.

8. The method of claim 1 wherein the first Business Intelligence Environment comprises a first version of a Business Intelligence Software, and wherein the second Business Intelligence Environment comprises a second version of the Business Intelligence Software that is different from the first version of the Business Intelligence Software, and wherein the first Business Intelligence Artifact is similar to the second Business Intelligence Artifact.

9. The method of claim 1 wherein injecting one or more of the exclude specification markers proximate comprises injecting one or more exclude specification markers such that the one or more exclude specification markers are at least one of:

before each of the identified matched elements,

after each of the identified matched elements,

into an ancestor of each of the identified matched elements,

or under an ancestor of each of the identified matched elements.

10. The method of claim 1 further comprising:

presenting the set of meaningful differences via a graphical user interface prior to generating at least one of the first Enhanced Business Intelligence Artifact Output or the second Enhanced Business Intelligence Artifact Output;

in response to the presentation of the set of meaningful differences, receiving a request for comparison of a second portion of the content from the first Business Intelligence Artifact Output and a second portion of the content from the second Business Intelligence Artifact Output;

generating an additional first set of images which represent the second portion of the content from the first Business Intelligence Artifact Output;

generating an additional second set of images which represent the second portion of the content from the second Business Intelligence Artifact Output;

comparing at least a portion the additional first set of images to at least a portion of the additional second set of images;

determining an additional set of meaningful differences between the first Business Intelligence Artifact and the second Business Intelligence Artifact based on the comparison, wherein the second set of meaningful differences comprise differences that are not associated with one or more of the expressions in the set of expressions to exclude; and

including the additional set of meaningful differences in the previously determined set of meaning differences between the first Business Intelligence Artifact and the second Business Intelligence Artifact.

11. The method of claim 1 wherein comparing at least a portion the first set of images to at least a portion of the second set of images comprises comparing a first set of pixels in a first location of the first set of images to a second set of pixels in a first location of the second set of images, wherein the first location of the first set of images and the first location of the second set of images are similar.

12. The method of claim 1 wherein one or more of the output markers comprise a first border injected into the first Business Intelligence Artifact Output, and wherein the first border at least partially encloses each part of the first Business Intelligence Artifact Output associated with one of the identified matched elements in the first instrumented specification;

and one or more of the output markers comprise a second border injected into the second Business Intelligence Artifact Output, and wherein the second border at least partially encloses each part of the second Business Intelligence Artifact Output associated with one of the identified matched elements in the second instrumented specification, and wherein the first border and the second border are rendered in the exclude style.

13. A method comprising:

retrieving a first Business Intelligence Artifact Output from a location referenced by a memory of an Supplemental System;

retrieving a first set of expressions;

retrieving a specification associated with a Business Intelligence Artifact, wherein the Business Intelligence Artifact is deployed in a Business Intelligence Environment;

evaluating each expression in the first set of expressions to identify a set of matched elements in the specification;

injecting one or more exclude specification markers proximate to each of the identified matched elements in the specification to generate an instrumented specification, wherein each exclude specification marker comprises an exclude style;

executing the instrumented specification in the Business Intelligence Environment to generate a second Business Intelligence Artifact Output, wherein the second Business Intelligence Artifact Output comprise one or more output markers associated with at least one of the injected exclude specification markers, and wherein each of the output markers is generated based on one or more visual formatting rules of at least one of the associated injected specification markers; and

wherein each of the output markers include one or more visual characteristics rendered in the exclude style;

generating a first set of images which represent at least a portion of the content from the first Business Intelligence Artifact Output;

generating a second set of images which represent at least a portion of the content from the second Business Intelligence Artifact Output, wherein the second set of images include parts visually identified in the exclude style that are associated with the identified matched elements;

comparing at least a portion the first set of images to at least a portion of the second set of images, wherein parts of the first set of images and parts of the second set of images visually identified in the exclude style are not compared; and

determining a set of meaningful differences between the first Business Intelligence Artifact Output and the second Business Intelligence Artifact Output based on the comparison.

14. The method of claim 13 further comprising presenting one or more of the meaningful differences in the set of meaningful differences via a graphical user interface.

15. The method of claim 14 wherein presenting one or more of the meaningful differences comprises presenting at least one of:

a first Enhanced Business Intelligence Artifact Output in which each of the meaningful differences in the determined set of meaningful differences is visually identified in a difference region style,

or a second Enhanced Business Intelligence Artifact Output in which each of the meaningful differences in the determined set of meaningful differences is visually identified in the difference region style;

and wherein the first Enhanced Business Intelligence Artifact Output comprises the first Business Intelligence Artifact Output combined with a first overlay providing a visual identification in the difference region style of each of the meaningful differences in the set of meaningful differences; and

wherein the second Enhanced Business Intelligence Artifact Output comprises the second Business Intelligence Artifact Output combined with a second overlay providing a visual identification in the difference region style of each of the meaningful differences in the set of meaningful differences.

16. The method of claim 15 wherein parts of the second Business Intelligence Artifact Output identified in the exclude style are visually identified in the second Enhanced Business Intelligence Artifact Output in the exclude style.

17. The method of claim 15 wherein visually identifying the determined set of meaningful differences comprises bounding via a first overlay one or more regions in at least a portion of the first Business Intelligence Artifact Output in the difference region style, and further comprising identifying one or more meaningful differences in a first region of the first set of images that are within a predetermined number of pixels from a second region including one or more other meaningful differences;

and bounding, via the first overlay, a third region in the first Business Intelligence Artifact Output of the first Enhanced Business Intelligence Artifact Output in the difference region style, wherein the third region includes a first region associated with the first region of the first set of images, a second region associated with the second region of the first set of images, and a fourth region associated with a fourth region in the first set of images, wherein the fourth region in the first set of images is disposed at least one of between or proximate the first region of the first set of images and second region of the first set of images, wherein the fourth region has a size less than the predetermined number of pixels.

18. The method of claim 15 wherein in at least one of the first Enhanced Business Intelligence Artifact Output or the second Enhanced Business Intelligence Artifact Output, a visual identification of one or more of the output regions associated with one or more of the expressions in the set of expressions to exclude is less visually apparent to a user than a visual identification of each of the output regions that contains one or more meaningful differences in the set of meaningful differences.

19. The method of claim 13 wherein determining the set of meaningful differences comprises:

comparing portions of the first set of images to portions of the second set of images; and

identifying the differences that occur in image regions not bounded by the exclude style.

20. The method of claim 13 further comprising:

receiving a request for comparison of a second portion of the content from the first Business Intelligence Artifact Output and a second portion of the content from the second Business Intelligence Artifact Output;

generating an additional first set of images which represent the second portion of the content from the first Business Intelligence Artifact Output;

generating an additional second set of images which represent the second portion of the content from the second Business Intelligence Artifact Output;

comparing at least a portion the additional first set of images to at least a portion of the additional second set of images, wherein parts of the additional first set of images and parts of the additional second set of images visually identified in the exclude style are not compared;

determining an additional set of meaningful differences between the first Business Intelligence Artifact and the second Business Intelligence Artifact based on the comparison; and

adding the meaningful differences to the additional set of meaningful differences to the set of meaningful differences.