×

Verification by metamorphic testing of applications that utilize artificial intelligence

  • US 10,438,118 B2
  • Filed: 09/28/2018
  • Issued: 10/08/2019
  • Est. Priority Date: 10/09/2017
  • Status: Active Grant
First Claim
Patent Images

1. A method, comprising:

  • receiving, by a device and from a user device, a request to verify a machine learning (ML) application,wherein verification of the ML application is to be performed using a metamorphic testing procedure, andwherein the request includes an indication to validate the metamorphic testing procedure;

    determining, by the device, a type of ML process used by the ML application after receiving the request;

    selecting, by the device, one or more metamorphic relations (MRs), that are to be used for performing the metamorphic testing procedure, based on the type of ML process used by the ML application;

    receiving, by the device, test data that is to be used to test the ML application,wherein the test data is based on the one or more MRs;

    performing, by the device and by using the one or more MRs and the test data, the metamorphic testing procedure to verify one or more aspects of the ML application;

    validating, by the device, the metamorphic testing procedure by using a mutation testing technique to determine whether the one or more MRs identify particular errors that were inserted into the ML application for testing;

    generating, by the device, a report that includes verification results data indicating whether the one or more aspects of the ML application have been verified and validation results data identifying a result of validating the metamorphic testing procedure; and

    providing, by the device, the report for display on an interface of the user device.

View all claims
  • 1 Assignment
Timeline View
Assignment View
    ×
    ×