The common steps to calibrate and validate classification models based on partial least squares discriminant analysis are discussed in the present tutorial. All issues to be evaluated during model training and validation are introduced and explained using a chemical dataset, composed of toxic and non-toxic sediment samples. The analysis was carried out with MATLAB routines, which are available in the ESI of this tutorial, together with the dataset and a detailed list of all MATLAB instructions used for the analysis.
One of the OECD principles for model validation requires defining the Applicability Domain (AD) for the QSAR models. This is important since the reliable predictions are generally limited to query chemicals structurally similar to the training compounds used to build the model. Therefore, characterization of interpolation space is significant in defining the AD and in this study some existing descriptor-based approaches performing this task are discussed and compared by implementing them on existing validated datasets from the literature. Algorithms adopted by different approaches allow defining the interpolation space in several ways, while defined thresholds contribute significantly to the extrapolations. For each dataset and approach implemented for this study, the comparison analysis was carried out by considering the model statistics and relative position of test set with respect to the training space.
15 June 2009 in Journal of Chemical Information and Modeling