Perhaps the first nonparametric, asymptotically optimal prediction intervals are provided for univariate random walks, with applications to renewal processes. Perhaps the first nonparametric prediction regions are introduced for vector-valued random walks. This paper further derives nonparametric data-splitting prediction regions, which are underpinned by very simple theory. Some of the prediction regions can be used when the data distribution does not have first moments, and some can be used for high-dimensional data, where the number of predictors is larger than the sample size. The prediction regions can make use of many estimators of multivariate location and dispersion.
Inference after model selection is a very important problem. Model selection algorithms for ARIMA time series, with criteria such as AIC and BIC, tend to select an inconsistent model with positive probability, making data-splitting inference for testing and confidence intervals unreliable. One technique was fairly reliable for sample sizes greater than 600, and a modification also worked. Model selection is often useful for prediction, since the selected submodel tends to have fitted values and residuals that are highly correlated with those of the full model. A few prediction intervals perform fairly well even after model selection. A useful technique for handling outliers is to replace the outliers with missing values.