This study aims to identify and visualize electrocardiogram (ECG) features using an explainable deep learning–based algorithm to predict cardiac resynchronization therapy (CRT) outcome. Its performance is compared with current guideline ECG criteria and QRSAREA. A deep learning algorithm, trained on 1.1 million ECGs from 251 473 patients, was used to compress the median beat ECG, thereby summarizing most ECG features into only 21 explainable factors (FactorECG). Pre-implantation ECGs of 1306 CRT patients from three academic centres were converted into their respective FactorECG. FactorECG predicted the combined clinical endpoint of death, left ventricular assist device, or heart transplantation [c-statistic 0.69, 95% confidence interval (CI) 0.66–0.72], significantly outperforming QRSAREA and guideline ECG criteria [c-statistic 0.61 (95% CI 0.58–0.64) and 0.57 (95% CI 0.54–0.60), P < 0.001 for both]. The addition of 13 clinical variables was of limited added value for the FactorECG model when compared with QRSAREA (Δ c-statistic 0.03 vs. 0.10). FactorECG identified inferolateral T-wave inversion, smaller right precordial S- and T-wave amplitude, ventricular rate, and increased PR interval and P-wave duration to be important predictors for poor outcome. An online visualization tool was created to provide interactive visualizations (https://crt.ecgx.ai). Requiring only a standard 12-lead ECG, FactorECG held superior discriminative ability for the prediction of clinical outcome when compared with guideline criteria and QRSAREA, without requiring additional clinical variables. End-to-end automated visualization of ECG features allows for an explainable algorithm, which may facilitate rapid uptake of this personalized decision-making tool in CRT. First, an artificial intelligence algorithm (variational auto-encoder) was pretrained on 1.1 million electrocardiograms (ECGs) to learn the underlying continuous factors that generate the ECG (i.e. the FactorECG). In this process, the variational auto-encoder (VAE) learns to reconstruct ECGs as accurately as possible using only 21 continuous factors without any human input. In the training phase, the pre-procedural median beat ECGs of 1306 cardiac resynchronization therapy (CRT) patients were each converted into their FactorECG. These 21 factors were subsequently used as input in a Cox model to predict the primary composite endpoint of left ventricular assist device implantation, heart transplantation and all-cause death, and the secondary endpoint of echocardiographic response. FactorECG significantly improved outcome prediction following CRT when compared with the current guidelines and QRSAREA. The algorithm is explainable by using the decoder to visualize the effect of the ECG factors that significantly predicted outcome on the median beat ECG morphology. Here, for example, the influence of Factor 9 (F9) is visualized, where higher values represent a more left bundle branch block-like ECG morphology and lower values, a more right bundle branch block-like morphology. CRT, cardiac resynchronization therapy; DNN, deep neural network; ECG, electrocardiogram; HTx, heart transplantation; LVAD, left ventricular assist device.