This study presents methods to handle deep learning regressions with input and output sequences of different lengths. We discuss the Autoregressive one-step prediction framework and introduce an innovative one-time multi-step (OTMS) prediction approach, based on a custom loss function, that predicts all future steps in a single shot. The presented methodologies are then applied to simultaneously predict the State of Health (SoH) trajectory and estimate the Remaining Useful Life (RUL) of lithium-ion battery cells. Accurate estimates of SoH trajectory and RUL are essential for Battery Management Systems (BMSs), electronic systems that guarantee safety while maximizing performance and extending battery lifespan. In this context, the studied methodologies were compared using a rigorous cross-validation approach. The OTMS model showed better predictions in early cycles, while the Autoregressive model performed better in later cycles, suggesting a hybrid approach between these two methodologies as an optimal solution.
Hawkes processes are stochastic point processes with self-exciting behavior, where the occurrence of an event increases the probability of subsequent events. In this paper, we provide a concise yet comprehensive introduction to Hawkes processes, focused on applications. We then employ marked Hawkes processes to model the occurrences of transactions in European Union Allowances (EUA) futures. The models are trained using an innovative and efficient Maximum Likelihood Estimation (MLE) implementation, that leverages PyTorch library to parallelize computations and exploit automatic differentiation. We evaluate and compare different excitation functions using Akaike Information Criterion (AIC), Bayesian Information Criterion (BIC), and Quantile-Quantile (Q-Q) plots based on the Random Time Change theorem. Additionally, we analyze the distribution of the calibrated parameters across different trading hours, finding the consistent relationship α = 3√(β2), to our knowledge never described before, between the self-exciting intensity parameter α and the decay parameter β . Furthermore, we identify two clusters: one characterized by transactions with a strong self-exciting effect, but that decays very quickly, and another with a less intense effect, that persists over longer time. Using logistic regression, we analyze the characteristics of the clusters and provide possible interpretations. We consider Hawkes processes very promising yet underutilized techniques for studying financial markets, and we believe this work can encourage researchers and practitioners to dive further into these models.