The gradual deterioration of water quality caused by human activities and global warming can lead to severe public health and economic consequences. Despite the critical need for effective water quality (WQ) monitoring using networks of automated sensors to mitigate these risks, the data collected are inevitably contaminated with missing values and insufficient monitoring frequency, which can hinder WQ prediction, assessment, and early warning. Various methods have been proposed to address the issue of incomplete data in follow-up applications through missing value imputation. However, the existing imputation approaches of incomplete WQ data fail to fully consider certain important mutual relationships among the spatio-temporal measurements and the imbalanced distribution of known data in an high-dimensional and incomplete (HDI) WQ tensor. Latent factorization of tensors (LFT) has been demonstrated to be particularly effective in many other applications. In this paper, we propose a Biased Non-negative Latent factorization of tensors with Nonlinear Regularization (BNLNR) model. This study adopts a nonlinear swish regularization scheme, aiming at enhancing the solution space of a resultant Non-negative Latent factorization of tensors (NLFT) model so as to improve its representative learning ability. Investigations using two large high-frequency water quality datasets reveal that the imputation accuracy of proposed method considerably outperforms several state-of-art baselines for different testing cases. Experimental results on two high-frequency WQ datasets from real applications demonstrate that compared with state-of-the-art models, the BNLNR model achieves prominent imputation accuracy for unobserved WQ data.