This study investigates the groundwater quality in the Faridpur district of central Bangladesh based on preselected 60 sample points. Water evaluation indices and a number of statistical approaches such as multivariate statistics and geostatistics are applied to characterize water quality, which is a major factor for controlling the groundwater quality in term of drinking purposes. The study reveal that EC, TDS, Ca2+, total As and Fe values of groundwater samples exceeded Bangladesh and international standards. Ground water quality index (GWQI) exhibited that about 47% of the samples were belonging to good quality water for drinking purposes. The heavy metal pollution index (HPI), degree of contamination (Cd), heavy metal evaluation index (HEI) reveal that most of the samples belong to low level of pollution. However, Cd provide better alternative than other indices. Principle component analysis (PCA) suggests that groundwater quality is mainly related to geogenic (rock–water interaction) and anthropogenic source (agrogenic and domestic sewage) in the study area. Subsequently, the findings of cluster analysis (CA) and correlation matrix (CM) are also consistent with the PCA results. The spatial distributions of groundwater quality parameters are determined by geostatistical modeling. The exponential semivariagram model is validated as the best fitted models for most of the indices values. It is expected that outcomes of the study will provide insights for decision makers taking proper measures for groundwater quality management in central Bangladesh