Salinity acts as a critical environmental filter on microbial communities in natural systems, negatively affecting microbial diversity. However, how salinity affects microbial community assembly remains unclear. This study used Wendeng multi-pond saltern as a model to evaluate the prokaryotic community composition and diversity and quantify the relative importance of ecological processes across salinity gradients. The results showed that low-saline salterns (45–80 g/L) exhibited higher bacterial diversity than high-saline salterns (175–265 g/L). The relative abundance of taxa assigned to Halomicrobiaceae, Rhodobacteraceae, Saprospiraceae, and Thiotrichaceae exhibited a hump-shaped dependence on increasing salinity. Salinity and pH were the primary environmental factors that directly or indirectly determined the composition and diversity of prokaryotic communities. Microbial co-occurrence network dynamics were more complex in the sediment than in the water of salterns. An infer Community Assembly Mechanisms by Phylogenetic-bin-based null model analysis (iCAMP) showed that microbial community assembly in sediment and water differed. Our findings provide more information about microbial community structure and the importance of various ecological processes in controlling microbial community diversity and succession along salinity gradients in water and sediment.