The drying of porous media is of major importance for civil engineering, geophysics, petrophysics, and the conservation of stone artworks and buildings. More often than not, stones contain salts that can be mobilized by water (e.g., rain) and crystallize during drying. The drying speed is strongly influenced by the crystallization of the salts, but its dynamics remains incompletely understood. Here, we report that the mechanisms of salt precipitation, specifically the primary or secondary nucleation, and the crystal growth are the key factors that determine the drying behaviour of salt contaminated porous materials and the physical weathering generated by salt crystallization. When the same amount of water is used to dissolve the salt present in a stone, depending on whether this is done by a rapid saturation with liquid water or by a slow saturation using water vapor, different evaporation kinetics and salt weathering due to different crystallization pathways are observed.