High-quality water availability is substantial for sustaining life, so its contamination presents a serious problem that has been the focus of several studies. The presence of heavy metals, such as cadmium, is frequently studied due to the increase in the contamination levels caused by fast industrial expansion. Cadmium ions were removed from aqueous solutions at pH 7.0 by chitosan–magnetite (ChM) xerogel beads and chitosan–FeO (ChF) xerogel beads in batch systems. Kinetic studies were best modeled by the Elovich model. The adsorption isotherms obtained showed an inflection point suggesting the formation of a second layer, and the BET model adjusted to liquid–solid systems was adequate for the description of the experimental data. Maximum uptake capacities of 36.97 ± 0.77 and 28.60 ± 2.09 mg Cd/g xerogel were obtained for ChM and ChF, respectively. The studied composites are considered promising adsorbent materials for removing cadmium ions from aqueous systems.