Soil contamination is associated with a high potential for health issues. This study aimed to investigate the bioaccumulation of heavy metals and its associated health impact among residents near a mining area. We performed environmental monitoring by analyzing lead (Pb), cadmium (Cd), and arsenic (As) levels in soil and rice samples, as well as biomonitoring by analyzing blood and urine samples from 58 residents living near the mine. Additionally, concentration trends were investigated among 26 participants in a 2013 study. The Cd and As levels in the soil samples and Cd levels in the rice samples exceeded the criteria for concern. The geometric mean blood Cd level (2.12 μg/L) was two times higher than that in the general population aged > 40 years. The blood Cd level showed decreasing trends from the previous measurements of 4.56–2.25 μg/L, but was still higher than that in the general population. The blood and urine Cd levels were higher in those with a low estimated glomerular filtration rate (eGFR) than in those with normal eGFR. In conclusion, heavy metals from mining areas can accumulate in soil and rice, adversely impacting human health. Continuous environmental monitoring and biomonitoring are required to ensure the safety of residents.