The application of silver nanoparticles (AgNPs) in antibacterial materials, glucose detection, etc., is of broad interest for researchers around the world. Nanocellulose with many excellent properties can be used as a carrier and stabilizer to assist in the synthesis of AgNPs. In this study, cellulose nanofibrils (CNFs) and cellulose nanocrystals (CNCs) were used to assist in the synthesis of AgNPs under the reduction of glucose and detection of glucose concentration under different conditions. Transmission electron microscopy (TEM) analysis showed that the AgNPs in the nanocellulose-AgNPs (NC-AgNPs) system were roughly spherical and randomly distributed on the nanocellulose. In the whole reaction system, when the concentration of nanocellulose is 0.11 mg/mL, the concentration of silver ammonia solution is 0.6 mM, and the mixing time is 2.5 h, according to the UV-Vis analysis, the absorbance of CNF-AgNPs at 425 nm exhibited a good linear relationship (R² = 0.9945) with the glucose concentration range (5–50 μM), while the absorbance of CNC-AgNPs at 420 nm showed a good linear relationship (R² = 0.9956) with the glucose concentration range (5–35 μM). The synthesis of NC-AgNPs can be further developed into a sensor with higher sensitivity and higher stability for detecting glucose concentration and a material with antibacterial effects.