This study explores the development of new room-temperature NO2 sensors utilizing carbon nanofibers (CNFs), single-walled carbon nanotubes (SWCNTs), and their hybrids with reduced graphite oxide (rGO), fabricated via a facile drop casting method with varying concentrations of carbon/ethanol mixtures. The concentration-dependent relation of sensor response to NO2 has been found. Comprehensive characterization techniques, including electron microscopy, Raman spectroscopy, optical microscopy, and X-ray diffraction were employed to analyze the sensing materials. Our results reveal that CNFs exhibit superior sensitivity, reaching −1.32%/ppm at an optimal suspension concentration of 1.5 mg/mL, outperforming SWCNTs. The creation of hybrid composites, specifically CNFs/rGO and SWCNTs/rGO, further enhances sensing performance due to synergistic effects. Molecular dynamics simulations revealed increased adsorption behavior of the CNFs/rGO hybrid sensing material. The fabricated devices, based on all-carbon composites, are effective and energy-efficient platforms for NO2 detection, offering promising solutions for environmental monitoring, the chemical industry, and industrial safety applications.