The mixture of the ionic liquid 1-ethyl-3-methylimidazolium acetate (EmimAc) and dimethylsulfoxide (DMSO) was employed to dissolve microcrystalline cellulose (MCC). A 10 wt % cellulose dope solution was prepared for spinning cellulose hollow fibers (CHFs) under a mild temperature of 50 °C by a dry–wet spinning method. The defect-free CHFs were obtained with an average diameter and thickness of 270 and 38 µm, respectively. Both the XRD and FTIR characterization confirmed that a crystalline structure transition from cellulose I (MCC) to cellulose II (regenerated CHFs) occurred during the cellulose dissolution in ionic liquids and spinning processes. The thermogravimetric analysis (TGA) indicated that regenerated CHFs presented a similar pyrolysis behavior with deacetylated cellulose acetate during pyrolysis process. This study provided a suitable way to directly fabricate hollow fiber carbon membranes using cellulose hollow fiber precursors spun from cellulose/(EmimAc + DMSO)/H₂O ternary system.