Sulfide electrolyte all-solid-state lithium-ion batteries (ASSLBs) that have inherently nonflammable properties have improved greatly over the past decade. However, determining both the stable and functional electrode components to pair with these solid electrolytes requires significant investigation. Solid electrolyte comprises 20–40% of the composite cathode electrode, which improves the ionic conductivity. However, this results in thick electrolyte that blocks the electron pathways in the electrode, significantly lowering the electrochemical performance. The application of conductive carbon material is required to overcome this issue, and, hence, determining the carbon properties that result in the most stable performance in the sulfide solid electrolyte is vital. This study analyzes the effect of the cathode conductive additive’s morphology on the electrochemical performance of sulfide electrolyte-based ASSLBs. Carbon black (CB) and carbon nanotubes (CNTs), which provide electron pathways at the nanoscale and sub-micron scale, and carbon nanofiber (CNF), which provides electron pathways at the tens-of-microns scale, are all tested individually as potential conductive additives. When the CNF, with its high crystallinity, is used as a conductive material, the electrochemical performance shows an excellent initial discharge capacity of 191.78 mAh/g and a 50-cycle capacity retention of 83.9%. Conversely, the CB and the CNTs, with their shorter pathways and significantly increased surface area, show a relatively low electrochemical performance. By using the CNF to provide excellent electrical conductivity to the electrode, the polarization is suppressed. Furthermore, the interfacial impedance across the charge transfer region is also reduced over 50 cycles compared with the CB and CNT composite cells. These findings stringently analyze and emphasize the importance of the morphology of the carbon conductive additives in the ASSLB cathode electrodes, with improvements in the electrochemical performance being realized through the application of long-form two-dimensional crystalline CNFs.