Compared with traditional lead-acid batteries, nickel–cadmium batteries and nickel-hydrogen batteries, lithium-ion batteries (LIBs) are much more environmentally friendly and much higher energy density. Besides, LIBs own the characteristics of no memory effect, high charging and discharging rate, long cycle life and high energy conversion rate. Therefore, LIBs have been widely considered as the most promising power source for mobile devices. Commonly used LIBs contain carbonate based liquid electrolytes. Such electrolytes own high ionic conductivity and excellent wetting ability. However, the use of highly flammable and volatile organic solvents in them may lead to problems like leakage, thermo runaway and parasitic interface reactions, which limit their application. Solid polymer electrolytes (SPEs) can solve these problems, while they also bring new challenges such as poor interfacial contact with electrodes and low ionic conductivity at room temperature. Many approaches have been tried to solve these problems. This article is divided into three parts to introduce polyethylene oxide (PEO) based polymer-ceramic hybrid solid electrolyte, which is one of the most efficient way to improve the performance of SPEs. The first part focuses on polymer-lithium salt (LiX) matrices, including their ionic conduction mechanism and impact factors for their ionic conductivity. In the second part, the influence of both active and passive ceramic fillers on SPEs are reviewed. In the third part, composite SPEs’ preparation methods, including solvent casting and thermocompression, are introduced and compared. Finally, we propose five key points on how to make composite SPEs with high ionic conductivity for reference.