In the replacement of the reinforced concrete slab in existing steel girder bridges, a loop joint is commonly used to join precast concrete slabs on site. However, a relatively wide joint is needed, and considerable time and effort are consumed to construct the joint due to the addition of transverse reinforcements to the joint on site. These disadvantages affect the progress of on-site construction and should be addressed, especially when this method is applied to highway bridges, where early traffic opening is necessary in many cases. This study proposes a narrow loop joint that has fiber-reinforced mortar without transverse reinforcements. Several material tests were conducted to determine a suitable material for the joint. A series of flexural loading tests of slabs was conducted to investigate the flexural behavior of the proposed loop joint with the selected material (polyvinyl alcohol (PVA) fibers). The results showed that the flexural capacity and deformation performance of the proposed joint with PVA fibers are equivalent to those of the conventional loop joint.