Although the role of vitamins in the human body is proven, guidelines for patients with chronic kidney disease (CKD) remain unclear. This narrative review summarizes the findings of 98 studies of CKD and the effects of vitamin D, B, C, A, E, and K supplementation on patients on dialysis for CKD, with the aim of summarizing the existing guidelines. The findings are promising, showing the potential effectiveness of vitamin supplementation with, for example, vitamins B, D, or C. However, recommendations are still ambiguous, especially in the case of vitamins A and K, due to the potential toxicity associated with higher doses for patients. Continued research is needed to rigorously evaluate the effectiveness and carefully consider the potential risks of some vitamin supplementation for patients with CKD.