This study investigated the relationship between eye frailty and physical, social, and psychological/cognitive weaknesses among older adults in Japan. The participants were 192 community-dwelling older adult women. We measured handgrip strength, walking speed, and skeletal muscle mass; additionally, their physical, social, and psychological/cognitive frailties were surveyed using questionnaires. Eye frailty self-checks were used to assess eye frailty. Exploratory and confirmatory factor analyses were employed to verify the validity of the eye frailty self-checks. Eye frailty prevalence and related factors were investigated by conducting a binomial logistic regression analysis, with eye frailty as the dependent variable. The factor analysis results showed that a model could be constructed with the two factors of visual acuity or contrast and visual field. The model’s goodness of fit was acceptable, supporting the validity of the self-checking construct. The Kihon checklist was the only variable with a significant relationship to eye frailty. Regarding the relationship between eye frailty and subordinate items of the Kihon checklist, social withdrawal [odds ratio (OR) 2.437, 95% confidence interval 1.145–5.188], cognitive function (OR 2.047, 95%CI 1.051–3.984), and depressed mood (OR 1.820, 95%CI 1.163–2.848) were significant. Eye frailty can be considered a factor reflecting the existence of social and psychological/cognitive frailties.