The Shinkansen super-express railway system in Japan has greatly increased its capacity and has expanded nationwide. However, many inhabitants in areas along the railways have been disturbed by noise and ground vibration from the trains. Additionally, the Shinkansen railway emits a higher level of ground vibration than conventional railways at the same noise level. These findings imply that building vibrations affect living environments as significantly as the associated noise. Therefore, it is imperative to quantify the effects of noise and vibration exposures on each annoyance under simultaneous exposure. We performed a secondary analysis using individual datasets of exposure and community response associated with Shinkansen railway noise and vibration. The data consisted of six socio-acoustic surveys, which were conducted separately over the last 20 years in Japan. Applying a logistic regression analysis to the datasets, we confirmed the combined effects of vibration/noise exposure on noise/vibration annoyance. Moreover, we proposed a representative relationship between noise and vibration exposures, and the prevalence of each annoyance associated with the Shinkansen railway.