(1) Background: The aim of this study was to investigate and compare the effect of sensorimotor training on transversus abdominis activation. (2) Methods: Seventy-five patients with chronic low back pain were randomly assigned to one of three groups (whole body vibration training using Galileo^®, coordination training using Posturomed^®, or physiotherapy (control)). Transversus abdominis activation was measured by using sonography pre- and post-intervention. Second, changes in clinical function tests and their correlation with the sonographic measurements were determined. (3) Results: All three groups showed an improvement in activation of the transversus abdominis post-intervention, with the Galileo^® demonstrating the largest improvement. There were no relevant (r > 0.5) correlations between activation of the transversus abdominis muscle and any clinical tests. (4) Conclusions: The present study provides evidence that sensorimotor training on the Galileo^® significantly improves the activation of the transversus abdominis muscle.