Whole-body vibration (WBV) is a novel exercise training measure that promotes the muscle strength, flexibility, and balance abilities of elderly groups. The feasibility and applicability of 20–30 min (lowering a heat pack at 73 °C by wrapping it in multiple layers of towels to 40–43 °C before it touched the skin) thermotherapy are increasingly being demonstrated by applications and clinical trials. Studies show that it increases the flexibility of macules and ligament. However, no studies have examined the interactions between the pre-exercise and post-exercise application of heat therapy (duration a training course). Therefore, this study investigates the effects of WBV and heat therapy on the muscle strength, flexibility, and balance abilities of elderly groups. Eighty middle-age and elderly participants with no regular exercise habits were enrolled in this study. They were randomly assigned to a WBV group, a WBV plus heat therapy group, a heat therapy alone group, and a control group. The WBV groups underwent 5-min, fixed-amplitude (4 mm), thrice-weekly WBV training sessions for 3 consecutive months on a WBV training machine. Participants’ balance was measured using the limits of stability (LOS) test on a balance system. The pretest and posttest knee extensor and flexor strength were tested using an isokinetic lower extremity dynamometer. Pretest and posttest flexibility changes were measured using the sit-and-reach test. Significantly larger pretest and posttest differences in flexibility and muscle strength were observed in the WBV and WBV plus heat therapy groups. The addition of heat therapy to WBV resulted in the largest flexibility improvements.