Background: The basal–bolus insulin regimen is recommended in hospitalized patients with diabetes mellitus (DM), but has an increased risk of hypoglycemia. We aimed to compare dipeptidyl peptidase 4 inhibitors (DPP4-i) and basal–bolus insulin glycemic outcomes in hospitalized type 2 DM patients. Methods and patients: Our prospective randomized study included 102 elderly T2DM patients (82 ± 9 years, HbA1c 6.6% ± 1.9). Glycemic control: A variability coefficient assessed by continuous glucose monitoring (Free Style^® sensor), mean insulin dose and hypoglycemia rates obtained with the two treatments were analyzed. Results: No differences were found between groups in glycemic control (mean daily glycemia during the first 10 days: 152.6 ± 38.5 vs. 154.2 ± 26.3 mg/dL; p = 0.8). The total doses Kg/day were 0.40 vs. 0.20, respectively (p < 0.001). A lower number of hypoglycemic events (9% vs. 15%; p < 0.04) and lower glycemic coefficient of variation (22% vs. 28%; p < 0.0002) were observed in the basal–DPP4-i compared to the basal–bolus regimen group. Conclusions: Treatment of inpatient hyperglycemia with basal insulin plus DPP4-i is an effective and safe regimen in old subjects with T2DM, with a similar mean daily glucose concentration, but lower glycemic variability and fewer hypoglycemic episodes compared to the basal bolus insulin regimen.