The incidence of colorectal cancer (CRC) is increasing in the population aged ≤ 49 (early-onset CRC-EOCRC). Recent studies highlighted the biological and clinical differences between EOCRC and late-onset CRC (LOCRC-age ≥ 50), while comparative results about long-term survival are still debated. This study aimed to investigate whether age of onset may impact on oncologic outcomes in a surgical population of sporadic CRC patients. Patients operated on for sporadic CRC from January 2010 to January 2022 were allocated to the EOCRC and LOCRC groups. The primary endpoint was the recurrence/progression-free survival (R/PFS). A total of 423 EOCRC and 1650 LOCRC was included. EOCRC had a worse R/PFS (p < 0.0001) and cancer specific survival (p < 0.0001) compared with LOCRC. At Cox regression analysis, age of onset, tumoral stage, signet ring cells, extramural/lymphovascular/perineural veins invasion, and neoadjuvant therapy were independent risk factors for R/P. The analysis by tumoral stage showed an increased incidence of recurrence in stage I EOCRC (p = 0.014), and early age of onset was an independent predictor for recurrence (p = 0.035). Early age of onset was an independent predictor for worse prognosis, this effect was stronger in stage I patients suggesting a potentially—and still unknown—more aggressive tumoral phenotype in EOCRC.