Non operative management of complete clinical responders after neoadjuvant treatment for rectal cancer enjoys an increasing popularity because of the increased functional outcome results. Even a near complete response can evolve in a cCR, and therefore further delaying response assessment is accepted. However, up to 40% of patients will develop a regrowth and will eventually require delayed surgery. It is presently unknown if and to what extent quality of life of these patients is affected, compared to patients who undergo immediate surgery. Between January 2015-May 2020, 200 patients were treated with neoadjuvant therapy of whom 94 received TME surgery. Fifty-one (59%) of 87 alive patients returned the questionnaires: 33 patients who underwent immediate and 18 patients who underwent delayed surgery. Quality of life was measured through the QLQ-C30, QLQ-CR29, and Cancer Worry Scale questionnaires. Regret to participate in repeated response assessment protocol was assessed through the Decision Regret Scale. Exploratory factor analysis (EFA) and a ‘known groups comparison’ was performed to assess QLQ questionnaires validity in this sample. Higher mean physical function scores (89.2 vs. 77.6, p = 0.03) were observed in the immediate surgery group, which lost significance after correction for operation type (p = 0.25). Arousal for men was higher in the delayed surgery group (20.0 vs. 57.1, p = 0.02). There were no differences between surgical groups for the other questionnaire items. Worry for cancer was lower in the delayed surgery group (10.8 vs. 14.0, p = 0.21). Regret was very low (12–16%). EFA reproduced most QLQ C-30 and CR29 subscales with good internal consistency. Quality of life is not impaired in patients undergoing delayed TME surgery after neoadjuvant treatment for rectal cancer. Moreover, there is very low regret and no increase in worry for cancer. Therefore, from a quality of life perspective, this study supports a repeated response assessment strategy after CRTx for rectal carcinoma to identify all complete responders.