The implementation of energy retrofit of residential buildings faces many risks around the world, especially in China, leading to low retrofit progress. Stakeholders’ proactive risk management is the key to the smooth implementation of retrofit projects but is normally affected by risk perception. Perceived risks instead of real risks are the motivators of their proactive behaviours. This paper aims to understand and address the present risk perception of stakeholders in order to drive effective proactive risk mitigation practices. Based on a risk list identified through a literature review and interviews, a questionnaire survey was then made to analyse and compare different stakeholders’ perceptions of each risk by measuring the levels of their concern about risks. It is validated that all the stakeholder groups tend to mitigate risks perceived highly proactively. Proactive risk management of risk-source-related stakeholders deserves more attention and responsibility-sharing with transaction costs (TCs) considerations contribute to the enhancement of risk perception. More responsibilities of construction quality and maintenance is taken by the government and contractors should be clarified, and the government should also be responsible for assisting design work. Effective information is beneficial to the decrease in homeowners’ risk perception that can motivate their initiative of cooperation.