Green infrastructure (GI) plays a fundamental role in achieving urban pluvial flood management, mitigating urban heat island effect, and improving living suitability. Residents’ participation is the main driving force of GI implementation. Based on semi-structured interviews, GIS spatial analysis, and multiple regression, we investigated residents’ willingness to participate in the implementation of GI in public and private space and identified the influence factors in Shanghai, China. The results show that, compared with private space, residents prefer to implement GI in public space, where they have different preferences of GI measures. On urban scale, residents’ willingness to participate in the implementation of GI in private space is characterized as “high in the inner city, low in the suburban areas”, while the spatial difference is insignificant for public space. In addition, the factors affecting residents’ willingness to participate in the implementation of GI are different in private and public space. The deterministic factors of GI participation are gender, education level, and floor for private space, while only include building age for public space, in addition to the common factors of free time, cognition of GI, perception of pluvial flood risk, supportive factors, and environment-improving factors that can influence both private and public space GI participation. Our analysis therefore provides valuable information for policymakers concerning nature-based solutions to climate change adaptation and urban sustainability.