Current research often neglects the spatial and temporal dynamics of relative sea level rise (RSLR) when assessing its impact on compound flood hazards in urban coastal areas. To address this issue, we develop a framework combining statistical and hydrodynamic overland inundation modeling to assess the combined effect of compound flooding and RSLR on urban functional areas in terms of flood hazard and exposure. This framework uses maximum flood depth (MFD), maximum flood area, and maximum flood volume (MFV) as metrics for flood hazard assessment, and absolute flood exposure and relative flood exposure (RFE) metrics for evaluating flood exposure in urban areas. In a case study focused on Haikou, Hainan Province, we analyze data from 66 TC events from 1960 to 2017 to determine the univariate distribution and bivariate dependency structure of storm tides and rainfall using extreme value distributions and copula functions. We then employ an overland inundation model to simulate compound flooding for various bivariate return periods (RPs) under RSLR. Our findings indicate that flood hazards assessed using univariate RPs are more severe than those derived from bivariate RPs, with the univariate MFV being 90.5% higher for the 200-year RP. RSLR significantly amplifies the compound flood effects in major inundation areas, such as Haidian Island and Jiangdong NewArea. Specifically, for the 100-year RP, the MFD in these regions is projected to increase by 1.5 m by 2100 due to RSLR. Additionally, residential land is identified as the most vulnerable to RSLR, with its RFE reaching 19.8% by 2100, which is 6.3% higher compared to scenarios without considering RSLR. These results show the necessity of incorporating RSLR into compound flood hazard assessment to formulate flood mitigation and management measures in coastal cities.