With the advancement of high-quality urban development, the assessment of urban visual quality (VQ) based on public perception is of great significance for enhancing the liveability of coastal cities. However, there is still a lack of systematic quantitative analysis regarding the complex nonlinear relationship between visual quality and the built environment. This study takes Shinan District, Qingdao, as a case study to construct a data-driven visual quality assessment framework. By collecting a large-scale dataset of street-view images and using semantic segmentation techniques. This study extracts five physical features—walkability, openness, greenness, enclosure, and the visual building density—to represent key streetscape dimensions related to spatial openness, naturalness, walking experience, and building interface intensity. It shows that the visual quality of Shinan District presents obvious spatial heterogeneity. Areas with relatively high visual quality are mainly concentrated in newly developed urban districts and coastal areas, while areas with lower visual quality are mostly distributed in old urban districts and inland areas. Newly developed urban areas have higher sky openness and continuous green interfaces, thereby bringing a good visual experience. The lower visual quality of old urban districts and some inland streets is more related to the superposition of factors such as a high proportion of visible buildings, excessive spatial enclosure, disordered street interfaces, and insufficient greenness. The further finds that the nonlinear relationship between sky openness and enclosure indicates that street visual quality does not depend on simply increasing open space, but on the coordination between visual permeability and interface order: excessive openness weakens the sense of street boundary, while excessive enclosure strengthens the sense of oppression, both of which reduce the quality of visual perception. Greenness, the building visibility index, and walkability also show obvious model-estimated turning points: after greenness exceeds approximately 0.14, continuous green interfaces begin to improve visual quality more stably; the building visibility index within the range of approximately 0–0.28 helps form street structure and visual order, but when it exceeds approximately 0.28, it may shift toward visual pressure; after walkability exceeds approximately 0.2, its effect on visual quality changes from negative to positive. This study not only quantifies the spatial variation in visual quality but, more importantly, reveals the underlying mechanisms of key environmental factors, providing a scientific basis for refined urban design interventions and the optimization of coastal spaces.