With the development of sensor technology and computer vision, the speed of video generation is increasing exponentially. The workload of video browsing and the amount of stored data are increasing. In order to achieve fast browsing and efficient storage, video structure technology is increasingly important. This paper focuses on the video structure technology in the construction of smart cities, outlines the system process of video structure, and studies the extraction algorithm of human and vehicle target attributes based on deep learning. And combined with the actual video monitoring scene, the experiment is carried out. Compared with traditional image processing methods, the video structure target attribute extraction model based on deep learning has high detection accuracy and strong algorithm generalization ability. The intelligent analysis and processing of data by video structure technology is conducive to quickly increasing the speed of target search, reducing storage capacity, solving the problem of long-term storage, and realizing full automation of surveillance video.