The space environment consists of various complex phenomena, which could have a strong influence on the spacecraft operation in different aspects. Since the very beginning of space exploration, numerous studies have been done on the space environment. However, most of the existing literature focuses on the investigation of the details of environmental phenomena, while the space environment has rarely been discussed from the perspective of orbits types. Therefore, a comprehensive review on analyzing and comparing the environmental characteristics among diverse orbits in space is of great significance. In this paper, the main components of the space environment are introduced, including the neutral atmosphere, the plasma environment, the radiation environment, the macroscopic particle environment, the geomagnetic field, the temperature field, and the solar activities. The relations of the various space environmental components are also discussed. The dominant environmental components and their effects on spacecraft in different orbits, i.e., the geosynchronous orbit (GEO), the low earth orbit (LEO), the medium earth orbit (MEO), and the high earth orbit (HEO), are investigated, respectively. The space environment that should be taken into particular consideration is summed up to facilitate the design of the spacecraft in a specific orbit.