The construction of a microscope with fast sample transfer system for single-molecule spectroscopy and microscopy at low temperatures using 2D/3D sample-scanning is reported. The presented construction enables the insertion of a sample from the outside (room temperature) into the cooled (4.2 K) cryostat within seconds. We describe the mechanical and optical design and present data from individual Photosystem I complexes. With the described setup numerous samples can be investigated within one cooling cycle. It opens the possibility to investigate biological samples (i) without artifacts introduced by prolonged cooling procedures and (ii) samples that require preparation steps like plunge-freezing or specific illumination procedures prior to the insertion into the cryostat.