In this article, we combine diffuse x-ray scattering with a Monte Carlo simulation method for the determination of the dislocation density in thin heteroepitaxial layers. As a model, we consider GaN epitaxial layers containing threading dislocations perpendicular to the surface. The densities of particular types of threading dislocations following from the comparison of measured and simulated distributions of diffusely scattered x-ray intensity are compared with the dislocation densities determined by etching. A good agreement was found.