We review the surface stability and growth kinetics of III-V and III-nitride semiconductors. The theoretical approach used in these studies is based on ab initio calculations and includes gas-phase free energy. With this method, we can investigate the influence of growth conditions, such as partial pressure and temperature, on the surface stability and growth kinetics. First, we examine the feasibility of this approach by comparing calculated surface phase diagrams of GaAs(001) with experimental results. In addition, the Ga diffusion length on GaAs(001) during molecular beam epitaxy is discussed. Next, this approach is systematically applied to the reconstruction, adsorption and incorporation on various nitride semiconductor surfaces. The calculated results for nitride semiconductor surface reconstructions with polar, nonpolar, and semipolar orientations suggest that adlayer reconstructions generally appear on the polar and the semipolar surfaces. However, the stable ideal surface without adsorption is found on the nonpolar surfaces because the ideal surface satisfies the electron counting rule. Finally, the stability of hydrogen and the incorporation mechanisms of Mg and C during metalorganic vapor phase epitaxy are discussed.