Developing non-destructive methods (NDT) that can deliver faster and more accurate results is an objective pursued by many researchers. The purpose of this paper is to present a new approach in predicting the concrete compressive strength through means of ultrasonic testing for non-destructive determination of the dynamic and static modulus of elasticity. For this study, the dynamic Poisson’s coefficient was assigned values provided by technical literature. Using ultra-sonic pulse velocity (UPV) the apparent density and the dynamic modulus of elasticity were determined. The viability of the theoretical approach proposed by Salman, used for the air-dry density determination (predicted density), was experimentally confirmed (measured density). The calculated accuracy of the Salman method ranged between 98 and 99% for all the four groups of specimens used in the study. Furthermore, the static modulus of elasticity was deducted through a linear relationship between the two moduli of elasticity. Finally, the concrete compressive strength was mathematically determined by using the previously mentioned parameters. The accuracy of the proposed method for concrete compressive strength assessment ranged between 92 and 94%. The precision was established with respect to the destructive testing of concrete cores. For this research, the experimental part was performed on concrete cores extracted from different elements of different structures and divided into four distinct groups. The high rate of accuracy in predicting the concrete compressive strength, provided by this study, exceeds 90% with respect to the reference, and makes this method suitable for further investigations related to both the optimization of the procedure and = the domain of applicability (in terms of structural aspects and concrete mix design, environmental conditions, etc.).