Natural carboxylic acids are plant-derived compounds that are known to possess biological activity. The aim of this review was to compare the effect of structural differences of the selected carboxylic acids (benzoic acid (BA), cinnamic acid (CinA), p-coumaric acid (p-CA), caffeic acid (CFA), rosmarinic acid (RA), and chicoric acid (ChA)) on the antioxidant, antimicrobial, and cytotoxic activity. The studied compounds were arranged in a logic sequence of increasing number of hydroxyl groups and conjugated bonds in order to investigate the correlations between the structure and bioactivity. A review of the literature revealed that RA exhibited the highest antioxidant activity and this property decreased in the following order: RA > CFA ~ ChA > p-CA > CinA > BA. In the case of antimicrobial properties, structure-activity relationships were not easy to observe as they depended on the microbial strain and the experimental conditions. The highest antimicrobial activity was found for CFA and CinA, while the lowest for RA. Taking into account anti-cancer properties of studied NCA, it seems that the presence of hydroxyl groups had an influence on intermolecular interactions and the cytotoxic potential of the molecules, whereas the carboxyl group participated in the chelation of endogenous transition metal ions.