Water-dispersible MgO nanoparticles were tested to investigate their cytotoxic effects on oxidative stress gene expression. In this in vitro study, genes related to reactive oxygen species (ROS), glutathione S-transferase (GST) and catalase, were quantified using real-time polymerase chain reactions (molecular level) and molecular beacon technologies (cellular level). The monodispersed MgO nanoparticles, 20 nm in size, were used to treat human cancer cell lines (liver cancer epithelial cells) at different concentrations (25, 75 and 150 µg/mL) and incubation times (24, 48 and 72 h). Both the genetic and cellular cytotoxic screening methods produced consistent results, showing that GST and catalase ROS gene expression was maximized at 150 µg/mL nanoparticle treatment with 48 h incubation. However, the genotoxic effect of MgO nanoparticles was not significant compared with control experiments, which indicates its significant potential applications in nanomedicine as a diagnostic and therapeutic tool.