Zika virus (ZIKV) and Japanese encephalitis virus (JEV) can cause permanent neurological damage and death, yet no approved drugs exist for these infections. Rhodiola crenulate, an herb used in traditional Chinese medicine for its antioxidation and antifatigue properties, was studied for its antiviral activity against ZIKV and JEV in vitro. The cytotoxicity of Rhodiola crenulata extract (RCE) was evaluated using the CCK-8 reagent. Antiviral effects of RCE were assessed in ZIKV-infected or JEV-infected Vero cells via quantitative reverse transcription polymerase chain reaction (qRT-PCR), Western blotting, fluorescent focus assay (FFA), and immunofluorescence assay (IFA). The cell-free antiviral effects of RCE were evaluated using an inactivation assay. To determine the stage of the viral life cycle affected by RCE, time-of-addition, binding, and entry assays were conducted. Three bioactive constituents of RCE (salidroside, tyrosol, and gallic acid) were tested for antiviral activity. RCE exhibited dose-dependent anti-ZIKV and anti-JEV activities at non-cytotoxic concentrations, which were likely achieved by disrupting viral binding and stability. Gallic acid exhibited antiviral activity against ZIKV and JEV. Our findings indicate that RCE disrupts viral binding and stability, presenting a potential strategy to treat ZIKV and JEV infections.