Antiretroviral therapy (ART) effectively controls HIV infection, suppressing HIV viral loads. However, some residual virus remains, below the level of detection, in HIV-infected patients on ART. The source of this viremia is an area of debate: does it derive primarily from activation of infected cells in the latent reservoir, or from ongoing viral replication? Observations seem to be contradictory: there is evidence of short term evolution, implying that there must be ongoing viral replication, and viral strains should thus evolve. However, phylogenetic analyses, and rare emergent drug resistance, suggest no long-term viral evolution, implying that virus derived from activated latent cells must dominate. We use simple deterministic and stochastic models to gain insight into residual viremia dynamics in HIV-infected patients. Our modeling relies on two underlying assumptions for patients on suppressive ART: that latent cell activation drives viral dynamics and that the reproductive ratio of treated infection is less than 1. Nonetheless, the contribution of viral replication to residual viremia in patients on ART may be non-negligible. However, even if the portion of viremia attributable to viral replication is significant, our model predicts (1) that latent reservoir re-seeding remains negligible, and (2) some short-term viral evolution is permitted, but long-term evolution can still be limited: stochastic analysis of our model shows that de novo emergence of drug resistance is rare. Thus, our simple models reconcile the seemingly contradictory observations on residual viremia and, with relatively few parameters, recapitulates HIV viral dynamics observed in patients on suppressive therapy. In HIV+ individuals, antiretroviral therapy (ART) effectively controls HIV viral loads to below levels detectable by routine tests. However, more sensitive tests can detect some residual viremia. The source of this virus is a matter of debate: does it derive from ongoing viral replication, or from viral production following activation of latently infected cells? Experimental observations support both sides of the argument: in patients on therapy, HIV shows no long-term evolution, and emergence of drug-resistant mutants is rare, implying no ongoing viral replication, but there remains short-term evolution, implying the opposite. To reconcile these observations, we propose a mathematical model of latently and productively infected cells and virus. Using our models we predict that, in patients on suppressive ART, the contribution of viral replication to residual virus, while small, yields short term-evolution. But even if the contribution is large, for example if adherence to therapy is poor, long-term evolution can still be limited, and de novo emergence of drug resistance is rare. Thus, our simple models reconcile the seemingly contradictory observations on residual viremia.