Tomato is an important vegetable in the United States and around the world. Recently, tomato brown rugose fruit virus (ToBRFV), an emerging tobamovirus, has impacted tomato crops worldwide and can result in fruit loss. ToBRFV causes severe symptoms, such as mosaic, puckering, and necrotic lesions on leaves; other symptoms include brown rugose and marbling on fruits. More importantly, ToBRFV can overcome resistance in tomato cultivars carrying the Tm-2² locus. In this study, we recovered ToBRFV sequences from tomato seeds, leaves, and fruits from the U.S., Mexico, and Peru. Samples were pre-screened using a real-time RT-PCR assay prior to high-throughput sequencing. Virus draft genomes from 22 samples were assembled and analyzed against more than 120 publicly available genomes. Overall, most sequenced isolates were similar to each other and did not form a distinct population. Phylogenetic analysis revealed three clades within the ToBRFV population. Most of the isolates (95%) clustered in clade 3. Genetic analysis revealed differentiation between the three clades indicating minor divergence occurring. Overall, pairwise identity showed limited genetic diversity among the isolates in this study with worldwide isolates, with a pairwise identity ranging from 99.36% and 99.97%. The overall population is undergoing high gene flow and population expansion with strong negative selection pressure at all ToBRFV genes. Based on the results of this study, it is likely that the limited ToBRFV diversity is associated with the rapid movement and eradication of ToBRFV-infected material between countries.