In the French Territories in the Americas (FTA), the risk of birth defects possibly associated with Zika virus (ZIKV) infection was 7.0% (95%CI: 5.0 to 9.5) among foetuses/infants of 546 women with symptomatic RT-PCR confirmed ZIKV infection during pregnancy. Many of these defects were isolated measurement-based microcephaly (i.e. without any detected brain or clinical abnormalities) or mild neurological conditions. We wanted to estimate the proportion of such minor findings among live births of women who were pregnant in the same region during the outbreak period but who were not infected with ZIKV. In Guadeloupe, pregnant women were recruited at the time of delivery and tested for ZIKV infection. The outcomes of live born infants of ZIKV non-infected women were compared to those of ZIKV-exposed live born infants in Guadeloupe, extracted from the FTA prospective cohort. Of 490 live born infants without exposure to ZIKV, 42 infants (8.6%, 95%CI: 6.2–11.4) had mild abnormalities that have been described as ‘potentially linked to ZIKV infection’; all but one of these was isolated measurement-based microcephaly. Among the 241 live born infants with ZIKV exposure, the proportion of such abnormalities, using the same definition, was similar (6.6%, 95%CI: 3.8–10.6). Isolated anthropometric abnormalities and mild neurological conditions were as prevalent among infants with and without in-utero ZIKV exposure. If such abnormalities had not been considered as ‘potentially linked to ZIKV’ in the original prospective cohort in Guadeloupe, the overall estimate of the risk of birth defects considered due to the virus would have been significantly lower, at approximately 1.6% (95% CI: 0.4–4.1). ClinicalTrials.gov (NCT02916732) Microcephaly defined using growth charts occurs naturally in some healthy infants. Nonetheless, in many recent Zika virus studies, such measurement-based microcephaly and other common mild abnormalities have been automatically attributed to viral exposure during pregnancy. For example, in 2016 in Guadeloupe, we did a cohort study and estimated that the risk of Zika virus related birth defects was 7%. However, most of the ‘abnormal’ live born infants that contributed to this risk estimate were considered healthy by pediatricians, but were found to have measurement-based microcephaly during data analysis. In the current study, we did a cross-sectional evaluation of infants live born in 2016 in Guadeloupe, but whose mothers were not infected with Zika virus during pregnancy. We found that Zika virus unexposed live born infants had similar proportions of measurement-based microcephaly and mild neurological abnormalities as exposed live born infants. If only severe and uncommon birth defects were considered linked to Zika virus in our original cohort study, our risk estimate would have been significantly lower. This research shows that it is important to consider baseline risks and control comparisons when establishing key parameters for emerging diseases, such as Zika virus.