We previously showed that facial expressions modulate functional MRI activity in the face-processing regions of the macaque monkey’s amygdala and inferior temporal (IT) cortex. Specifically, we showed that faces expressing emotion yield greater activation than neutral faces; we term this difference the “valence effect.” We hypothesized that amygdala lesions would disrupt the valence effect by eliminating the modulatory feedback from the amygdala to the IT cortex. We compared the valence effects within the IT cortex in monkeys with excitotoxic amygdala lesions (n = 3) with those in intact control animals (n = 3) using contrast agent-based functional MRI at 3 T. Images of four distinct monkey facial expressions—neutral, aggressive (open mouth threat), fearful (fear grin), and appeasing (lip smack)—were presented to the subjects in a blocked design. Our results showed that in monkeys with amygdala lesions the valence effects were strongly disrupted within the IT cortex, whereas face responsivity (neutral faces > scrambled faces) and face selectivity (neutral faces > non-face objects) were unaffected. Furthermore, sparing of the anterior amygdala led to intact valence effects in the anterior IT cortex (which included the anterior face-selective regions), whereas sparing of the posterior amygdala led to intact valence effects in the posterior IT cortex (which included the posterior face-selective regions). Overall, our data demonstrate that the feedback projections from the amygdala to the IT cortex mediate the valence effect found there. Moreover, these modulatory effects are consistent with an anterior-to-posterior gradient of projections, as suggested by classical tracer studies. Significance Successful social interaction depends on the ability to recognize others, evaluate their mental states (e.g. intentions, desires, and beliefs), and “read” their emotional states. Here, we show that, in monkeys, damage to the amygdala, a brain structure that is central to the expression of emotion, significantly disrupts the processing of emotional facial expression in high-level visual cortical areas involved in face recognition. These findings suggest that the projections of the amygdala to visual cortical areas likely enhance the sensory processing of biologically important signals, including those related to potential environmental threats and social contexts.