The KERNEL NUMBER PER ROW6 (KNR6)-mediated phosphorylation of an adenosine diphosphate ribosylation factor (Arf) GTPase-activating protein (AGAP) forms a key regulatory module for the numbers of spikelets and kernels in the ear inflorescences of maize (Zea mays L.). However, the action mechanism of the KNR6–AGAP module remains poorly understood. Here, we characterized the AGAP-recruited complex and its roles in maize cellular physiology and agronomically important traits. AGAP and its two interacting Arf GTPase1 (ARF1) members preferentially localized to the Golgi apparatus. The loss-of-function AGAP mutant produced by CRISPR/Cas9 resulted in defective Golgi apparatus with thin and compact cisternae, together with delayed internalization and repressed vesicle agglomeration, leading to defective inflorescences and roots, and dwarfed plants with small leaves. The weak agap mutant was phenotypically similar to knr6, showing short ears with fewer kernels. AGAP interacted with KNR6, and a double mutant produced shorter inflorescence meristems and mature ears than the single agap and knr6 mutants. We hypothesized that the coordinated KNR6–AGAP–ARF1 complex modulates vegetative and reproductive traits by participating in vesicle trafficking in maize. Our findings provide a novel mechanistic insight into the regulation of inflorescence development, and ear length and kernel number, in maize.