As part of a successful IoV implementation, testing of IoV-based systems is essential for detecting errors related to device availability, communication reliability, quality of service, and system security. However, this remains a challenge due to the dynamic nature of IoV susceptibility to failures, heterogeneity, and large data streams associated with remotely distributed IoV system components. This paper proposes an intelligent agent-based architecture with a special focus on semantic interoperability testing in order to ensure better interaction and coherence between the various components of the IoV-based system. As a proof of concept, the proposed architecture is implemented in the NetLogo (v6.4.0) multi-agent environment and applied to a case study that detects semantic interoperability issues at both the data and query levels.