The operation of smart buildings (with solar, storage and suitable power routing infrastructure) can be optimized with the addition of parking stations for electric vehicles (EVs) with vehicle-to-everything (V2X) operations including vehicle-to-vehicle (V2V), vehicle-to-building (V2B) and vehicle-to-grid (V2G) operations. In this paper, a multi-objective optimization framework is proposed for the smart charging and discharging of EVs along with the maximization of revenue and savings of smart building (prosumers with solar power, a battery storage system and a parking station) and non-primary/ordinary buildings (consumers of electricity without solar power, a battery storage system and parking station). A mixed-integer linear program is developed to maximize the profits of smart buildings that have bilateral contracts with non-primary buildings. The optimized charging and discharging (V2X) of EVs at affordable rates utilizing solar power and a battery storage system in the smart building helps to manage the EV load during on-peak hours and prevent utility congestion. The results indicate that in addition to the 4–9% daily electricity cost reductions for non-primary buildings, a smart building can achieve up to 60% of the daily profits. Further, EVs can save 50–69% in charging costs while performing V2X operations.