Electric vehicles (EVs) are envisaged to be the future transportation medium, and demonstrate energy efficiency levels much higher than conventional gasoline or diesel-based vehicles. However, the sustainability of EVs is only justified if the electricity used to charge these EVs is availed from a sustainable source of energy and not from any fossil fuel or carbon generating source. In this paper, the challenges of the EV charging stations are discussed while highlighting the growing use of distributed generators in the modern electrical grid system. The benefits of the adoption of photovoltaic (PV) sources along with battery storage devices are studied. A multiport converter is proposed for integrating the PV, charging docks, and energy storage device (ESD) with the grid system. In order to control the bidirectional flow between the generating sources and the loads, an intelligent energy management system is proposed by adapting particle swarm optimization for efficient switching between the sources. The proposed system is simulated using MATLAB/Simulink environment, and the results depicted fast switching between the sources and less switching time without obstructing the fast charging to the EVs.