Event detection and classification in sports is particularly important in the field of sports data analytics. In this era, various AI methods are utilized to detect events in a football (soccer) game. The use of advanced computational techniques in this area can help to achieve higher accuracy in detecting events. This paper proposes a novel architecture to classify events in a football game. The dataset which is used consists of numerous images pertaining to different events in a regular football match. From this dataset the objective is to detect specific and semantically meaningful events such as pass, dribble or shoot, etc. The proposed model consists of a convolutional autoencoder coupled with a Multi-Layer Extreme Learning Machine to classify the given images into defined events. The Convolutional Autoencoder (AE) module is placed before the ELM in the model pipeline as it helps with data compression and dimensionality reduction so as to ensure fast computation. Thereby, a Multi-Layer Extreme Learning machine achieves better performance compared to other existing approaches.