Semantic face editing of real-world facial images is an important application of generative models. Recently, several works have explored possible techniques to generate such modifications by utilizing the latent structure of pre-trained GAN models. However, such approaches frequently necessitate the training of an encoder network, which is a time-consuming and resource-intensive procedure. StyleALAE [17], a latent-space based autoencoder that can generate photorealistic images of high quality, could be a viable alternative to a GAN-based architecture. Unfortunately, the reconstructed image in StyleALAE does not preserve the identity of the input facial image. This limits the application of StyleALAE for semantic face editing of images. In our work, we propose a one-shot learning approach to address this problem in StyleALAE. Our work ensures that the identity of the reconstructed image in StyleALAE is the same as the given input image. We also present ways to efficiently use the latent space of the pre-trained model to create semantic modification over the reconstructed image within the proposed one-shot learning approach. Results shows that our approach can generate semantic modifications on any real-world facial image while preserving identity.