Numerical methods, such as finite element or finite difference, have been widely used in the past decades for modeling solid mechanics problems by solving partial differential equations (PDEs). Differently from the traditional computational paradigm employed in numerical methods, physics-informed deep learning approximates the physics domains using a neural network and embeds physics laws to regularize the network. In this work, a physics-informed neural network (PINN) is extended for application to linear elasticity problems that arise in modeling non-uniform deformation for a typical open-holed plate specimen. The main focus will be on investigating the performance of a conventional PINN approach to modeling non-uniform deformation with high stress concentration in relation to solid mechanics involving forward and inverse problems. Compared to the conventional finite element method, our results show the promise of using PINN in modeling the non-uniform deformation of materials with the occurrence of both forward and inverse problems.