Image synthesis is a novel solution in precision medicine for scenarios where important medical imaging is not otherwise available. Convolutional neural network is an ideal model for this task because of its powerful learning capabilities through the large number of layers and trainable parameters. In this research, we propose a new architecture of Residual Inception Encoder-Decoder Neural Network (RIED-Net) to learn the nonlinear mapping between the input images and targeting output images. To evaluate the validity of the proposed approach, it is compared with 2 models from the literature: sCT-DCNN and Shallow CNN, using both an institutional mammogram dataset from Mayo Clinic Arizona and a public neuroimaging dataset from the Alzheimer's Disease Neuroimaging Initiative (ADNI). Experimental results show that the proposed RIED-Net outperforms the two models on both datasets significantly in terms of structural similarity index (SSIM), mean absolute percent error (MAPE), and peak signal to noise ratio (PSNR).