This research proposes a novel topology optimization method using neural style transfer to simultaneously optimize both structural performance for a given loading condition and geometric similarity for a reference design. For the neural style transfer, the convolutional layers of a pre-trained neural network extract and quantify characteristic features from the reference and input designs for optimization. The optimization analysis is evaluated as a single weighted objective function with the ability for the user to control the influence of the neural style transfer with the structural performance. As seen in architecture and consumer-facing products, the visual appeal of a design contributes to its overall value along with mechanical performance metrics. Using this method, a designer allows the tool to find the ideal compromise of these metrics. Three case studies are included to demonstrate the capabilities of this method with various loading conditions and reference designs. The structural performances of the novel designs are within 10% of the baseline without geometric reference, and the designs incorporate features in the given reference such as member size or meshed features. The performance of the proposed optimizer is compared against other optimizers without the geometric similarity constraint.