Several solid lesions can be found within the pancreas mainly arising from the exocrine and endocrine pancreatic tissue. Among all pancreatic malignancies, the most common subtype is pancreatic ductal adenocarcinoma (PDAC), to a point that pancreatic cancer and PDAC are used interchangeably. But, in addition to PDAC, and to the other most common and well-known solid lesions, either related to benign conditions, such as pancreatitis, or not so benign, such as pancreatic neuroendocrine neoplasms (pNENs), there are solid pancreatic lesions considered rare due to their low incidence. These lesions may originate from a cell line with a differentiation other than exocrine/endocrine, such as from the nerve sheath as for pancreatic schwannoma or from mesenchymal cells as for solitary fibrous tumour. These rare solid pancreatic lesions may show a behaviour that ranges in a benign to highly aggressive malignant spectrum. This review includes cases of an intrapancreatic accessory spleen, pancreatic tuberculosis, solid serous cystadenoma, solid pseudopapillary tumour, pancreatic schwannoma, purely intraductal neuroendocrine tumour, pancreatic fibrous solitary tumour, acinar cell carcinoma, undifferentiated carcinoma with osteoclastic-like giant cells, adenosquamous carcinoma, colloid carcinoma of the pancreas, primary leiomyosarcoma of the pancreas, primary and secondary pancreatic lymphoma and metastases within the pancreas. Therefore, it is important to determine the correct diagnosis to ensure optimal patient management. Because of their rarity, their existence is less well known and, when depicted, in most cases incidentally, the correct diagnosis remains challenging. However, there are some typical imaging features present on cross-sectional imaging modalities that, taken into account with the clinical and biological context, contribute substantially to achieve the correct diagnosis.