The most common peripheral nerve tumors are of a benign nature and include schwannoma or neurofibroma. In rare cases, other tumors or non-tumorous lesions can mimic peripheral nerve tumors clinically or radiologically. Based on data from the multicentric German Peripheral Nerve Tumor Registry (PNTR), which encompasses current information on 315 surgically treated patients from three high-volume centers, we present 61 cases of rare tumors and lesions that mimic tumors associated with peripheral nerves. This cohort displays considerable heterogeneity, featuring a broad spectrum of morphological features and biological potentials. Histopathological diagnoses include various intrinsic peripheral nerve tumors such as malignant peripheral nerve tumors (MPNSTs) (n = 13), perineurioma (n = 17), and hybrid nerve sheath tumors (HPNSTs, comprising schwannoma/perineurioma and schwannoma/neurofibroma) (n = 14), as well as atypical neurofibromatous neoplasm with unknown biological potential (ANNUBP) (n = 1). Additionally, the cohort encompasses extrinsic tumorous lesions like lymphoma (n = 3), lymphangioma (n = 2), hemangioma (n = 2), solitary fibrous tumor (n = 2), metastatic disease (n = 1), and single cases of other rare tumor entities (n = 6). An overview of the underlying pathology, imaging features, and clinical presentation is provided, with a brief description of each entity. A definitive preoperative differentiation between benign peripheral nerve tumors and rare intrinsic and extrinsic tumors is often not possible. Clinical examination and subtle imaging clues can at least indicate the possibility of a rare entity. The basic requirement is close cooperation between radiologists, neurologists, neuropathologists, and neurosurgeons at a specialized center to develop a multidisciplinary concept and offer the patient the best therapeutic approaches.