Although significant advances have been made in recent years, the structural elucidation of small molecules continues to remain a challenging issue for metabolite profiling. Many metabolomic studies feature unknown compounds; sometimes even in the list of features identified as “statistically significant” in the study. Such metabolic “dark matter” means that much of the potential information collected by metabolomics studies is lost. Accurate structure elucidation allows researchers to identify these compounds. This in turn, facilitates downstream metabolite pathway analysis, and a better understanding of the underlying biology of the system under investigation. This review covers a range of methods for the structural elucidation of individual compounds, including those based on gas and liquid chromatography hyphenated to mass spectrometry, single and multi-dimensional nuclear magnetic resonance spectroscopy, and high-resolution mass spectrometry and includes discussion of data standardization. Future perspectives in structure elucidation are also discussed; with a focus on the potential development of instruments and techniques, in both nuclear magnetic resonance spectroscopy and mass spectrometry that, may help solve some of the current issues that are hampering the complete identification of metabolite structure and function.