The emergence of large language models (LLMs) has marked a significant breakthrough in natural language processing (NLP), fueling a paradigm shift in information acquisition. Nevertheless, LLMs are prone to hallucination, generating plausible yet nonfactual content. This phenomenon raises significant concerns over the reliability of LLMs in real-world information retrieval (IR) systems and has attracted intensive research to detect and mitigate such hallucinations. Given the open-ended general-purpose attributes inherent to LLMs, LLM hallucinations present distinct challenges that diverge from prior task-specific models. This divergence highlights the urgency for a nuanced understanding and comprehensive overview of recent advances in LLM hallucinations. In this survey, we begin with an innovative taxonomy of hallucination in the era of LLM and then delve into the factors contributing to hallucinations. Subsequently, we present a thorough overview of hallucination detection methods and benchmarks. Our discussion then transfers to representative methodologies for mitigating LLM hallucinations. Additionally, we delve into the current limitations faced by retrieval-augmented LLMs in combating hallucinations, offering insights for developing more robust IR systems. Finally, we highlight the promising research directions on LLM hallucinations, including hallucination in large vision-language models and understanding of knowledge boundaries in LLM hallucinations.
Libo Qin, Wanxiang Che, Yangming Li, Haoyang Wen, Ting Liu. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). 2019.
Yiming Cui, Ting Liu, Wanxiang Che, Li Xiao, Zhipeng Chen, Wentao Ma, Shijin Wang, Guoping Hu. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). 2019.
Active Millimeter Wave (AMMW) imaging technique has been widely applied in the security industries due to its under-controlled privacy concerns and no health hazards. In fact, how to automatically and precisely detect the concealed objects on the human body in the AMMW images is one key issue in industrial security scanner systems. In this paper, we first investigate the deep learning based object detection approaches for the AMMW images, and then we develop a concealed object detection system for the security system in the airport. For our particular application, the concealed objects include several small items. However, most of the current deep learning based methods focus mainly on detecting large objects resulting in the unsatisfactory performance on small objects. To address this issue, we first skip the down-sampling of the last pooling layer and apply the dilated convolution for the following convolutional layers. Then, we propose a context embedding object detection network. Besides, we build a new large-scale dataset to benchmark the concealed object detection tasks in the AMMW images, which includes more than 58k AMMW images. With the proposed algorithm, we finally achieve 90.05% in detection rate and 9.73% in false alarm rate in our dataset.