In this paper, we present a word embedding dataset NWJC2Vec constructed using ‘NINJAL Web Japanese Corpus (NWJC)’. NWJC is a Web-crawled text corpus that contains 25.8 billion tokens. We construct two types of the word embedding dataset: one is based on the surface form, and the other is based on the complete morpheme information provided by UniDic, which is a lexicon for the Japanese morphological analyser MeCab. We perform an evaluation of the dataset by comparing it with the ‘Word List by Semantic Principles (Bunrui Goihyo)’.
Hiroaki Ozaki, Kanako Komiya, Masayuki Asahara, Toshinobu Ogiso. Proceedings of the 1st Workshop on Machine Learning for Ancient Languages (ML4AL 2024). 2024.
28 December 2025 in Journal of Quantitative Linguistics