Conference Proceedings

Cross-Lingual Word Embeddings for Low-Resource Language Modeling

Trevor Cohn, Steven Bird, Graham Neubig, Oliver Adams, Adam J Makarucha

Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers | Unknown | Published : 2017


Most languages have no established writing system and minimal written records. However, textual data is essential for natural language processing, and particularly important for training language models to support speech recognition. Even in cases where text data is missing, there are some languages for which bilingual lexicons are available, since creating lexicons is a fundamental task of documentary linguistics. We investigate the use of such lexicons to improve language models when textual training data is limited to as few as a thousand sentences. The method involves learning cross-lingual word embeddings as a preliminary step in training monolingual language models. Results across a nu..

View full abstract

Citation metrics