Facebook Open-Sources RoBERTa: an Improved Natural Language Processing Model

Facebook AI open-sourced a new deep-learning natural-language processing (NLP) model, Robustly-optimized BERT approach (RoBERTa). Based on Google's BERT pre-training model, RoBERTa includes additional pre-training improvements that achieve state-of-the-art results on several benchmarks, using only unlabeled text from the world-wide web, with minimal fine-tuning and no data augmentation.

24 Sep 2019 ... Facebook AI open-sourced a new deep-learning natural-language processing ( NLP) model, Robustly-optimized BERT approach (RoBERTa).

อ่านต่อ