Wals Roberta Sets -

: Whether a language has case marking and how many cases it uses.

WALS RoBERTa sets are curated variants of the RoBERTa family of pre-trained Transformer language models adapted for the WALS (World Atlas of Language Structures) or for tasks/datasets that use WALS-style typological features. They typically combine RoBERTa’s strong contextual embeddings with structured typological signals or evaluation setups focused on linguistic features across languages. wals roberta sets