UER-py
UER-py is a toolkit for pre-training and fine-tuning NLP models on general-domain corpora and downstream tasks. It features a modular architecture supporting models such as BERT and GPT-2, facilitating the extension and utilization of pre-trained models from its model zoo. Achieving high performance in tasks like classification and reading comprehension, UER-py is compatible with CPU and multi-GPU systems, offering comprehensive functions for researchers to explore and optimize advanced models.