Explore projects

Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo

Ongoing research training transformer language models at scale, including: BERT & GPT-2