Organization overview
What EleutherAI does
EleutherAI is an open research organization that develops and releases open-weight large language models, datasets, and model evaluation tooling, with an emphasis on mechanistic interpretability and model evaluation. The group’s best-known open artifacts include the GPT-Neo model family, GPT-J, GPT-NeoX-20B, The Pile pretraining dataset, the Pythia training/checkpoint suite for interpretability and training-dynamics work, and the lm-evaluation-harness framework used to run standardized evaluations across language models.