Does Transformer Interpretability Transfer to RNNs?

Llemma: An Open Language Model For Mathematics

Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling

CarperAI, an EleutherAI lab, announces plans for the first open-source “instruction-tuned” language model.

EleutheAI GPT NeoX 20B

EleutherAI: When OpenAI Isn’t Open Enough

Announcing GPT-NeoX-20B