Does Transformer Interpretability Transfer to RNNs?#RNN#Transformers#Large Language Models#Paper#PDF#EleutherAI·arxiv.org·Apr 10, 2024Does Transformer Interpretability Transfer to RNNs?
Neural Networks Learn Statistics of Increasing ComplexityDownload PDF#Machine Learning#Neural Networks#Paper#PDF#EleutherAI·arxiv.org·Feb 9, 2024Neural Networks Learn Statistics of Increasing Complexity
The third New England RLHF Hackers Hackathon#EleutherAI#Event#Reinforcement Learning#Feedback·blog.eleuther.ai·Nov 26, 2023The third New England RLHF Hackers Hackathon
Llemma: An Open Language Model For Mathematics#Mathematics#Large Language Models#Paper#PDF#EleutherAI·arxiv.org·Oct 17, 2023Llemma: An Open Language Model For Mathematics
Can Transformers Learn to Solve Problems Recursively?#Transformers#Problem-Solving#Recursion#Paper#PDF#EleutherAI·arxiv.org·May 27, 2023Can Transformers Learn to Solve Problems Recursively?
Transformer Math 101#EleutherAI#Transformers#Mathematics·blog.eleuther.ai·Apr 24, 2023Transformer Math 101
Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling#EleutherAI#Science#Research#Paper#PDF#Large Language Models·arxiv.org·Apr 10, 2023Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling
The View from 30,000 Feet: Preface to the Second EleutherAI Retrospective#EleutherAI#Research·blog.eleuther.ai·Mar 2, 2023The View from 30,000 Feet: Preface to the Second EleutherAI Retrospective
Crosslingual Generalization through Multitask Finetuning (BLOOMZ & mT0)#Machine Learning#Fine-Tuning#BigScience#BLOOM#Big Science#EleutherAI·youtube.com·Nov 19, 2022Crosslingual Generalization through Multitask Finetuning (BLOOMZ & mT0)
Stella Rose Biderman on Twitter#EleutherAI#Funding#DOE·twitter.com·Nov 19, 2022Stella Rose Biderman on Twitter
CarperAI, an EleutherAI lab, announces plans for the first open-source “instruction-tuned” language model.#Instruction#Fine-Tuning#EleutherAI#Opensource#Large Language Models·carper.ai·Oct 20, 2022CarperAI, an EleutherAI lab, announces plans for the first open-source “instruction-tuned” language model.
EleutheAI GPT NeoX 20B#EleutherAI#Large Language Models·20b.eleuther.ai·Jun 22, 2022EleutheAI GPT NeoX 20B
EleutherAI: When OpenAI Isn’t Open Enough#EleutherAI#Large Language Models·spectrum.ieee.org·Mar 21, 2022EleutherAI: When OpenAI Isn’t Open Enough
Announcing GPT-NeoX-20B#Large Language Models#EleutherAI·blog.eleuther.ai·Feb 4, 2022Announcing GPT-NeoX-20B