PatternBoost: Constructions in Mathematics with a Little Help from AI

Etched is Making the Biggest Bet in AI

STT: Stateful Tracking with Transformers for Autonomous Driving

Retrieval Head Mechanistically Explains Long-Context Factuality

Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

Does Transformer Interpretability Transfer to RNNs?

DSI++: Updating Transformer Memory with New Documents

Transformers at Work 2023: The future of Transformers, LLMs and AI Agents.

Faith and Fate: Limits of Transformers on Compositionality

CodeTF: One-stop Transformer Library for State-of-the-art Code LLM

Bytes Are All You Need: Transformers Operating Directly On File Bytes

The Impact of Positional Encoding on Length Generalization in Transformers

Can Transformers Learn to Solve Problems Recursively?

RWKV: Reinventing RNNs for the Transformer Era

Scaling Transformer to 1M tokens and beyond with RMT

An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale

Transformer Math 101

Scaling Vision Transformers to 22 Billion Parameters

Exphormer: Sparse Transformers for Graphs

RT-1: Robotics Transformer for Real-World Control at Scale

Probabilistic Time Series Forecasting with 🤗 Transformers

Wang, W. and others. (2021). Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction Without Convolutions.

Teaching AI advanced mathematical reasoning

Get Ready for Transformational Transformer Networks - EE Times

NielsRogge/Transformers-Tutorials: This repository contains demos I made with the Transformers library by HuggingFace.

Getting started with IPUs on Paperspace

Introducing Whisper

Release v4.22.0: Swin Transformer v2, VideoMAE, Donut, Pegasus-X, X-CLIP, ERNIE · huggingface/transformers

How AI Transformers Mimic Parts of the Brain | Quanta Magazine

CS25 I Stanford Seminar - Mixture of Experts (MoE) paradigm and the Switch Transformer