swe

swe

503 bookmarks
Newest
Thread by @altryne on Thread Reader App
Thread by @altryne on Thread Reader App
@altryne: Watching @karpathy presentation from today and taking twitter notes, come along for the ride: If you're like only the practical tips, skip to #32 @karpathy starts with stages: 1 - Pre-training - months x th...…
·threadreaderapp.com·
Thread by @altryne on Thread Reader App
Understanding GPT tokenizers
Understanding GPT tokenizers
Large language models such as GPT-3/4, LLaMA and PaLM work in terms of tokens. They take text, convert it into tokens (integers), then predict which tokens should come next. Playing …
·simonwillison.net·
Understanding GPT tokenizers
Understanding React Concurrency
Understanding React Concurrency
React v18.0 has broken ground by introducing a long-awaited feature: Concurrency! Unfortunately, despite a deluge of resources explaining how to use it, explanations of how it works are sparse. As it is a low-level feature, it’s not critical to understand React’s idea of concurrency, but it doesn’t hurt!
·bbss.dev·
Understanding React Concurrency
Random Thoughts 15 years into Software Engineering
Random Thoughts 15 years into Software Engineering
I’m coming up on 15 years of professional software engineering. I’ve worked at companies from unknown startups to large FAANG-like silicon valley companies and everywhere in between. In no particular order, sharing some things I’ve learned that others may find helpful.
·roughlywritten.substack.com·
Random Thoughts 15 years into Software Engineering
Prompt Engineering
Prompt Engineering
Prompt Engineering, also known as In-Context Prompting, refers to methods for how to communicate with LLM to steer its behavior for desired outcomes without updating the model weights. It is an empirical science and the effect of prompt engineering methods can vary a lot among models, thus requiring heavy experimentation and heuristics. This post only focuses on prompt engineering for autoregressive language models, so nothing with Cloze tests, image generation or multimodality models.
·lilianweng.github.io·
Prompt Engineering