Found 1 bookmarks
Newest
Training great LLMs entirely from ground zero in the wilderness as a startup — Yi Tay
Training great LLMs entirely from ground zero in the wilderness as a startup — Yi Tay
  1. Experiences in procuring compute & variance in different compute providers. Our biggest finding/surprise is that variance is super high and it's almost a lottery to what hardware one could get!
  2. Discussing "wild life" infrastructure/code and transitioning to what I used to at Google
  3. New mindset when training models.
#prompts#ai#LLMs#blog
·yitay.net·
Training great LLMs entirely from ground zero in the wilderness as a startup — Yi Tay