To Code, or Not To Code? Exploring Impact of Code in Pre-trainingView PDF#Training#Large Language Models#Pretrained Models#Coding#Paper#PDF#Cohere·arxiv.org·Apr 25, 2025To Code, or Not To Code? Exploring Impact of Code in Pre-training