Coder Survival Guide

Coder Survival Guide

5839 bookmarks
Newest
Website Sustainability
Website Sustainability
The web is a major source of carbon emissions. This site provides independent research to help web developers make their products more sustainable.
·websitesustainability.com·
Website Sustainability
Carbon Emissions and Large Neural Network Training
Carbon Emissions and Large Neural Network Training
The computation demand for machine learning (ML) has grown rapidly recently, which comes with a number of costs. Estimating the energy cost helps measure its environmental impact and finding greener strategies, yet it is challenging without detailed information. We calculate the energy use and carbon footprint of several recent large models-T5, Meena, GShard, Switch Transformer, and GPT-3-and refine earlier estimates for the neural architecture search that found Evolved Transformer. We highlight the following opportunities to improve energy efficiency and CO2 equivalent emissions (CO2e): Large but sparsely activated DNNs can consume 1/10th the energy of large, dense DNNs without sacrificing accuracy despite using as many or even more parameters. Geographic location matters for ML workload scheduling since the fraction of carbon-free energy and resulting CO2e vary ~5X-10X, even within the same country and the same organization. We are now optimizing where and when large models are trained. Specific datacenter infrastructure matters, as Cloud datacenters can be ~1.4-2X more energy efficient than typical datacenters, and the ML-oriented accelerators inside them can be ~2-5X more effective than off-the-shelf systems. Remarkably, the choice of DNN, datacenter, and processor can reduce the carbon footprint up to ~100-1000X. These large factors also make retroactive estimates of energy cost difficult. To avoid miscalculations, we believe ML papers requiring large computational resources should make energy consumption and CO2e explicit when practical. We are working to be more transparent about energy use and CO2e in our future research. To help reduce the carbon footprint of ML, we believe energy usage and CO2e should be a key metric in evaluating models, and we are collaborating with MLPerf developers to include energy usage during training and inference in this industry standard benchmark.
·arxiv.org·
Carbon Emissions and Large Neural Network Training
code.gouv.fr sur Twitter
code.gouv.fr sur Twitter
“Le conseil #LogicielsLibres, mis en place et animé par la mission logiciels libres de la @_DINUM à @Etalab, émet son premier avis en répondant positivement à cette question:”
·twitter.com·
code.gouv.fr sur Twitter
Green Software Practitioner
Green Software Practitioner
If you want to make your software applications more sustainable and build a career in green software, then this training is for you
·learn.greensoftware.foundation·
Green Software Practitioner
What we accept as evidence of green power - The Green Web Foundation
What we accept as evidence of green power - The Green Web Foundation
We outline in more detail the process of listing providers as green, but if you are not sure about what to present as evidence we have outlined what we accept here, and our reasoning. The general principle is as follows though: If you want a green site, you need to demonstrate steps you are taking… Read More »What we accept as evidence of green power
·thegreenwebfoundation.org·
What we accept as evidence of green power - The Green Web Foundation
Guide pratique pour des achats numériques responsables
Guide pratique pour des achats numériques responsables
Ce guide consigne de nombreuses recommandations à l’adresse des acteurs publics, recommandations également ouvertes aux acteurs du secteur privé qui peuvent se les approprier dans leur propre démarche d’achat.
·ecoresponsable.numerique.gouv.fr·
Guide pratique pour des achats numériques responsables
What people think building a sustainable internet involves vs what it might actually be - The Green Web Foundation
What people think building a sustainable internet involves vs what it might actually be - The Green Web Foundation
Dear diary, We’ve been asked by Chris and Michelle to write a post that summarises 5 things we’ve learned in the fellowship so far. It’s been a great prompt to take stock and summarise the vast amount of learning I’ve done. I dashed off a quick list a few weeks back. Since then, whenever something… Read More »What people think building a sustainable internet involves vs what it might actually be
·thegreenwebfoundation.org·
What people think building a sustainable internet involves vs what it might actually be - The Green Web Foundation
Home · SDIA
Home · SDIA
SDIA is the first alliance created as an authoritative source of industry leaders and information forging the way for sustainable digital infrastructure.
·sdialliance.org·
Home · SDIA
WPSustainable
WPSustainable
Check the sustainability from your hosting company and the CO2 generated by your IP address.
·wordpress.org·
WPSustainable