Machine Learning & Artificial Intelligence

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

A set of 3 decoder-only LLMs with 125M, 1.3B, and 2.7B parameters trained on the Pile.

Our API platform offers our latest models and guides for safety best practices.

Meta AI Research released Open Pre-trained Transformer (OPT-175B), a 175B parameter AI language model. The model was trained on a dataset containing 180B tokens and exhibits performance comparable with GPT-3, while only requiring 1/7th GPT-3's training carbon footprint.

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Contribute to google-research/multilingual-t5 development by creating an account on GitHub.

In this article, we'll explore the architecture and mechanisms behind Google’s T5 Transformer model, from the unified text-to-text framework to the comparison of T5 results.

null

null

PaLM 2 - Google’s next generation large language model.

The Generalist Language Model GLaM is a mixture of experts (MoE) model, a type of model that can be thought of as having different submodels (or expert...

null

Scaling to Trillion Parameter Models with Simple and Efficient Sparsity *In deep learning, models typically reuse the same parameters for all inputs. Mi...

A GPT-3 rival by Deepmind Researchers at DeepMind have proposed a new predicted compute-optimal model called Chinchilla that uses the same compute budge...

280 Billion Parameters Language model DeepMind’s language model, which it calls Gopher, is significantly more accurate than these existing ultra-large ...

Large Language Models, LLM, Language Models, Concepts, Examples, Machine Learning, Deep Learning, Tutorials, Interviews, News, AI

This figure was adapted from a similar image published in DistilBERT (opens in new tab). Turing Natural Language Generation (T-NLG) is a 17 billion parameter language model by Microsoft that outperforms the state of the art on many downstream NLP tasks. We present a demo of the model, including its freeform generation, question answering, and […]

null

Harness the power of Cohere's API to access pre-trained language models for AI-driven text generation. Create engaging content effortlessly. Get started for free.

This easy, efficient, and cost-effective framework helps developers build, train, and deploy large language models (LLMs) faster for enterprise application development.

After working with key partners for the past few months, we’re opening up access to Claude, our AI assistant.

Today, we’re releasing our LLaMA (Large Language Model Meta AI) foundational model with a gated release. LLaMA is more efficient and competitive with previously published models of a similar size on existing benchmarks.

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

PaLM 2 - Google’s next generation large language model.

LaMDA adds pieces to one of the most tantalizing sections of the language puzzle: conversation.

A large language model (LLM) is a type of artificial intelligence model that has been trained to recognize and generate vast quantities of written human language.

Nature Biotechnology - Artificial neural networks have been applied to problems ranging from speech recognition to prediction of protein secondary structure, classification of cancers and gene...