Re-ranking is an integral component of many retrieval pipelines; however, there exist numerous approaches to it, all with different implementation methods. To mitigate this, we propose rerankers, a Python library which provides a simple, easy-to-use interface to all commonly used re-ranking approaches.

DocETL is an open-source system for building LLM-powered data processing pipelines, offering declarative operators and powerful optimization for complex document analysis tasks

Community driven roadmaps, articles and guides for developers to grow in their career.

In this tutorial, we explore and evaluate different chunking strategies to choose the right one for a sample RAG application.

This repository provides tutorials and implementations for various Generative AI Agent techniques, from basic to advanced. It serves as a comprehensive guide for building intelligent, interactive A...

Distinguishing problems with external vs. internal LLMs, and data vs non-data patterns

Structured input/output, prefilling, n-shots prompting, chain-of-thought, reducing hallucinations, etc.

Learn how to combine text extraction, network analysis, and LLM prompting and summarization for improved RAG accuracy.

What’s the real reason AI hasn’t yet delivered on its hype?

Build language agents as graphs

Build resilient language agents as graphs.

Build resilient language agents as graphs. Contribute to langchain-ai/langgraph development by creating an account on GitHub.

Desktop app for prototyping and debugging LangGraph applications locally. - langchain-ai/langgraph-studio

New LLM Pre-training and Post-training Paradigms: A Look at How Moderns LLMs Are Trained

Use cases, techniques, alignment, finetuning, and critiques against LLM-evaluators.

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Learn how to do batch inference using a provisioned throughput endpoint.

Learn the overview and basic steps for performing model serving on Databricks.

dbdemos - Databricks Lakehouse demos : Fine Tune your LLMs with Mosaic AI Model Training

dbdemos - Databricks Lakehouse demos : LLM Chatbot With Retrieval Augmented Generation (RAG) and DBRX

Discover the power of Lakehouse. Install demos in your workspace to quickly access best practices for data ingestion, governance, security, data science and data warehousing.

Web site created using create-react-app

The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

My experiences from preparing for and successfully passing the (beta) exam

Discover why GraphRAG will subsume vector-only RAG and emerge as the default RAG architecture for most use cases.