GitHub - collabora/WhisperFusion: WhisperFusion builds upon the capabilities of WhisperLive and WhisperSpeech to provide a seamless conversations with an AI.
WhisperFusion builds upon the capabilities of WhisperLive and WhisperSpeech to provide a seamless conversations with an AI. - GitHub - collabora/WhisperFusion: WhisperFusion builds upon the capabil...
Logging OpenAI API requests and responses using HTTPX
My LLM tool has a feature where you can set a LLM_OPENAI_SHOW_RESPONSES environment variable to see full debug level details of any HTTP requests it makes to the OpenAI APIs.
How I Made AI Assistants Do My Work For Me: CrewAI
In this video about crewai I've decided to show you:
1. how to build your own team of ai agents that debate and think about your business idea from multiple angles
2. how to give your agents access to real world data like google searches and reddit
3. performance of 15 models in total: 13 local models + 2 through api
Promised links:
My Github CrewAI Repo:
https://github.com/majacinka/crewai-experiments
CrewAI:
https://github.com/joaomdmoura/crewAI
AI agent landscape (as seen on 2:09):
https://github.com/e2b-dev/awesome-ai-agents
Serper Free Signup:
https://serper.dev
Andrej's video:
https://youtu.be/zjkBMFhNj_g?si=NeN5qsdfOYwOAiEI
Gemini Free API Key:
https://makersuite.google.com/app
LangChain Tools:
https://python.langchain.com/docs/integrations/tools
Timecodes:
0:00 - 3:17 what is crewai
3:18 - 8:24 startup example
8:28 - 13:48 internet/reddit example
13:49 - 14:27 gemini pro
14:28 - 14:42 price
14:42 - 19:17 local models
#crewai #aiagents #localmodels
CrewAI Tutorial - Next Generation AI Agent Teams (Fully Local)
CrewAI helps you build incredible AI agent teams with a focus on giving them tools, delegation powers, and more.
Monster API, the best place to integrate the latest AI models at a fraction of the cost - https://www.monsterapi.ai
Follow me on Twitter 🧠 - https://twitter.com/matthewberman
Join the Discord 💬 - https://discord.gg/xxysSXBxFW
Become a Patron 🔥 - https://patreon.com/MatthewBerman
Subscribe to my Substack 🗞️ - https://matthewberman.substack.com/
Media/Sponsorship Inquiries 📈 - https://bit.ly/44TC45V
Need AI Consulting? ✅ - https://forwardfuture.ai/
VM with My Favorite AI Apps Pre-installed 🚀 - https://bit.ly/matthew-berman-youtube USE CODE "MatthewBerman" for 50% discount
Links:
CrewAI - https://github.com/joaomdmoura/crewAI
Ollama Guide - https://www.youtube.com/watch?v=rIRkxZSn-A8
Chapters
00:00 - Introduction to Crew AI and its Features
01:10 - Setting Up Crew AI with GP4 and a Local Model
02:05 - Importing and Configuring Crew AI Components
03:15 - Creating Agent Teams for Specific Tasks
04:23 - Assigning and Managing Tasks for Agents
06:02 - Instantiating and Running the Crew
07:08 - Demonstrating Crew AI in Action
08:04 - Integrating Local Models with Crew AI
09:12 - Advanced Configuration with Local Models
10:19 - Preview of Upcoming Features and Tutorials
Thanks to @warezit for the chapters!
We modify speculative decoding where we replace the draft model with simple string matching in the prompt to generate candidate token sequences. This results in significant speedups (2x-4x) in input-grounded tasks, with no effect on output quality. This method can be used with any decoder model without model changes or external datastore, and with both greedy and sampling techniques.
Code LoRA from Scratch - a Lightning Studio by sebastian
LoRA (Low-Rank Adaptation) is a popular technique to finetune LLMs more efficiently.
This Studio explains how LoRA works by coding it from scratch, which is an excellent exercise for looking under the hood of an algorithm.
Long ago, in a parallel universe three doors down and one to the left of our own, OpenAI headquarters found itself in chaos.
A klaxon blared overhead as red lights began flashing. A message played over a loud-speaker: “Warning! Warning! This is not a drill! Artificial General Intelligence window closing!
This video offers a quick dive into the world of finetuning Large Language Models (LLMs). This video covers - common usage scenarios for pretrained LLMs- par...
CrewAI is the best AI tool for marketers. Discover how Crew's autonomous AI can transform your marketing efficiency and effectiveness today. Get CrewAI today.
Stable Code, an upgrade from Stable Code Alpha 3B, specializes in code completion and outperforms predecessors in efficiency and multi-language support. It is compatible with standard laptops, including non-GPU models, and features capabilities like FIM and expanded context size. Trained in multiple