#Inference

Scaling Rufus, the Amazon generative AI-powered conversational shopping assistant with over 80,000 AWS Inferentia and AWS Trainium chips, for Prime Day | Amazon Web Services

#Amazon Web Services #AI #Shopping #Inference

·aws.amazon.com·Oct 10, 2024

Scaling Rufus, the Amazon generative AI-powered conversational shopping assistant with over 80,000 AWS Inferentia and AWS Trainium chips, for Prime Day | Amazon Web Services

Groq

#Large Language Models #Inference #Performance #Hardware

·groq.com·Feb 20, 2024

Groq

Inference with Reference: Lossless Acceleration of Large Language Models

#Inference #Microsoft #Paper #PDF #Large Language Models

·arxiv.org·Apr 19, 2023

Inference with Reference: Lossless Acceleration of Large Language Models

Pinecone - 🤗 Inference Endpoints case study

#Inference #Semantic Search #Hugging Face #Pinecone #Data Science

·youtube.com·Sep 30, 2022

Pinecone - 🤗 Inference Endpoints case study