
Public
Blog - Private Cloud Compute: A new frontier for AI privacy in the cloud - Apple Security Research
Secure and private AI processing in the cloud poses a formidable new challenge. To support advanced features of Apple Intelligence with larger foundation models, we created Private Cloud Compute (PCC), a groundbreaking cloud intelligence system designed specifically for private AI processing. Built with custom Apple silicon and a hardened operating system, Private Cloud Compute extends the industry-leading security and privacy of Apple devices into the cloud, making sure that personal user data sent to PCC isn’t accessible to anyone other than the user — not even to Apple. We believe Private Cloud Compute is the most advanced security architecture ever deployed for cloud AI compute at scale.
bryanheinz starred armbues/SiLLM
bryanheinz
starred
armbues/SiLLM
·
armbues/SiLLM
SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.
Python
145
Updated Apr 25
via GitHub Public Timeline Feed https://ift.tt/2dvB1bN
bryanheinz starred abi/secret-llama
bryanheinz
starred
abi/secret-llama
·
abi/secret-llama
Fully private LLM chatbot that runs entirely with a browser with no server needed. Supports Mistral and LLama 3.
TypeScript
2.1k
5 issues need help
Updated May 11
via GitHub Public Timeline Feed https://ift.tt/2dvB1bN
Tutorial: How to convert HuggingFace model to GGUF format · ggerganov/llama.cpp · Discussion #2948
Source: https://www.substratus.ai/blog/converting-hf-model-gguf-model/ I published this on our blog but though others here might benefit as well, so sharing the raw blog here on Github too. Hope it...
Stanford CRFM
We introduce Alpaca 7B, a model fine-tuned from the LLaMA 7B model on 52K instruction-following demonstrations. On our preliminary evaluation of single-turn instruction following, Alpaca behaves qualitatively similarly to OpenAI’s text-davinci-003, while being surprisingly small and easy/cheap to reproduce (<600$). Checkout our code release on GitHub.
bryanheinz starred mudler/LocalAI
bryanheinz
starred
mudler/LocalAI
·
mudler/LocalAI
🤖 The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade…
C++
15.1k
Updated Jan 6
via GitHub Public Timeline Feed https://ift.tt/3eHsXz6
bryanheinz starred Significant-Gravitas/Auto-GPT
bryanheinz
starred
Significant-Gravitas/Auto-GPT
·
Significant-Gravitas/Auto-GPT
An experimental open-source attempt to make GPT-4 fully autonomous.
Python
135k
23 issues need help
Updated May 24
via GitHub Public Timeline Feed https://ift.tt/0QGuaVT
bryanheinz starred lm-sys/FastChat
bryanheinz
starred
lm-sys/FastChat
·
lm-sys/FastChat
An open platform for training, serving, and evaluating large languages. Release repo for Vicuna and FastChat-T5.
Python
18.4k
4 issues need help
Updated May 6
via GitHub Public Timeline Feed https://ift.tt/MeGbcux