Deploy an AI model on your own machines
LLMs, inference configs and stacks to deploy AI on your own machines, without sending your data elsewhere.
- [10wkyv1] Local automations: n8n and Ollama | stack | en | MIT | https://contextetech.com/en/stacks/local-automations-n8n-ollama-10wkyv1 - [1dabn54] Minimal private AI chat: Ollama and Open WebUI | stack | en | MIT | https://contextetech.com/en/stacks/minimal-private-ai-chat-1dabn54 - [16vk3g8] Private chat on your documents: Ollama, Qdrant, Open WebUI | stack | en | MIT | https://contextetech.com/en/stacks/private-chat-on-your-documents-16vk3g8
Local automations: n8n and Ollama
docker-compose stack to automate with a local AI: n8n (workflows) and Ollama (model), without sending data to an external API.
Minimal private AI chat: Ollama and Open WebUI
The simplest stack for a private AI chat: Ollama and Open WebUI with docker-compose, interface on port 3000.
Private chat on your documents: Ollama, Qdrant, Open WebUI
docker-compose stack for a private chat on your documents: Ollama (model), Qdrant (vector database) and Open WebUI (interface).
What does deploying an AI model mean?
Deploying means running a model on your own machines or servers instead of calling an external API: your data stays with you. You pick a model (LLM, embeddings), a runtime (Ollama, vLLM, llama.cpp) and, if needed, a full docker-compose stack.