Sign in Publish

Deploy an AI model on your own machines

LLMs, inference configs and stacks to deploy AI on your own machines, without sending your data elsewhere.

6 result(s)
- [8hyjqo] llama.cpp server for a GGUF model | inference | en | MIT | https://contextetech.com/en/inference/llama-cpp-server-gguf-8hyjqo
- [10wkyv1] Local automations: n8n and Ollama | stack | en | MIT | https://contextetech.com/en/stacks/local-automations-n8n-ollama-10wkyv1
- [1dabn54] Minimal private AI chat: Ollama and Open WebUI | stack | en | MIT | https://contextetech.com/en/stacks/minimal-private-ai-chat-1dabn54
- [1rcm91j] Mistral 7B on a 16 GB Mac with Ollama | inference | en | MIT | https://contextetech.com/en/inference/mistral-7b-ollama-mac-16gb-1rcm91j
- [16vk3g8] Private chat on your documents: Ollama, Qdrant, Open WebUI | stack | en | MIT | https://contextetech.com/en/stacks/private-chat-on-your-documents-16vk3g8
- [l4t26x] Qwen2.5 7B with vLLM on a 24 GB GPU | inference | en | MIT | https://contextetech.com/en/inference/qwen2-5-7b-vllm-24gb-gpu-l4t26x

What does deploying an AI model mean?

Deploying means running a model on your own machines or servers instead of calling an external API: your data stays with you. You pick a model (LLM, embeddings), a runtime (Ollama, vLLM, llama.cpp) and, if needed, a full docker-compose stack.