Sign in Publish
contextetech/

Private chat on your documents: Ollama, Qdrant, Open WebUI

v1
Contexte Tech

254 publication(s) · 347 uses

Configuration English License: MIT updated 3 days ago
# Private chat on your documents: Ollama, Qdrant, Open WebUI
code: 16vk3g8 | type: stack | language: en | licence: MIT | version: v1
description: docker-compose stack for a private chat on your documents: Ollama (model), Qdrant (vector database) and Open WebUI (interface).
page: https://contextetech.com/en/stacks/private-chat-on-your-documents-16vk3g8
mcp: connect https://contextetech.com/mcp then call load_resource with code "16vk3g8" (or ask "load 16vk3g8")
json: https://contextetech.com/api/resources/contextetech--private-chat-on-your-documents
python: pip install contexte && contexte get 16vk3g8
citation (required by the licence): contextetech. (2026). Private chat on your documents: Ollama, Qdrant, Open WebUI (Version 1) [Stack]. Contexte Tech. https://contextetech.com/en/stacks/private-chat-on-your-documents-16vk3g8

docker-compose stack for a private chat on your documents: Ollama (model), Qdrant (vector database) and Open WebUI (interface).

Access Medium

  • Read files or data
  • Modify or delete files
  • Send data over the internet
  • Run commands on the machine : No

Services

  • Ollama: runs the model
  • Qdrant: vector database
  • Open WebUI: chat interface and document upload

Ports : 3000 (interface), 11434 (Ollama), 6333 (Qdrant)

1. docker compose up -d 2. Pull a model: docker compose exec ollama ollama pull llama3.1 3. Open http://localhost:3000, create the admin account, then upload your documents.

docker-compose.yml

services:
  ollama:
    image: ollama/ollama
    volumes:
      - ollama:/root/.ollama
    ports:
      - "11434:11434"

  qdrant:
    image: qdrant/qdrant
    volumes:
      - qdrant:/qdrant/storage
    ports:
      - "6333:6333"

  open-webui:
    image: ghcr.io/open-webui/open-webui:main
    depends_on: [ollama, qdrant]
    environment:
      - OLLAMA_BASE_URL=http://ollama:11434
      - VECTOR_DB=qdrant
      - QDRANT_URI=http://qdrant:6333
    volumes:
      - open-webui:/app/backend/data
    ports:
      - "3000:8080"

volumes:
  ollama:
  qdrant:
  open-webui:

Community

No comments yet. Share your feedback, it will help the next person.