Private chat on your documents: Ollama, Qdrant, Open WebUI

docker-compose stack for a private chat on your documents: Ollama (model), Qdrant (vector database) and Open WebUI (interface).

Access Medium

• ✓ Read files or data
• ✓ Modify or delete files
• ✓ Send data over the internet
• — Run commands on the machine : No

Services

• Ollama: runs the model
• Qdrant: vector database
• Open WebUI: chat interface and document upload

Ports : 3000 (interface), 11434 (Ollama), 6333 (Qdrant)

1. docker compose up -d 2. Pull a model: docker compose exec ollama ollama pull llama3.1 3. Open http://localhost:3000, create the admin account, then upload your documents.

docker-compose.yml

services:
  ollama:
    image: ollama/ollama
    volumes:
      - ollama:/root/.ollama
    ports:
      - "11434:11434"

  qdrant:
    image: qdrant/qdrant
    volumes:
      - qdrant:/qdrant/storage
    ports:
      - "6333:6333"

  open-webui:
    image: ghcr.io/open-webui/open-webui:main
    depends_on: [ollama, qdrant]
    environment:
      - OLLAMA_BASE_URL=http://ollama:11434
      - VECTOR_DB=qdrant
      - QDRANT_URI=http://qdrant:6333
    volumes:
      - open-webui:/app/backend/data
    ports:
      - "3000:8080"

volumes:
  ollama:
  qdrant:
  open-webui:

Estimated cost

Input tokens per call : ≈ 374

Input cost only, excluding the model's answer. Providers' public standard prices (Mistral AI, DeepSeek, OpenAI, Anthropic) converted from USD to euros at the ECB rate of September 29, 2026. Estimate: 1 token ≈ 3.6 characters.

Identifier

contextetech--private-chat-on-your-documents

Type

Stacks

File

docker-compose.yml

Format

YML

Size

574 bytes

Encoding

UTF-8

Estimated tokens

≈ 159

Language

English

License

MIT

Commercial use

Allowed

Personal data

None

Version

1.0

Published on

October 2, 2026 at 9:54 PM

Updated on

October 2, 2026 at 9:54 PM

Storage

in database

Uses

0

Likes

0

docker-compose.yml

services:
  ollama:
    image: ollama/ollama
    volumes:
      - ollama:/root/.ollama
    ports:
      - "11434:11434"

  qdrant:
    image: qdrant/qdrant
    volumes:
      - qdrant:/qdrant/storage
    ports:
      - "6333:6333"

  open-webui:
    image: ghcr.io/open-webui/open-webui:main
    depends_on: [ollama, qdrant]
    environment:
      - OLLAMA_BASE_URL=http://ollama:11434
      - VECTOR_DB=qdrant
      - QDRANT_URI=http://qdrant:6333
    volumes:
      - open-webui:/app/backend/data
    ports:
      - "3000:8080"

volumes:
  ollama:
  qdrant:
  open-webui:

Launch

# enregistrez docker-compose.yml, puis :
docker compose up -d
docker compose ps