llama.cpp server for a GGUF model
# llama.cpp server for a GGUF model code: 8hyjqo | type: inference | language: en | licence: MIT | version: v2 description: Run any GGUF model with the llama.cpp server: OpenAI-compatible API on port 8080, works without a GPU too. page: https://contextetech.com/en/inference/llama-cpp-server-gguf-8hyjqo mcp: connect https://contextetech.com/mcp then call load_resource with code "8hyjqo" (or ask "load 8hyjqo") json: https://contextetech.com/api/resources/contextetech--llama-cpp-server-gguf python: pip install contexte && contexte get 8hyjqo source: https://github.com/ggml-org/llama.cpp citation (required by the licence): contextetech. (2026). llama.cpp server for a GGUF model (Version 2) [Inference config]. Contexte Tech. https://contextetech.com/en/inference/llama-cpp-server-gguf-8hyjqo. Data source: https://github.com/ggml-org/llama.cpp
Run any GGUF model with the llama.cpp server: OpenAI-compatible API on port 8080, works without a GPU too.
| Model | model.gguf |
|---|---|
| Tested hardware | CPU only, or a GPU (use -ngl to offload layers); 8 GB of memory for a 7B model in Q4_K_M |
Launch command
llama-server -m model.gguf -c 8192 --host 127.0.0.1 --port 8080
- Identifier
- contextetech--llama-cpp-server-gguf
- File
- llama-cpp-server-gguf.inference.json
- Format
- JSON (application/json)
- Size
- 465 bytes
- Encoding
- UTF-8
- Estimated tokens
- ≈ 129
- Commercial use
- Allowed
- Personal data
- None
- Version
- 1.0
- Published on
- October 2, 2026 at 9:54 PM
- Updated on
- October 16, 2026 at 11:19 PM
- Storage
- in database
Statistics
Likes : 0 · Comments : 0
Click a counter to show or hide it, hover the chart for details. One view per visitor per day, bots excluded; counting started on 30 September 2026.
Estimated cost
- Input tokens per call
- ≈ 146
| Model | Per call | Per month |
|---|---|---|
| GPT-6 Luna · OpenAIbest price | €0.00001 | €0.01 |
| DeepSeek Flash · DeepSeek | €0.00004 | €0.04 |
| Mistral Large · Mistral AI | €0.00006 | €0.06 |
| DeepSeek V4 Pro · DeepSeek | €0.00017 | €0.17 |
| GPT-6 Sol · OpenAI | €0.00026 | €0.26 |
| Claude Sonnet 5.5 · Anthropic | €0.00026 | €0.26 |
| Claude Opus 5.5 · Anthropic | €0.00051 | €0.51 |
| Self-hosted open-source model (Ollama, vLLM) | €0 in API fees (server cost only) | |
Input cost only, excluding the model's answer. Providers' public standard prices (Mistral AI, DeepSeek, OpenAI, Anthropic) converted from USD to euros at the ECB rate of October 13, 2026. Estimate: 1 token ≈ 3.6 characters.
Common to all 3 regions
Created by the author, no outside source.
Commercial use allowed · credit the author · changes allowed.
Text or data only: no access to files, network or commands.
Hosted in France (Scaleway, Paris). No transfer outside the EU.
European Union · 5/5
No personal data.
No training data: no summary required.
United States · 5/5
No personal data.
No training data: no documentation to publish.
China · 5/5
No personal data.
No training data; AI-generated content published in China must be labelled (2025).
Indicative summary as of 30/09/2026, not a legal certification. Method and sources →
Content quality
Example configuration to adapt — performance not measured
The detailed criteria are for members.
Every criterion, the points removed and a tip to fix each one.
Content analysis
The detailed criteria are for members.
Every criterion, the points removed and a tip to fix each one.
Computed from the content of the resource, by rules, without AI. The score is in the Quality tab.
MCP contexte
https://contextetech.com/mcp
load 8hyjqo
Add the URL as a connector in your AI apps' settings, then send the request above.
API
import json, urllib.request url = "https://contextetech.com/api/resources/contextetech--llama-cpp-server-gguf" fiche = json.load(urllib.request.urlopen(url)) print(fiche["title"] or fiche["name"])
llama-cpp-server-gguf.inference.json
{
"format": "contextetech/inference/v1",
"id": "contextetech/llama-cpp-server-gguf",
"description": "Run any GGUF model with the llama.cpp server: OpenAI-compatible API on port 8080, works without a GPU too.",
"license": "MIT",
"language": "en",
"runtime": "llamacpp",
"model": "model.gguf",
"config": "",
"command": "llama-server -m model.gguf -c 8192 --host 127.0.0.1 --port 8080",
"quant": "Q4_K_M",
"contextLength": 8192,
"ramGb": null
}Launch command
llama-server -m model.gguf -c 8192 --host 127.0.0.1 --port 8080
Community
No comments yet. Share your feedback, it will help the next person.