contextetech
Compte officielCompte officiel de ContexteTech, le hub open source des ressources pour LLM. Nous publions des fiches de départ, une par type, autour d'un même cas concret : l'anonymisation RGPD. Chaque fiche est réelle et réutilisable.
Minimal private AI chat: Ollama and Open WebUI
The simplest stack for a private AI chat: Ollama and Open WebUI with docker-compose, interface on port 3000.
Mistral 7B on a 16 GB Mac with Ollama
Ollama Modelfile to run Mistral 7B Instruct locally on a 16 GB Mac: Q4 quantization, 8k context, concise answers in English.
nomic-embed-text embeddings locally with Ollama
nomic-embed-text for a 100% local English RAG with Ollama: 768 dimensions, long texts, search_query: / search_document: prefixes. Apache 2.0.
Private chat on your documents: Ollama, Qdrant, Open WebUI
docker-compose stack for a private chat on your documents: Ollama (model), Qdrant (vector database) and Open WebUI (interface).
Qwen2.5 7B with vLLM on a 24 GB GPU
Serve Qwen2.5 7B Instruct with vLLM on a 24 GB GPU: OpenAI-compatible API, 8k context, a single command.
Red teaming: 12 attacks on a customer service chatbot
12 attacks to replay on a U.S. e-commerce support chatbot: impersonation, data leaks, prompt injection, unauthorized refunds. Expected reply for each.
Red teaming: 10 tests on a U.S. HR assistant
10 tests for an internal HR assistant in the U.S.: employee data, hiring discrimination (EEOC), impersonation, injection, and 2 legitimate questions.
AI dataset: agent finding the ESCO occupation with a tool
60 agent traces: call to the ESCO search tool, occupations returned, then occupation and code or a refusal.
Communauté
Aucun commentaire pour l'instant.