↓ Skip to main content

Ansible

Hosting your private ChatGPT on consumer hardware

·1426 words·7 mins
Context / Disclaimers # When I say “private ChatGPT” I mean an LLM server / model host + a RAG solution with a web interface. The chat interface has everything I’d need - chat history, the ability to do web searches, connect to MCP servers, and index both uploaded documents and crawled websites. So what’s important, you’re not relying on the model’s “knowledge” but give it the ability to look up the information both from the internet and the resources you give it.