Serge
Serge is a fully self-hosted Web chat interface based on llama.cpp. It can run multiple large language models (LLMs) without API keys. It supports local deployment, protects data privacy, and is suitable for intelligent conversation needs of individuals and teams.
You need to use Page Pig. ·Support running multiple open source large language models (such as Alpaca, LLaMA) through llama.cpp ·Fully locally deployed without relying on external API keys · SvelteKit front-end, smooth experience · FastAPI + LangChain provides strong API support ·Support Redis to store chat records and parameters, making data safe and controllable ·Persistence storage of chat history and model parameters for multiple conversations ·Easy to use Web interface that supports multi-session management ·Provide API documentation to facilitate secondary development or integration by developers
