awesome-ChatGPT-repositories
Section: Langchain · Model swapping for llama.cpp (or any local OpenAPI compatible server)
FreshScore 87
Entry
llama-swap
Appears in 5 awesome lists
Intelligent model swapping proxy for llama.cpp. Enables seamless hot-swapping between different GGUF models without restarting the server, with automatic model loading/unloading and OpenAI-compatible API. MIT licensed.
Open github.commostlygeek/llama-swap
Found in these lists
Awesome Stars
Section: Go · transparent proxy server on demand model swapping for llama.cpp (or any local OpenAPI compatible server)
SlowScore 58
Awesome local LLM
Section: Models · reliable model swapping for any local OpenAI compatible server - llama.cpp, vllm, etc.
FreshScore 87
Awesome Open Source AI
Section: 3. Inference Engines & Serving · Intelligent model swapping proxy for llama.cpp. Enables seamless hot-swapping between different GGUF models without restarting the server, with automatic model loading/unloading and OpenAI-compatible API. MIT licensed.
FreshScore 89
awesome-go
Section: Other · Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc
FreshScore 81
Often listed next to it
Awesome Go
A curated list of awesome Go frameworks, libraries, software and resources.
In 9 listsDetails
LangChain
Langchain integrates various providers like Anthropic, AWS, and OpenAI, and offers tools for components such as LLMs, chat models, and data analysis, supporting functionalities from Alpha Vantage to YouTube github | docs
In 20 listsDetails
LiteLLM
Unified proxy and SDK that routes to 100+ LLM providers behind a single OpenAI-compatible interface, with a Router handling retry/fallback across deployments, per-project cost and rate-limit tracking, and OTEL callback integrations. The right infrastructure layer when your harness needs provider…
In 16 listsDetails
LlamaIndex
(MIT) provides modules for structured outputs at different levels of abstraction, including output parsers for text completion endpoints, Pydantic programs for mapping prompts to structured outputs using function calling or output parsing, and pre-defined Pydantic programs for specific output types.
In 14 listsDetails
LocalAI
robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video,…
In 14 listsDetails