GitHub

Run any AI model locally — one unified API for chat, vision, speech, images, video, and ...

InferAll is a self-hosted inference server that exposes an OpenAI-compatible REST API for every type of AI model. Point any OpenAI SDK client, LangChain, LlamaIndex, or custom application at InferAll ...