Open Source

Tensormux OSS

An open-source inference gateway. Route, health-check, and observe your inference backends with a single config file.

View on GitHubStar on GitHub
Quick install
docker pull ghcr.io/krxgu/tensormux:latest

What you get

Routing: least inflight, EWMA latency, weighted round-robin
Health checking with configurable thresholds
Automatic failover and recovery
OpenAI-compatible API (chat completions + streaming)
Prometheus metrics endpoint
Health and status endpoints
YAML configuration
JSONL audit logging

Tensormux is open source and self-hosted. No vendor lock-in, no external dependencies.

Contribute, report issues, or star the repository on GitHub.