I am the author of GPT-Load. GPT-Load is a self-hosted AI gateway that centrally manages API keys and supported subscription accounts. It also provides credential scheduling, failover, access control, request logging, and usage tracking.
In addition to some commonly used AI gateway features, this section focuses on two features:
1. Reversible request redaction This feature allows matching content to be encrypted using configurable rules before request data reaches the upstream service, then restores authenticated sensitive information in response output and tool calls. This protects outgoing content, not just logs.
2. JEV-based smart guardrails (experimental) This safeguard can issue a warning or block a request when a matching rule is found. It uses JEV for review services (disabled by default).
The README provides quick-start and configuration instructions. Feedback and suggestions are welcome.
tbphp•37m ago
In addition to some commonly used AI gateway features, this section focuses on two features:
1. Reversible request redaction This feature allows matching content to be encrypted using configurable rules before request data reaches the upstream service, then restores authenticated sensitive information in response output and tool calls. This protects outgoing content, not just logs.
2. JEV-based smart guardrails (experimental) This safeguard can issue a warning or block a request when a matching rule is found. It uses JEV for review services (disabled by default).
The README provides quick-start and configuration instructions. Feedback and suggestions are welcome.