FAQ
Why does my tool use dummy as the API key?
Section titled “Why does my tool use dummy as the API key?”Because the real upstream credential is stored inside AI Relay Box and injected during forwarding. Many OpenAI-compatible tools only require a non-empty local key value.
Why can one provider fetch the model list while another cannot?
Section titled “Why can one provider fetch the model list while another cannot?”Relay services do not always expose model metadata in the same way. Some support /v1/models, some return custom formats, and some do not expose model discovery at all.
Does AI Relay Box choose the model for the user?
Section titled “Does AI Relay Box choose the model for the user?”No. The client tool still decides which model to request.
AI Relay Box only uses its selected model ordering as a fallback chain under specific conditions:
- The incoming request already names a model in the selected list.
- The upstream request fails with a retryable status such as
429or5xx.
Does AI Relay Box support Gemini native API?
Section titled “Does AI Relay Box support Gemini native API?”Not currently. It can work with Gemini models only when the upstream provider exposes them through an OpenAI-compatible or Anthropic-compatible interface.