llmisvc_model_provider_resolver
Rewrites publisher-ID body model values to the short model name for LLMISvc / KServe routing; the routing header is left unchanged.
On this page
Rewrites publisher-ID body model values to the short model name for LLMISvc / KServe routing; the routing header is left unchanged.
Configuration Notes
Reads the model name from the configured request header (default X-Model, typically set by an earlier model_to_header). When that value is a publisher ID (publishers/.../models/<name>), rewrite the body "model" field to <name> only. The routing header is never modified – KServe routes on the publisher ID.
If the header is absent/empty, or the body has no "model" field, this filter is a no-op (it does not invent a body "model").
Does not resolve ExternalModel / ExternalProvider CRDs, perform weighted provider selection, rewrite Host, or inject credentials.
Configuration
| Field | Type | Required | Description |
|---|---|---|---|
header | string | no | Request header that carries the publisher ID for KServe routing. Defaults to X-Model (same as model_to_header). |
max_body_bytes | integer | no | Maximum request body size to buffer before parsing. |
Example
filter: llmisvc_model_provider_resolver
header: X-Model # optional, defaults to X-Model