diff --git a/LLM-API-Router-Service.md b/LLM-API-Router-Service.md index b75460f..e062b35 100644 --- a/LLM-API-Router-Service.md +++ b/LLM-API-Router-Service.md @@ -32,6 +32,10 @@ configuration is provided through a `LLMApiRouterConfiguration` object. `AllLLMServicesUnavailableException`. * The request is routed to the selected `LLMService`. * This call is wrapped in the `autoRetry` method + * depending on the endpoint, the `shortTimeout` parameter is set + * `true` for `processQuery` + * `false` for `generateSummary` + > **Note** The service selection mechanism is implemented in the `currentService` property. > This property is evaluated for each access, so it should always return an `LLMService` that is flagged as `operational`