From a73e41e7cdc191be3c94464d70c5ef2ecb0fa856 Mon Sep 17 00:00:00 2001 From: midnight Date: Fri, 26 Sep 2025 04:09:41 +0200 Subject: [PATCH] Update LLM API Router Service --- LLM-API-Router-Service.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/LLM-API-Router-Service.md b/LLM-API-Router-Service.md index e062b35..39dcf47 100644 --- a/LLM-API-Router-Service.md +++ b/LLM-API-Router-Service.md @@ -32,7 +32,7 @@ configuration is provided through a `LLMApiRouterConfiguration` object. `AllLLMServicesUnavailableException`. * The request is routed to the selected `LLMService`. * This call is wrapped in the `autoRetry` method - * depending on the endpoint, the `shortTimeout` parameter is set + * The `shortTimeout` parameter is set based on the endpoint. * `true` for `processQuery` * `false` for `generateSummary` @@ -49,7 +49,7 @@ configuration is provided through a `LLMApiRouterConfiguration` object. * If a timeout is encountered by an `LLMService`, it sets its `operational` flag to false and throws a `ServiceUnavailableException` * the autoRetry method catches the exception and automatically retries the request - * the `LLMApiRouter` always selects the first available service for each attempt independently each attempt independently + * the `LLMApiRouter` always selects the first available service for each attempt independently 5. **Service Health Checks:** * A scheduled task (`@Scheduled`) periodically checks the availability of each `LLMService`.