Adopt PromptKit timeout fix and complete verification

This commit is contained in:
2026-11-19 14:39:10 +00:00
parent 78bcf86619
commit c5e54edaa5
20 changed files with 92 additions and 57 deletions

View File

@@ -67,11 +67,11 @@ The optional `model` object accepts `endpoint`, `model`, `temperature`,
`max_tokens`, `top_p`, `timeout_seconds`, `service_tier`,
`reasoning_effort`, `api_key_env`, and `extra_params`. Numeric ranges and
framework credential semantics are defined by the
[PromptKit v0.23.2 format reference](https://forge.maximumdirect.net/base-layer/promptkit/src/commit/382ccfb14b9630fd8f48c8364dbe2b6159637d71/docs/formats.md).
[PromptKit v0.23.3 format reference](https://forge.maximumdirect.net/base-layer/promptkit/src/commit/804a4d32b23aa2e7973400bb0a322a7016574c9f/docs/formats.md).
Explicit zero values for the numeric fields are overrides; zero
`timeout_seconds` disables the per-attempt generation deadline only, retaining the
request context and configured transport cap. The timeout layers are defined in
the [PromptKit v0.23.2 outbound integration contract](https://forge.maximumdirect.net/base-layer/promptkit/src/commit/382ccfb14b9630fd8f48c8364dbe2b6159637d71/docs/integrations/openai-compatible-chat.md#timeout-and-cancellation).
the [PromptKit v0.23.3 outbound integration contract](https://forge.maximumdirect.net/base-layer/promptkit/src/commit/804a4d32b23aa2e7973400bb0a322a7016574c9f/docs/integrations/openai-compatible-chat.md#timeout-and-cancellation).
Each built-in transient retry gets a fresh generation timeout; the caller's
request context remains the outer cancellation boundary.
@@ -221,14 +221,6 @@ attempt timeout while the parent remains live retains `502 llm_failed`. A succes
run remains successful even if cancellation races with response formatting;
delivery after a client disconnect cannot be guaranteed.
With the selected PromptKit release and Go 1.27.4, an operation budget that
expires during an in-flight built-in HTTP request can currently surface as
`502 llm_failed` instead of the intended `504`: the transport may return the
operation's cancellation cause without the typed timeout. Retry and capacity
waits are attributed correctly. In the affected case, an opted-in terminal
report can likewise classify the failure as `transport`. Treat this as a known
upstream limitation.
## Retry And Idempotency
Scriptorium provides no idempotency keys, pagination, caching headers, or rate