Add detailed validation evidence

This commit is contained in:
2026-11-07 04:52:58 +00:00
parent 1986c44f49
commit 0b70f37267
5 changed files with 286 additions and 19 deletions

View File

@@ -335,12 +335,20 @@ with each reached scope and its outcome (`valid`, `failed`, or `canceled`).
example config validate
example config validate --scope promptkit --format yaml
example config validate --scope all
example config validate --scope all --details --severity warning --code schema.version
```
Each successful scope is reported as `SCOPE: valid`. Aggregate validation stops
at the first load failure or cancellation, then submits one report containing
the reached scopes. Output errors occur after acquisition has stopped. Provider
warnings go to the diagnostic stream and do not alone make validation fail.
`--details` includes native findings and the source references needed to
interpret them. Each scope's detail state is `unavailable`, `empty`, `filtered`,
or `present`. Repeat `--severity error|warning` or `--code CODE` to filter
findings: values within a filter match any, and the two filters narrow together.
Filters require `--details` and never change the validation outcome. Detailed
output suppresses ordinary warnings associated with its native findings; other
messages and terminal failure explanations remain visible.
`--config` and `--overlay` preserve whether an
empty value was explicitly supplied, so a scope callback can map those inputs to
its own ConfigKit load policy. Help and invalid syntax do not call scope

View File

@@ -1,6 +1,6 @@
# Shared reporting and PromptKit v0.20.0 implementation plan
Status: implementation in progress; Stages 1–19 complete.
Status: implementation in progress; Stages 1–20 complete.
## Scope, authority, and execution
@@ -709,6 +709,11 @@ add a comparison callback, reload data, or implement list matching.
## Stage 20: Detailed validation and reached-scope aggregation
**Complete.** Detailed validation filters native findings and reports reached
scopes after acquisition stops, preserving independent diagnostics and causes.
Root, ckconfig, and ckprompt workspace suites passed with Go 1.27.0, including
failure, cancellation, source references, quiet mode, and output failure.
Complete Stage 7's validation aggregation using Stage 14's evidence. Add
`--details`, repeatable `--severity`, and repeatable `--code` on validation;
filters require detailed mode. Parse severity using native known severities;