Document invocation observation and cost reporting
This commit is contained in:
@@ -173,6 +173,10 @@ otherwise usable content. Existing common count decoding remains strict.
|
||||
OpenRouter's `usage.cost` is an optional USD amount; malformed or non-finite
|
||||
amounts are ignored without invalidating content. The generic and vLLM
|
||||
providers do not interpret that field.
|
||||
vLLM prompt-token details depend on server configuration, including
|
||||
`--enable-prompt-tokens-details`; reasoning details depend on a configured
|
||||
reasoning parser. Servers without these details remain usable. vLLM cache
|
||||
writes describe local prefix-cache creation, not a billable write charge.
|
||||
|
||||
Each common token field retains whether the provider reported a
|
||||
non-null integer, including zero. Omitted and `null` fields are unknown for
|
||||
|
||||
Reference in New Issue
Block a user