API Reference
Runtime API
The hot path — the four endpoints every integration calls before and after the LLM, plus the bundle-fetch endpoint runtimes poll with ETags.
GET
/v1/bundles/latestFetch the active bundle for the runtime token's scope
POST
/v1/evaluate/inputEvaluate user input before calling the LLM
POST
/v1/evaluate/outputEvaluate an LLM response before returning it to the user
POST
/v1/evaluate/streamEvaluate streaming LLM output as it arrives
POST
/v1/evaluate/toolEvaluate a tool / function invocation