SentinelForge™ · by Ultrec AI Inc
An evaluator kit for AI agents.
SentinelForge is an SDK and CLI that grades and gates AI agents. It is not a chat AI. You bring your own model keys, and it never trains model weights.
Download SentinelForge (.zip) Download explainer video Get notified
v0.1.0 · free · MIT · AS IS · all four modules in the zip · Python 3.9+ · wheel
Four modules
Grade, gate, score, compare.
Sentinel · free
Blind cross-family grading: a model from a different family grades the work without knowing who did it.
Forge · free
Gates for skills and memory, so changes are checked before they are promoted, and can be rolled back.
Scorecard · free
Scores built from your agents’ event logs.
Baseline · free
Frozen, hashed task sets to measure against over time.
Free
All four modules are free.
Sentinel, Forge, Scorecard, and Baseline are all included in the v0.1.0 download.
Not a chat AI
It grades and gates. It doesn’t chat or act as an agent itself.
Bring your own keys
Use your own model provider keys. We never see them.
No weight training
SentinelForge measures agents. It does not train or change model weights.
SentinelForge™ by Ultrec AI Inc — product details are working drafts.