Four-product conformance: live run, 2026-10-04
These are the reports from cainstudio conform (SDK 0.6.0). Each run makes 32 real operations and attacks through the public API against a test tenant, covering RIG, OpenShell, MemVault, SCITT and cross-tenant isolation. Every report carries a SHA-256 digest you can recompute.
Result: 32/32 on both gateway instances and on cainstudio.online, mcpgate.online and clawx.click, including a run from a clean pip install. See SUMMARY.json.
Failures kept on record
- First run, 31/32. This was a bug in the test, not in the product. Another tenant's revoke was refused with the same answer a non-existent id gets, and the agent stayed active. The check expected a different status code and was rewritten.
- clawx.click run 1: one ERROR. A network timeout under heavy host load. It was reported as PARTIAL, not as a pass. Two reruns gave 32/32.
Run it yourself
pip install --extra-index-url https://cainstudio.online/simple cainstudio==0.6.0 export CAIN_API_KEY=... # a key of the tenant to test cainstudio conform --out conformance.json
This is a self-run test on test tenants, not a certification or an independent audit. A PASS means the property held for these inputs at this time.