Benchmarks
Public benchmark surfaces that show how OSuite validates runtime coverage, approval behavior, and evidence quality.
Generated
2026-04-26T09:14:06.058Z
Overall status
Ready with noted limits
Target studio
https://studio.osuite.ai
Runtime rows
4
Baseline p95 ceiling
2593.34 ms
Burst p95 ceiling
920.41 ms
Soak errors
0%
Plugin signatures
8
Use this page when
Read this page when you need the public benchmark view behind a readiness or procurement claim.
What belongs here
- latency and saturation indicators
- runtime-family coverage
- approval-path behavior
- evidence and export completeness
- publication-safe aggregate validation
How to read the matrices
| Matrix | What it clarifies |
|---|---|
| Runtime family coverage | which execution shapes are strong, partial, or provisional |
| Approval path behavior | whether human review still behaves correctly under pressure |
| Partner compatibility | whether curated partner packs integrate cleanly into the control layer |
| Evidence completeness | whether exports still reflect the governed decision rather than disconnected logs |
Who reads this page
| Reader | What they look for |
|---|---|
| Platform operators | regression signals and saturation points |
| Security review | signs that control layers still behave under load |
| Buyers | evidence that public claims are not decorative |
What this page does not publish
This public benchmark view reports aggregates. It does not publish the protected scenario corpus, exact policy thresholds, exact heuristic weights, or connector-specific decision rules.
Read next
Live benchmark artifact
Baseline load
| Target | Success | p50 | p95 | p99 | Max |
|---|---|---|---|---|---|
| studio.health | 100% | 206.52 ms | 2593.34 ms | 3518.48 ms | 3518.48 ms |
| studio.status_json | 100% | 308.59 ms | 927.31 ms | 2181.24 ms | 2181.24 ms |
| docs.system_card | 100% | 218.47 ms | 938.05 ms | 1655.01 ms | 1655.01 ms |
| readiness.overview | 100% | 205.89 ms | 629.82 ms | 916.42 ms | 916.42 ms |
Burst concurrency
| Target | Success | p50 | p95 | p99 | Max |
|---|---|---|---|---|---|
| studio.health | 100% | 207.79 ms | 920.41 ms | 1689.09 ms | 1920.75 ms |
| docs.enterprise_assurance | 100% | 220.12 ms | 839.07 ms | 1087.17 ms | 1506.09 ms |
| readiness.benchmarks | 100% | 210.23 ms | 692.15 ms | 929.13 ms | 1623.75 ms |
Runtime coverage matrix
| Runtime family | Adapter mode | Import | Heartbeat | Action outcome | Visible in Agents |
|---|---|---|---|---|---|
| framework_sdk | inline_sdk | Yes | Yes | governed_action_created | Yes |
| openai_compatible | gateway | Yes | Yes | governed_action_created | Yes |
| managed_agent_platform | bridge | Yes | Yes | governed_action_created | Yes |
| observer_import | observer | Yes | Yes | governed_action_created | Yes |
Plugin compatibility matrix
| Plugin | Type | Tier | Signature verified | Scopes | Hook points |
|---|---|---|---|---|---|
| OSuite Identity Authority | identity bridge | official | Yes | 4 | 4 |
| OSuite Zero-Trust Gateway | identity bridge | official | Yes | 5 | 4 |
| OSuite Runtime Security | security pack | official | Yes | 4 | 4 |
| OSuite Verifiable Trust | trust wallet provider | official | Yes | 5 | 4 |
| OSuite ESG Intelligence | vertical pack | official | Yes | 3 | 3 |
| OSuite Enterprise Governance | compliance pack | official | Yes | 4 | 4 |
| OSuite MCP Perimeter | security pack | curated partner | Yes | 3 | 3 |
| OSuite Commerce Trust | trust wallet provider | curated partner | Yes | 3 | 3 |
Boundary checks
| Check | Expectation | Observed | Pass |
|---|---|---|---|
| Studio connect redirects to docs | 307/308 redirect to docs /api-sdk | 307 → https://docs.osuite.ai/api-sdk | Yes |
| Docs API SDK surface renders | HTTP 200 from docs API SDK page | 200 | Yes |
| Status surface renders | HTTP 200 from public status page | 200 | Yes |
| Readiness surface renders | HTTP 200 from readiness overview | 200 | Yes |
| Studio roadmap alias redirects to readiness | 307/308 redirect to readiness roadmap | 307 → https://readiness.osuite.ai/roadmap | Yes |
| Workbench remains protected | Redirect to login or security-check for unauthenticated access | 307 → /security-check?redirect=%2Fmission-control | Yes |
| Readiness artifact API publishes current artifact | HTTP 200 and artifact payload | 200 | Yes |