run-guardian-prod-benchmarks

Run and report production GUARDIAN benchmarks using the distributed ECS client harness.

Updated Aug 20, 2026
One-click install
npx skills add https://github.com/hduoc2003/leviathan-guardian --skill run-guardian-prod-benchmarks-hduoc2003
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: run-guardian-prod-benchmarks
Source: https://github.com/hduoc2003/leviathan-guardian/tree/main/.agents/skills/run-guardian-prod-benchmarks
Command: npx skills add https://github.com/hduoc2003/leviathan-guardian --skill run-guardian-prod-benchmarks-hduoc2003

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve? Running credible production benchmarks against the GUARDIAN server requires coordinating ephemeral ECS/Fargate workers, selecting the right signer and workload profiles, cleaning up benchmark-owned data, and interpreting throughput and latency results correctly. This Skill encodes that entire workflow so benchmark runs are reproducible, safe, and consistently reported. ## Core Features & Use Cases - Guided benchmark execution: Walks through readiness checks, local preflight, profile selection, and the canonical run-prod-benchmark-ecs.sh execution path for ECDSA, Falcon, and mixed gRPC workloads. - Cleanup and artifact validation: Verifies cleanup-manifest.json completion, run reports, and endpoint health after each run so no benchmark-owned data or temporary AWS resources linger. - Result interpretation and reporting: Applies documented rules for throughput, latency percentiles, state_conflict caveats, shard loss, and 500 TPS sizing estimates, following the established report structure. - Use Case: An engineer needs to know how many GUARDIAN tasks are required for a 500 TPS target. The Skill selects the Falcon+ECDSA mixed profile, runs 16 ECS workers against prod, validates cleanup, and produces a report with throughput, p50/p95/p99 latency, and a sizing estimate. ## Quick Start Use the run-guardian-prod-benchmarks skill to execute the falcon-ecdsa-mixed-burst-scale profile against the prod GUARDIAN endpoint and summarize the throughput and latency results.

Frequently Asked Questions about run-guardian-prod-benchmarks

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run production benchmarks against the GUARDIAN server?▼

Run the repository script ./scripts/run-prod-benchmark-ecs.sh with a profile from benchmarks/prod-server/profiles and a worker count, after passing the cargo preflight check. The script builds the image, launches ephemeral Fargate workers, aggregates results, and cleans up.

Which benchmark profile should I use for mixed signer workloads?▼

Use falcon-ecdsa-mixed-burst-scale.toml for production-like traffic with a 50% Falcon and 50% ECDSA signer mix at a 1 push_delta to 4 get_state ratio. Use the single-signer mixed profiles when isolating one signature scheme.

How do I estimate GUARDIAN tasks needed for 500 TPS?▼

Divide 500 by the run's push_delta/s multiplied by 0.70 for 30% headroom, then round up. The April 2026 mixed Falcon+ECDSA run at 352 push_delta/s implied 3 GUARDIAN tasks for the 500 TPS reference target.

Why do benchmark runs show state_conflict failures?▼

Mostly state_conflict failures mean the workload is reusing accounts too aggressively, so the run measures account eligibility limits rather than the server's true write ceiling. Do not report that number as the absolute push_delta/s limit.

What are the limitations of these GUARDIAN benchmark profiles?▼

The kept profiles are burst-style admission tests with unique benchmark-owned accounts that retire after one successful push_delta. They measure admission capacity and planning signals, not sustained long-lived account reuse, and local single-process runs are unsupported.