signal-validation

Validate trading signals with Wilson CI and binomial tests in Rust.

2|1|Updated Oct 4, 2025
One-click install
npx skills add https://github.com/andrew-starosciak/deep-algo --skill signal-validation
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: signal-validation
Source: https://github.com/andrew-starosciak/deep-algo/tree/main/.claude/skills/signal-validation
Command: npx skills add https://github.com/andrew-starosciak/deep-algo --skill signal-validation

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This skill provides a structured framework to validate trading signals using statistical methods before deployment, reducing the risk of live losses due to false signals.

Core Features & Use Cases

  • Hypothesis testing: Apply p-values to assess signal profitability with defined thresholds.
  • Confidence intervals: Use Wilson score intervals to quantify win-rate uncertainty.
  • Go/No-Go criteria: Predefine development and production readiness criteria (p-value, sample size, EV) to guide decisions.
  • Backtest & Walk-Forward: Evaluate signals across historical and out-of-sample data to detect overfitting.

Quick Start

Review the signal's data, run the validation routines to compute Wilson CI, binomial p-value, information coefficient, and conditional probability, then decide Go/No-Go based on predefined criteria.

Frequently Asked Questions about signal-validation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I statistically validate a trading signal before live deployment?▼

To statistically validate a trading signal, you can apply hypothesis testing and confidence intervals to historical trade data to compute p-values and assess profitability before live deployment.

What is a Wilson confidence interval and how does it quantify win-rate uncertainty?▼

A Wilson confidence interval quantifies win-rate uncertainty by calculating a score interval around your signal's historical trade outcomes, helping you determine if observed profitability is statistically significant or due to chance.

How do I use walk-forward analysis to detect overfitting in trading strategies?▼

Walk-forward analysis detects overfitting by evaluating trading signals across out-of-sample data, ensuring that the predictive power and performance outcomes hold up beyond the initial historical backtest data.

How do I set Go or No-Go criteria for production trading readiness?▼

You set Go/No-Go criteria by predefining thresholds for p-values, sample sizes, and expected value, then using binomial tests and conditional probability assessments to decide if a signal meets production readiness.

Does signal validation require any external statistical libraries or dependencies?▼

No external statistical libraries are required because this signal validation framework implements standard statistical routines natively in Rust, computing p-values and confidence intervals without any dependencies.

What is information coefficient and how does it measure trading signal predictive power?▼

Information coefficient measures trading signal predictive power by correlating predicted signal values with actual historical performance outcomes, providing a quantitative assessment of the signal's forecasting ability.