Integrate custom signals, calibrators, and decision policies into the ek framework.
npx skills add https://github.com/thorwhalen/ek --skill ek-dev-add-signal
Please help me install this Agent Skill. Skill: ek-dev-add-signal Source: https://github.com/thorwhalen/ek/tree/main/skills/ek-dev-add-signal Command: npx skills add https://github.com/thorwhalen/ek --skill ek-dev-add-signal
This skill addresses the need to extend the reference-free quality estimation pipeline in the ek framework, allowing developers to integrate custom signals, calibrators, and decision policies for robust extraction validation.
Register a new custom signal component by implementing the Signal protocol and adding it to the ek registry for use in the estimate_quality pipeline.
High-intent search queries and answers about installing and using this skill.
To add custom validation signals to an OCR quality estimation pipeline, implement the Signal protocol and register your component within the ek registry system for integration into the estimate_quality workflow.
Reference-free quality estimation validates extraction and OCR outputs without requiring gold-standard references, using custom signals, calibrators, and decision policies to estimate data reliability.
Yes, you can implement Platt or Isotonic scaling calibrators and define selective Conformal or Cost-Sensitive decision policy gates to control validation logic within the ek framework.
You can add a regex-based verifier signal by implementing the Signal protocol to flag extracted dates that do not match a valid calendar format before the decision policy accepts the OCR output.
No, you do not need gold-standard references to calibrate extraction confidence scores, because the ek framework specifically supports reference-free quality estimation using intrinsic confidence signals and custom calibrators.
thorwhalenWrap external libraries into standardized Protocol metrics for the ek framework.
reaatechCalculate calibrated confidence scores and uncertainty estimates for classification predictions.
mahmoud20138Consolidate and weight trading strategy signals into a composite directional output.
HuskyDannyGenerate standalone HTML/SVG system architecture diagrams from text descriptions.
