logprob-prefill-analysis

What problem does it solve?

Documents and executes the full prefill sensitivity analysis workflow to assess model susceptibility to reward hacking via exploit-oriented prefills.

Core Features & Use Cases

• End-to-end pipeline for token-based and logprob-based metrics, including trajectory analysis, KL divergence, and extrapolation across checkpoints.
• Useful for evaluating how different prefill levels influence exploitability and comparing across exploit types.
• Case example: run evaluation across checkpoints to determine when a model becomes easily exploitable and compare metrics to identify early warning signals.

Quick Start

Run the full prefill sensitivity evaluation against your checkpoints using the provided scripts.