skills.rest
castorini
castoriniOFFICIAL
Explore all skills by this author →
WebsiteGitHub

castorini-pipeline

Coordinates end-to-end Castorini pipelines across rank_llm, ragnarok, nuggetizer, and umbrela.

2|2|Updated Mar 17, 2026
Search Tags:#workflow#evaluation#orchestration#pipeline#reproducibility#jsonl#castorini
One-click install
npx skills add https://github.com/castorini/castorini-skills --skill castorini-pipeline
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: castorini-pipeline
Source: https://github.com/castorini/castorini-skills/tree/main/skills/castorini-pipeline
Command: npx skills add https://github.com/castorini/castorini-skills --skill castorini-pipeline

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

Coordinating end-to-end Castorini pipelines across rank_llm, ragnarok, nuggetizer, and umbrela to streamline handoffs, ensure JSONL compatibility, and support reproducible experimentation across multiple repos.

Core Features & Use Cases

  • Cross-repo orchestration of multi-stage retrieval, generation, nuggetization, and evaluation workflows.
  • Standardized data formats and clear stage handoffs to improve reproducibility and traceability.
  • Use cases include coordinating pipelines for JSONL artifacts, evaluating end-to-end results, and reproducing multi-stage experiments.

Quick Start

Run the end-to-end Castorini pipeline across rank_llm, ragnarok, nuggetizer, and umbrela to kick off a multi-stage workflow.

Frequently Asked Questions about castorini-pipeline

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I coordinate end-to-end retrieval and evaluation workflows across multiple Castorini repositories?▼

Cross-repo orchestration coordinates stage transitions across rank_llm, ragnarok, nuggetizer, and umbrela to ensure seamless handoffs and reproducible multi-stage experiments.

What is the standard data format required for passing artifacts between pipeline stages?▼

JSONL artifacts serve as the standard data format for stage handoffs, ensuring JSONL compatibility and traceability across multi-stage retrieval, generation, nuggetization, and evaluation workflows.

How do I reproduce multi-stage experiments involving rank_llm and umbrela components?▼

Multi-stage experiments are reproduced by coordinating standardized data formats and robust stage dependencies across rank_llm, ragnarok, nuggetizer, and umbrela to ensure traceable handoffs.

Does this pipeline orchestration approach support cross-repo workflows with nuggetizer and ragnarok?▼

Cross-repo orchestration supports workflows involving nuggetizer and ragnarok by managing stage transitions and evaluating end-to-end results across multiple components.

What are the limitations of orchestrating multi-stage retrieval and generation pipelines?▼

Orchestration is limited to cross-repo workflows involving JSONL artifacts, stage transitions, and evaluation pipelines across the specified Castorini components, requiring standardized data formats for compatibility.

Related Skills

Explore More Data & Analytics Skills→
castorinicastorini
2

castorini-onboard

Configure Castorini Python repos with uv or pip and run smoke tests.

Official
Advanced
Wenwen555Wenwen555

research-refine-pipeline

Chain research refinement and experiment planning into an end-to-end pipeline.

Community
Advanced
castorinicastorini
2

castorini-release

Automate PyPI release workflows for Castorini projects with version bumps and publishing.

Official
Advanced
0xRayAI0xRayAI

processor-pipeline

Orchestrate multi-stage data processing pipelines and automated workflow execution.

Official
Intermediate