redpanda

Deploy and tune Redpanda clusters with rpk, Schema Registry, and tiered storage.

14|1|Updated May 5, 2026
One-click install
npx skills add https://github.com/ivanshamaev/de-agent-skills --skill redpanda
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: redpanda
Source: https://github.com/ivanshamaev/de-agent-skills/tree/main/skills/redpanda
Command: npx skills add https://github.com/ivanshamaev/de-agent-skills --skill redpanda

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill helps you deploy and operate Redpanda as a Kafka-compatible streaming platform while configuring topics, clients, security, and tiered storage for reliable data engineering.

Core Features & Use Cases

  • Cluster deployment (Docker/Kubernetes/bare metal): Stand up single-node for development and multi-node clusters for staging/production.
  • Topic and consumer/group management with rpk: Create topics with retention/compaction settings, inspect leaders/replicas, manage consumer offsets and lag.
  • Performance and reliability tuning: Configure producer durability/throughput and consumer fetch/commit/rebalance behavior.
  • Tiered storage (Shadow Indexing): Offload historical segments to S3/GCS/ABS and control remote read/write/delete semantics.
  • Schema Registry and Kafka Connect compatibility: Use the built-in Schema Registry APIs and run standard Kafka Connect workers against Redpanda.
  • Monitoring and security: Enable SASL/SCRAM, TLS/mTLS, ACLs, and instrument metrics via Prometheus/Grafana.

Quick Start

Configure a 3-broker Redpanda cluster with Schema Registry and tiered storage, then create a topic using rpk with the appropriate retention and remote read/write settings.

Frequently Asked Questions about redpanda

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I deploy a Kafka-compatible streaming cluster on Kubernetes?▼

Deploy a Kafka-compatible streaming cluster on Kubernetes by setting up multi-node Redpanda brokers for staging and production, which reduces operational overhead compared to traditional partitioned log systems.

Does Redpanda work with standard Kafka Connect workers and clients?▼

Yes, Redpanda works with standard Kafka Connect workers and clients by providing Kafka API accessibility, allowing you to run existing Kafka-compatible data pipelines without modification.

How do I manage Kafka topics and consumer offsets using rpk?▼

Manage Kafka topics and consumer offsets using the rpk CLI to create topics with specific retention or compaction settings, inspect leaders and replicas, and monitor consumer lag.

Can I offload historical Kafka segments to S3 using tiered storage?▼

Yes, you can offload historical Kafka segments to S3, GCS, or ABS using Redpanda tiered storage, which controls remote read, write, and delete semantics to optimize storage costs.

How do I configure Schema Registry for Kafka-compatible streaming?▼

Configure Schema Registry for Kafka-compatible streaming by utilizing built-in Schema Registry APIs in Redpanda to manage data schemas and ensure compatibility across your producers and consumers.

What is the best way to secure a Kafka-compatible streaming platform?▼

Secure a Kafka-compatible streaming platform by enabling SASL/SCRAM authentication, configuring TLS/mTLS encryption, and applying ACLs to control broker access and restrict unauthorized topic operations.