confluent-kafka-developer

Designs, implements, and reviews Kafka producers, consumers, Streams, Connect, ksqlDB, and Flink applications.

1|Updated Jul 22, 2026
One-click install
npx skills add https://github.com/thititongumpun/skills --skill confluent-kafka-developer-thititongumpun
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: confluent-kafka-developer
Source: https://github.com/thititongumpun/skills/tree/main/skills/confluent-kafka-developer
Command: npx skills add https://github.com/thititongumpun/skills --skill confluent-kafka-developer-thititongumpun

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Kafka application work fails at runtime when config keys, SQL syntax, or API surfaces are written from stale memory, and subtle pitfalls like non-co-partitioned joins or missing DLQs silently corrupt data pipelines. This Skill grounds every answer in official Confluent and Apache documentation and applies a checklist of known pitfalls to design, implementation, and review tasks. ## Core Features & Use Cases - Docs-grounded research workflow: Retrieves from docs.confluent.io, kafka.apache.org, Apache Flink docs, and context7 with deliberate version pinning, refusing unofficial sources. - Multi-surface implementation: Writes producer, consumer, Kafka Streams, Connect, ksqlDB, and Flink code/config with delivery semantics, schema compatibility, and error handling matched to the stated guarantee. - Design and diagramming: Covers topic naming, partitioning, key design, and retention choices, and produces data-flow diagrams via the archify skill or Mermaid fallback. - Use Case: Ask it to write an exactly-once producer in Java and it will verify current config keys against the docs, set acks/idempotence correctly, and leave a Testcontainers round-trip check proving it runs. ## Quick Start Ask the agent to design a Kafka consumer with a dead-letter queue for poison messages and verify the offset-commit strategy against the official docs.

Frequently Asked Questions about confluent-kafka-developer

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I write a Kafka producer with exactly-once semantics?▼

Set enable.idempotence=true with acks=all and matching min.insync.replicas, configure the serializer and Schema Registry, and choose a deliberate partition key. The skill verifies current config keys against official docs before writing the code.

How do I handle poison messages in a Kafka consumer?▼

Add a dead-letter-queue path so one bad record does not block the whole partition, and match your offset-commit strategy to the processing guarantee, committing after processing for at-least-once. The skill checks these in every consumer implementation and review.

Why does my ksqlDB or Kafka Streams join return no results?▼

Joins on mismatched keys or partition counts are not co-partitioned, so the join silently returns nothing instead of erroring. Verify both sides share the same key and partition count before joining.

Does this skill cover Confluent Cloud cluster provisioning and RBAC?▼

No, provisioning, RBAC, and networking belong to the confluent-kafka-admin skill. This skill covers the application side: client connection config, Schema Registry credentials, and Cloud Flink or ksqlDB usage.

What sources does the skill use for Kafka configuration answers?▼

Only official documentation: docs.confluent.io, kafka.apache.org, docs.ksqldb.io, Apache Flink docs, and official client library docs, including context7 with deliberate version pinning. Forums, blogs, and Stack Overflow are explicitly excluded.

When should I use Flink versus ksqlDB versus Kafka Streams?▼

ksqlDB suits SQL-declared streaming with CTAS-materialized tables for pull queries, Flink fits event-time processing needing watermarks and state control, and Streams fits JVM application code. The skill weighs trade-offs and commits to a recommendation with rationale.