← ClaudeAtlas

kafka-consumer-testslisted

Use whenever Kafka producers or consumers need tests, in KafkaJS, kafka-go or Spring Kafka: a real broker via Testcontainers, offset commits, consumer-group rebalances, at-least-once vs exactly-once transactions, idempotent producers and dead-letter topics.
testland/qa · ★ 13 · Testing & QA · score 80
Install: claude install-skill testland/qa
# kafka-consumer-tests ## Overview Kafka uses consumer-owned committed offsets as its delivery primitive (unlike SQS visibility-timeout, RabbitMQ ack/nack, or BullMQ job-state) - every test must control where the read position is. This skill covers that model: offset management, consumer-group rebalance, at-least-once vs exactly-once (EOS / transactions), idempotent producer, and dead-letter routing across KafkaJS (Node.js), kafka-go (Go), and Spring Kafka (Java). ## Step 1 - Spin up Kafka with Testcontainers Per [testcontainers.com/modules/kafka][tc-kafka]: [tc-kafka]: https://testcontainers.com/modules/kafka/ **Node.js / TypeScript** ```bash npm install @testcontainers/kafka --save-dev ``` ```typescript import { KafkaContainer } from '@testcontainers/kafka'; let container: Awaited<ReturnType<KafkaContainer['start']>>; beforeAll(async () => { container = await new KafkaContainer('confluentinc/cp-kafka:7.2.2').start(); }); afterAll(async () => { await container.stop(); }); function brokers(): string[] { return [`${container.getHost()}:${container.getMappedPort(9093)}`]; } ``` Per [node.testcontainers.org/modules/kafka][node-tc-kafka], the mapped port is `9093`; retrieve the host with `container.getHost()`. [node-tc-kafka]: https://node.testcontainers.org/modules/kafka/ **Java (Maven)** Per [java.testcontainers.org/modules/kafka][java-tc-kafka]: [java-tc-kafka]: https://java.testcontainers.org/modules/kafka/ ```xml <dependency> <groupId>org.testcont