agentsclimarketplace

Kafka topic designer

Skill a5c-ai/babysitter/library/specializations/data-engineering-analytics/skills/kafka-topic-designer

Babysitter enforces obedience on agentic workforces and enables them to manage extremely complex tasks and workflows through deterministic, hallucination-free self-orchestration

Install
npx -y skills add a5c-ai/babysitter --skill kafka-topic-designer

Assembled from the repository path, not quoted from the project. Check it against their README if it does not work.

What its author says it does

Copied from the file, not written here

Designs and optimizes Apache Kafka topics and configurations

SKILL.md

2.2 KB, as published. Nobody here has run it

Kafka Topic Designer

Overview

Designs and optimizes Apache Kafka topics and configurations. This skill provides expertise in topic architecture, partitioning strategies, and producer/consumer configuration for optimal streaming performance.

Capabilities

  • Topic naming convention design
  • Partition strategy optimization
  • Replication factor recommendations
  • Retention policy configuration
  • Compaction strategy design
  • Schema registry integration
  • Consumer group design
  • Throughput capacity planning
  • Security configuration (ACLs, encryption)

Input Schema

{
  "requirements": {
    "throughputMBps": "number",
    "messageSize": "number",
    "retentionDays": "number",
    "orderingRequirements": "string"
  },
  "existingTopics": ["object"],
  "clusterConfig": "object"
}

Output Schema

{
  "topicDesign": {
    "name": "string",
    "partitions": "number",
    "replicationFactor": "number",
    "configs": "object"
  },
  "schemaDefinition": "object",
  "producerConfig": "object",
  "consumerConfig": "object"
}

Target Processes

  • Streaming Pipeline
  • ETL/ELT Pipeline (CDC)
  • Feature Store Setup

Usage Guidelines

  1. Define throughput and latency requirements
  2. Specify message size and retention needs
  3. Document ordering requirements (per-partition, global)
  4. Include existing topic configurations for consistency

Best Practices

  • Use consistent naming conventions across all topics
  • Size partitions based on consumer parallelism needs
  • Configure appropriate retention for compliance and replay scenarios
  • Implement schema registry for schema evolution
  • Set up proper ACLs for security

Keep looking

Skills are one crate of 328,083. Ordering is by how many stacks a row turns up in, so the top of any crate is what has actually been picked rather than what has the most stars.