backpressure-patterns - Design backpressure for stable data pipelines
Provides patterns for controlling flow, bounding concurrency, monitoring queue pressure, and stabilizing systems under load.
Tags
Updated: 2026-09-29backpressureflow controlconcurrencymessage queuesdata pipelinesconsumer lagGoKafkaRabbitMQPrometheus
Capabilities
Typical Inputs
What this skill does
- Choose backpressure strategies
- Bound Go concurrency
- Configure worker pools
- Control queue consumption
- Monitor consumer lag
- Propagate pipeline backpressure
- Instrument channel depth
- Define overflow behavior
Inputs
- Data flow description
- Load symptoms
- Data volumes
- Consumer capacity
- Producer behavior
- Pipeline stages
Outputs
- Backpressure design guidance
- Go concurrency patterns
- Queue configuration examples
- Pipeline implementation examples
- Lag monitoring configurations
- Alerting recommendations
Requirements
- Go runtime for Go examples
- Kafka or RabbitMQ for queue-specific patterns
- Prometheus for metrics examples
- Permission to configure consumers and monitoring