Partition reassignment: reasons, risks, and safeguards
I reassign partitions when replica placement no longer meets operational goals, such as balancing disk usage, decommissioning a broker, improving rack-aware placement, or addressing capacity changes. Reassignment changes which brokers host replicas; it is not the same as increasing a topic's partition count. The main risk is replica data movement consuming network and disk resources while production traffic continues. I review the target layout, validate capacity, throttle movement where supported, and monitor client impact.
Common reasons include balancing storage and replicas, removing a broker, improving rack awareness, and adapting to capacity changes.
Check destination disk headroom, network capacity, broker health, replication factor, rack placement, and replica sizes before execution.
Replica movement can increase disk I/O and network traffic, elevate request latency, and temporarily increase replication lag.
Use a reviewed plan and small batches. Apply throttles supported by the installed Kafka version and adjust based on observed impact.
Monitor under-replicated partitions, ISR changes, disk utilization, network throughput, produce/fetch latency, and consumer lag.
Common misconception: reassignment is only a metadata change. Existing replica data often needs to be copied; command options vary by Kafka version.
0-2 years experience
2-5 years experience
5-8 years experience
8+ years experience