TIL one of those things that is obvious in hindsight:
Kafka doesn't use consistent hashing primarily because of its immutable nature, where redistributing keys is meaningless and breaks many other assumptions people might make. This is the gist of why partition rebalancing is such a PITA when operating Kafka.