How to copy a topic from a kafka cluster to another kafka cluster? -


one way kafka documentation shows through kafka.tools.mirrormaker can trick. however, need copy topic (say test 1 partition) (its content , meta data) production environment development environment connectivity not there. simple file transfer between environments though. question: if move *.log , .index folder test-0 destination kafka cluster, enough? or there more need meta data , zookeeper-related data need move too?

just copying log , indexes not suffice - kafka stores offsets , topic meta data in zookeeper. mirrormaker quite simple tool, spawns consumers source topic producers target topic , runs until consumers consumed source queue. can't find simpler process migrate topic.


Comments

Popular posts from this blog

c - Bitwise operation with (signed) enum value -

xslt - Unnest parent nodes by child node -

YouTubePlayerFragment cannot be cast to android.support.v4.app.Fragment -