Migrate to AutoMQ Cloud with full Kafka compatibility. Adaptive elastic scaling, batch migration, and cost-efficient cloud-native infrastructure for reliable data synchronization.
AutoMQ is a next-generation Kafka distribution redesigned based on cloud-native principles and compatible with Apache Kafka®. This article explains the Kafka Linking feature provided by AutoMQ and how to use Kafka Linking to migrate business from Apache Kafka® or other Kafka distributions to AutoMQ.
AutoMQ Cloud provides the Kafka migration tool Kafka Linking, which supports migration from Apache Kafka® or other Kafka distributions to AutoMQ without application changes.The Kafka Linking migration tool has the following advantages:
Non-Stop Migration: Unlike MirrorMaker2, which requires client downtime for switching, Kafka Linking is equipped with a built-in traffic proxy component that ensures the switching process for Producers does not require downtime.
Byte-to-byte replication: Unlike MirrorMaker2, which changes offsets during replication, Kafka Linking preserves partition offsets when it replicates source data to the target. Applications such as Flink jobs that restore offsets from checkpoints, savepoints, or external stores must still verify that every saved offset is readable on the target. See Kafka Linking best practices for the validation procedure.
Synchronized Consumption Progress: Kafka Linking supports synchronized source cluster consumption progress, allowing consumers to resume consumption from the target cluster post-migration with consistent position information.
Elastic Scaling on Demand: Kafka Linking requires no separate deployment and scales with the AutoMQ cluster on demand, reducing operational complexity during migration.
High Kafka Compatibility: Kafka Linking supports most historical versions of Apache Kafka (version >=0.11) as well as other commercial editions, allowing transitions to AutoMQ.
A Kafka Link is a data synchronization and proxy task for a set of Topics from an external Apache Kafka cluster to an AutoMQ Kafka instance, including the configuration required for data synchronization, real-time operational status, and traffic proxy control.
The Source Cluster is an abstract configuration defined in Kafka Linking for the migration source cluster. The Source Cluster is described by AutoMQ’s console-provided Kafka integration, containing configuration information such as the source cluster’s access point, ACL rules, alias, etc.
The Sink Cluster is an abstract configuration defined in Kafka Linking for the migration target cluster. The Sink Cluster specifically refers to an AutoMQ instance (Kafka Linking supports only AutoMQ instances as Sink Clusters), containing configuration information such as the target cluster’s access point, ACL rules, alias, etc.
Mirror Topic is the basic unit used in Kafka Linking to synchronize and migrate a Topic from the source cluster to the target cluster. Each Mirror Topic corresponds to a specific Topic in the source cluster and serves as the unique representation of that Topic in the target cluster.
Source Topic is the expression of the Topic in the source cluster for Kafka Linking. In each Kafka Link, the Source Topic and Mirror Topic correspond one-to-one.
Kafka Linking supports copying consumption progress information from the source cluster’s Consumer Group and synchronizing it to the target cluster. Users can specify the Source Cluster’s Consumer Group and configure it to the Sink Cluster’s designated Consumer Group.
Unlike MirrorMaker2, which implements data synchronization based on Connectors, the Kafka Linking migration tool reconstructs two paths: Byte-to-Byte replication path and Producer proxy path:
Byte-to-Byte Replication Path: This is used for synchronizing data from the Source Cluster to the Sink Cluster, ensuring data integrity and position consistency.
Producer Proxy Path: Traditional MirrorMaker2 requires Producers to be completely shut down before switching to the target cluster to avoid data disorder caused by simultaneous writing to both clusters. AutoMQ Kafka Linking provides a Producer proxy path that supports traffic proxying back to the source cluster during the switching process and subsequent unified switching, enabling zero-downtime switching.
Kafka Linking’s data synchronization links can achieve the following effects:
Topic partition numbers are completely consistent.
Message full synchronization, with offsets exactly aligned with the source cluster.
Consumer offsets are synchronized; the specific partitions’ consumer offsets for specific Consumer Groups in the source cluster are fully synchronized to the target cluster, maintaining consistency.
To understand the background and functionality of Kafka Linking, it is recommended to follow this sequence:
Prerequisites sorting: Identify the characteristics of the source cluster and business relationships that need migration, plan the migration batches, and check prerequisite resources. Prerequisites▸
Review migration best practices: Create a runbook for each batch based on endpoints, client types, offset sources, and rollback requirements. Kafka Linking best practices▸
Execute the migration plan: After completing the prerequisite review, follow the migration plan step by step. Executing migration▸
Was this page helpful?
{"docsConfig":{"theme":"mint","$schema":"https://mintlify.com/docs.json","name":"AutoMQ Documentation","colors":{"primary":"#2449D4","light":"#2449D4","dark":"#2449D4"},"logo":{"light":"https://mintcdn.com/automq/s9vNxeyMGZ1r1DRV/logo/automq-black.svg?fit=max\u0026auto=format\u0026n=s9vNxeyMGZ1r1DRV\u0026q=85\u0026s=bcc93ae74a4143ae2b7602497b7b354b","dark":"https://mintcdn.com/automq/s9vNxeyMGZ1r1DRV/logo/automq-white.svg?fit=max\u0026auto=format\u0026n=s9vNxeyMGZ1r1DRV\u0026q=85\u0026s=209c336f52b4021f2e991e10d07613ae"},"favicon":"https://mintcdn.com/automq/s9vNxeyMGZ1r1DRV/logo/favicon.svg?fit=max\u0026auto=format\u0026n=s9vNxeyMGZ1r1DRV\u0026q=85\u0026s=d736b0934a674250c9dbe95a5f642fb9","appearance":{"default":"light","strict":true},"navbar":{"links":[{"icon":"github","href":"https://github.com/automq/automq","label":"Github"}],"primary":{"type":"button","label":"automq.com","href":"https://www.automq.com"}},"footer":{"socials":{"slack":"https://go.automq.com/slack","telegram":"https://t.me/+VgqhN9wqBGIzYmU1","x":"https://x.com/AutoMQ_Lab","github":"https://github.com/automq/automq","linkedin":"https://linkedin.com/company/automq"}},"icons":{"library":"lucide"},"integrations":{"ga4":{"measurementId":"G-4F3BX9DFG9"}},"contextual":{"options":["copy","view","chatgpt","claude","perplexity","mcp","cursor","vscode"],"display":"header"},"styling":{"latex":true},"navigation":{"global":{"anchors":[{"anchor":"Github","icon":"github","href":"https://github.com/automq/automq"},{"anchor":"Slack","icon":"slack","href":"https://go.automq.com/slack"},{"anchor":"Telegram","icon":"Telegram","href":"https://t.me/+VgqhN9wqBGIzYmU1"},{"anchor":"Blog","icon":"newspaper","href":"https://www.automq.com/blog"}]},"languages":[{"language":"en","href":""},{"language":"cn","href":"zh/automq/what-is-automq/overview"}]}},"deployment":{"deploymentMetadataValue":{"subdomain":"automq","hasAudioNarration":false,"actualSubdomain":"automq","customDomains":["docs.automq.com"],"gitSource":{"type":"github","owner":"automq","repo":"sitebox","deployBranch":"main","contentDirectory":"docs","isPrivate":true,"mountPath":"","label":""},"chroma":{"liveDeploymentHistoryId":"6ad735a93eabd17c66250d4b","collectionId":"54500605-320d-46b3-b896-c0d1e0d9a573","schemaVersion":"v3","latestBuiltDeploymentHistoryId":"6ad735a93eabd17c66250d4b"},"feedback":{"thumbs":true,"edits":false,"issues":false},"entitlements":{"AI_CHAT":{"status":"DISABLED"},"WEB_MCP":{"status":"DISABLED"},"NARRATION":{"status":"DISABLED"}},"buildId":"6ad735a93eabd17c66250d4b","clientVersion":"0.0.3902","searchFilterCounts":[{"language":"cn","tag":"AutoMQ BYOC","count":124},{"language":"en","tag":"AutoMQ BYOC","count":113},{"language":"en","tag":"AutoMQ Open Source","count":61},{"language":"cn","tag":"AutoMQ Open Source","count":57},{"language":"en","tag":"Kafka Connect","count":48},{"language":"cn","tag":"Kafka Connect","count":48},{"language":"en","tag":"Sink Connectors","count":26},{"language":"cn","tag":"Sink Connectors","count":26},{"language":"en","tag":"Source Connectors","count":19},{"language":"cn","tag":"Source Connectors","count":19},{"language":"cn","tag":"快速开始","count":16},{"language":"en","tag":"Integrations","count":14},{"language":"en","tag":"Getting Started","count":12},{"language":"cn","tag":"生态集成","count":12},{"language":"en","tag":"Architecture","count":11},{"language":"cn","tag":"管理环境","count":11},{"language":"cn","tag":"技术架构","count":11},{"language":"cn","tag":"安装 BYOC 环境","count":9},{"language":"en","tag":"Eliminate Inter-Zone Traffics","count":8},{"language":"en","tag":"Manage Environments","count":8}]},"assistantConfig":{"deflection":{"enabled":true,"email":"support@automq.com"}},"hasChatPermissions":false,"hasWebMcpPermissions":false,"toggles":[{"name":"kill-isr","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"agent-mintlify-slack","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"editor-v7-file-tree","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"agent-integrations-settings","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automations-pr-grouping","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"custom-prefix","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"analytics-v7","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"user-flows-analytics","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"no-publish-flow","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-onboarding","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"llms-txt-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"pause-universal-search-reconcile","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"snapshot-serving-live","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"stripTemperatureMiddleware","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"per-site-search-delta","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"support-platform-pylon-zendesk","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"editor-branches-v2-autocommit","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"editor-branches-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"snapshot-serving","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"instant-rollback","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"granular-notifications-server","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"granular-notifications","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"editor-private-page-search","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automations-fable","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"fixed-ai-action-pricing","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automation-resolve-merge-conflict","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"scoped-publishing","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"mintql","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"page-level-analytics","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"teamspace","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"editor-version-history-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"vite-origin","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"editor-nav-generations","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workspace-projects","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"assistant-v5","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"byok-sep-25","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"revalidation-jwt","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"editor-agent-model-picker","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"client-snapshot-docs-config","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"hobby-abuse-scan","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"dashboard-inbox","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false}],"isAtlas":false,"googleFontsInlined":false},"customCss":[{"filePath":"static/style.css","content":"#content-area{word-break:keep-all;white-space:normal;overflow-wrap:normal}header div:nth-child(2) p{display:none}.emphasize-placeholder{background-color:#e0f2ff;border:1px solid #2d64eb;padding:2px 6px;border-radius:4px;font-family:monospace;cursor:pointer;display:inline-flex;align-items:center}.emoji-flip{display:inline-block;transform:scaleX(-1);font-size:.8em;margin-left:4px}"}],"page":{"pagePath":"automq-cloud/migrate-to-automq/overview","slug":"/automq-cloud/migrate-to-automq/overview","pageMetadata":{"title":"Overview","description":"Migrate to AutoMQ Cloud with full Kafka compatibility. Adaptive elastic scaling, batch migration, and cost-efficient cloud-native infrastructure for reliable data synchronization.","href":"/automq-cloud/migrate-to-automq/overview"},"description":{"compiledSource":"\"use strict\";\nconst {jsx: _jsx} = arguments[0];\nconst {useMDXComponents: _provideComponents} = arguments[0];\nfunction _createMdxContent(props) {\n const _components = {\n p: \"p\",\n ..._provideComponents(),\n ...props.components\n };\n return _jsx(_components.p, {\n children: \"Migrate to AutoMQ Cloud with full Kafka compatibility. Adaptive elastic scaling, batch migration, and cost-efficient cloud-native infrastructure for reliable data synchronization.\"\n });\n}\nfunction MDXContent(props = {}) {\n const {wrapper: MDXLayout} = {\n ..._provideComponents(),\n ...props.components\n };\n return MDXLayout ? _jsx(MDXLayout, {\n ...props,\n children: _jsx(_createMdxContent, {\n ...props\n })\n }) : _createMdxContent(props);\n}\nreturn {\n default: MDXContent\n};\n","frontmatter":{},"scope":{}},"pageType":"default","mdx":{"mdxSource":{"compiledSource":"\"use strict\";const{Fragment:_Fragment,jsx:_jsx,jsxs:_jsxs}=arguments[0];const{useMDXComponents:_provideComponents}=arguments[0];function _createMdxContent(props){const _components={a:`a`,li:`li`,p:`p`,strong:`strong`,ul:`ul`,..._provideComponents(),...props.components},{Heading,OptimizedImage,Tip}=_components;if(!Heading)_missingMdxReference(`Heading`,true);if(!OptimizedImage)_missingMdxReference(`OptimizedImage`,true);if(!Tip)_missingMdxReference(`Tip`,true);return _jsxs(_Fragment,{children:[_jsx(_components.p,{children:`AutoMQ is a next-generation Kafka distribution redesigned based on cloud-native principles and compatible with Apache Kafka®. This article explains the Kafka Linking feature provided by AutoMQ and how to use Kafka Linking to migrate business from Apache Kafka® or other Kafka distributions to AutoMQ.`}),`\n`,_jsx(Heading,{level:`2`,id:`migration-scenarios`,children:`Migration scenarios`}),`\n`,_jsx(_components.p,{children:`AutoMQ is compatible with Apache Kafka®, enabling Kafka Linking to migrate Kafka distributions provided by other vendors. Details are listed below:`}),`\n`,_jsxs(`table`,{children:[_jsx(`thead`,{children:_jsxs(`tr`,{children:[_jsxs(`th`,{colspan:`1`,rowspan:`1`,children:[_jsx(_components.p,{children:`Source Cluster`}),_jsx(`br`,{})]}),_jsxs(`th`,{colspan:`1`,rowspan:`1`,children:[_jsx(_components.p,{children:`Target Cluster`}),_jsx(`br`,{})]}),_jsxs(`th`,{colspan:`1`,rowspan:`1`,children:[_jsx(_components.p,{children:`Migration Support`}),_jsx(`br`,{})]})]})}),_jsxs(`tbody`,{children:[_jsxs(`tr`,{children:[_jsxs(`td`,{colspan:`1`,rowspan:`1`,children:[_jsx(_components.p,{children:`Apache Kafka`}),_jsx(`br`,{})]}),_jsxs(`td`,{colspan:`1`,rowspan:`5`,children:[_jsx(_components.p,{children:`AutoMQ`}),_jsx(`br`,{})]}),_jsxs(`td`,{colspan:`1`,rowspan:`1`,children:[_jsx(_components.p,{children:`Support`}),_jsx(`br`,{}),_jsx(Tip,{children:_jsx(_components.p,{children:`Kafka Linking is compatible with Apache Kafka® versions >= 0.11.`})}),_jsx(`br`,{})]})]}),_jsxs(`tr`,{children:[_jsxs(`td`,{colspan:`1`,rowspan:`1`,children:[_jsx(_components.p,{children:`AWS MSK`}),_jsx(`br`,{})]}),_jsxs(`td`,{colspan:`1`,rowspan:`1`,children:[_jsx(_components.p,{children:`Support`}),_jsx(`br`,{}),_jsx(Tip,{children:_jsx(_components.p,{children:`Kafka Linking does not support MSK IAM Role authentication mode and only supports the native ACL authentication mode.`})}),_jsx(`br`,{})]})]}),_jsxs(`tr`,{children:[_jsxs(`td`,{colspan:`1`,rowspan:`1`,children:[_jsx(_components.p,{children:`Confluent Platform`}),_jsx(`br`,{})]}),_jsxs(`td`,{colspan:`1`,rowspan:`1`,children:[_jsx(_components.p,{children:`Supported`}),_jsx(`br`,{})]})]}),_jsxs(`tr`,{children:[_jsxs(`td`,{colspan:`1`,rowspan:`1`,children:[_jsx(_components.p,{children:`Alibaba Cloud Kafka`}),_jsx(`br`,{})]}),_jsxs(`td`,{colspan:`1`,rowspan:`1`,children:[_jsx(_components.p,{children:`Supported`}),_jsx(`br`,{})]})]})]})]}),`\n`,_jsx(Tip,{children:_jsx(_components.p,{children:`If the current Kafka release version you are using is not listed above, please contact us immediately for support and assistance.`})}),`\n`,_jsx(Heading,{level:`2`,id:`overview-of-kafka-linking`,children:`Overview of Kafka Linking`}),`\n`,_jsx(_components.p,{children:`AutoMQ Cloud provides the Kafka migration tool Kafka Linking, which supports migration from Apache Kafka® or other Kafka distributions to AutoMQ without application changes.`}),`\n`,_jsx(_components.p,{children:`The Kafka Linking migration tool has the following advantages:`}),`\n`,_jsxs(_components.ul,{children:[`\n`,_jsxs(_components.li,{children:[`\n`,_jsxs(_components.p,{children:[_jsx(_components.strong,{children:`Non-Stop Migration`}),`: Unlike MirrorMaker2, which requires client downtime for switching, Kafka Linking is equipped with a built-in traffic proxy component that ensures the switching process for Producers does not require downtime.`]}),`\n`]}),`\n`,_jsxs(_components.li,{children:[`\n`,_jsxs(_components.p,{children:[_jsx(_components.strong,{children:`Byte-to-byte replication:`}),` Unlike MirrorMaker2, which changes offsets during replication, Kafka Linking preserves partition offsets when it replicates source data to the target. Applications such as Flink jobs that restore offsets from checkpoints, savepoints, or external stores must still verify that every saved offset is readable on the target. See `,_jsx(_components.a,{href:`/automq-cloud/migrate-to-automq/kafka-linking-best-practices#validate-consumer-offset-sources`,children:`Kafka Linking best practices`}),` for the validation procedure.`]}),`\n`]}),`\n`,_jsxs(_components.li,{children:[`\n`,_jsxs(_components.p,{children:[_jsx(_components.strong,{children:`Synchronized Consumption Progress:`}),` Kafka Linking supports synchronized source cluster consumption progress, allowing consumers to resume consumption from the target cluster post-migration with consistent position information.`]}),`\n`]}),`\n`,_jsxs(_components.li,{children:[`\n`,_jsxs(_components.p,{children:[_jsx(_components.strong,{children:`Elastic Scaling on Demand:`}),` Kafka Linking requires no separate deployment and scales with the AutoMQ cluster on demand, reducing operational complexity during migration.`]}),`\n`]}),`\n`,_jsxs(_components.li,{children:[`\n`,_jsxs(_components.p,{children:[_jsx(_components.strong,{children:`High Kafka Compatibility:`}),` Kafka Linking supports most historical versions of Apache Kafka (version >=0.11) as well as other commercial editions, allowing transitions to AutoMQ.`]}),`\n`]}),`\n`]}),`\n`,_jsx(Heading,{level:`2`,id:`kafka-linking-terminology-and-concepts`,children:`Kafka Linking terminology and concepts`}),`\n`,_jsx(_components.p,{children:`Kafka Linking defines a series of terms, listed as follows:`}),`\n`,_jsx(Heading,{level:`3`,id:`kafka-link`,children:`Kafka Link`}),`\n`,_jsx(_components.p,{children:`A Kafka Link is a data synchronization and proxy task for a set of Topics from an external Apache Kafka cluster to an AutoMQ Kafka instance, including the configuration required for data synchronization, real-time operational status, and traffic proxy control.`}),`\n`,_jsx(Heading,{level:`3`,id:`source-cluster`,children:`Source Cluster`}),`\n`,_jsx(_components.p,{children:`The Source Cluster is an abstract configuration defined in Kafka Linking for the migration source cluster. The Source Cluster is described by AutoMQ’s console-provided Kafka integration, containing configuration information such as the source cluster’s access point, ACL rules, alias, etc.`}),`\n`,_jsx(Heading,{level:`3`,id:`sink-cluster`,children:`Sink Cluster`}),`\n`,_jsx(_components.p,{children:`The Sink Cluster is an abstract configuration defined in Kafka Linking for the migration target cluster. The Sink Cluster specifically refers to an AutoMQ instance (Kafka Linking supports only AutoMQ instances as Sink Clusters), containing configuration information such as the target cluster’s access point, ACL rules, alias, etc.`}),`\n`,_jsx(Heading,{level:`3`,id:`mirror-topic`,children:`Mirror Topic`}),`\n`,_jsx(_components.p,{children:`Mirror Topic is the basic unit used in Kafka Linking to synchronize and migrate a Topic from the source cluster to the target cluster. Each Mirror Topic corresponds to a specific Topic in the source cluster and serves as the unique representation of that Topic in the target cluster.`}),`\n`,_jsx(Heading,{level:`3`,id:`source-topic`,children:`Source Topic`}),`\n`,_jsx(_components.p,{children:`Source Topic is the expression of the Topic in the source cluster for Kafka Linking. In each Kafka Link, the Source Topic and Mirror Topic correspond one-to-one.`}),`\n`,_jsx(Heading,{level:`3`,id:`consumer-group`,children:`Consumer Group`}),`\n`,_jsx(_components.p,{children:`Kafka Linking supports copying consumption progress information from the source cluster’s Consumer Group and synchronizing it to the target cluster. Users can specify the Source Cluster’s Consumer Group and configure it to the Sink Cluster’s designated Consumer Group.`}),`\n`,_jsx(Heading,{level:`2`,id:`kafka-linking-architecture`,children:`Kafka Linking architecture`}),`\n`,_jsx(_components.p,{children:`Unlike MirrorMaker2, which implements data synchronization based on Connectors, the Kafka Linking migration tool reconstructs two paths: Byte-to-Byte replication path and Producer proxy path:`}),`\n`,_jsxs(_components.ul,{children:[`\n`,_jsxs(_components.li,{children:[`\n`,_jsxs(_components.p,{children:[_jsx(_components.strong,{children:`Byte-to-Byte Replication Path:`}),` This is used for synchronizing data from the Source Cluster to the Sink Cluster, ensuring data integrity and position consistency.`]}),`\n`]}),`\n`,_jsxs(_components.li,{children:[`\n`,_jsxs(_components.p,{children:[_jsx(_components.strong,{children:`Producer Proxy Path:`}),` Traditional MirrorMaker2 requires Producers to be completely shut down before switching to the target cluster to avoid data disorder caused by simultaneous writing to both clusters. AutoMQ Kafka Linking provides a Producer proxy path that supports traffic proxying back to the source cluster during the switching process and subsequent unified switching, enabling zero-downtime switching.`]}),`\n`]}),`\n`]}),`\n`,_jsx(Heading,{level:`3`,id:`byte-to-byte-replication-path`,children:`Byte-to-Byte replication path`}),`\n`,_jsx(OptimizedImage,{alt:`The data synchronization link of Kafka Linking can achieve the following effects:`,src:`https://mintcdn.com/automq/6t03b99H9kP_jCZq/automq-cloud/migrate-to-automq/overview/1.webp?fit=max\u0026auto=format\u0026n=6t03b99H9kP_jCZq\u0026q=85\u0026s=4944a3c1c369348de8b403d0b8746432`,\"data-og-width\":`2560`,width:`2560`,\"data-og-height\":`944`,height:`944`,\"data-path\":`automq-cloud/migrate-to-automq/overview/1.webp`,\"data-optimize\":`true`,\"data-opv\":`3`,srcset:`https://mintcdn.com/automq/6t03b99H9kP_jCZq/automq-cloud/migrate-to-automq/overview/1.webp?w=280\u0026fit=max\u0026auto=format\u0026n=6t03b99H9kP_jCZq\u0026q=85\u0026s=73a99d61ef0b7e33d2904a40961d6acb 280w, https://mintcdn.com/automq/6t03b99H9kP_jCZq/automq-cloud/migrate-to-automq/overview/1.webp?w=560\u0026fit=max\u0026auto=format\u0026n=6t03b99H9kP_jCZq\u0026q=85\u0026s=1bf19bef0dd86a08da3c7e669903996d 560w, https://mintcdn.com/automq/6t03b99H9kP_jCZq/automq-cloud/migrate-to-automq/overview/1.webp?w=840\u0026fit=max\u0026auto=format\u0026n=6t03b99H9kP_jCZq\u0026q=85\u0026s=c7b6ccbdf790af98761fdea9d540342d 840w, https://mintcdn.com/automq/6t03b99H9kP_jCZq/automq-cloud/migrate-to-automq/overview/1.webp?w=1100\u0026fit=max\u0026auto=format\u0026n=6t03b99H9kP_jCZq\u0026q=85\u0026s=c4de8378fcd2a30187d58bb580325c9c 1100w, https://mintcdn.com/automq/6t03b99H9kP_jCZq/automq-cloud/migrate-to-automq/overview/1.webp?w=1650\u0026fit=max\u0026auto=format\u0026n=6t03b99H9kP_jCZq\u0026q=85\u0026s=aafb6b099bce7f64e637652320c9daeb 1650w, https://mintcdn.com/automq/6t03b99H9kP_jCZq/automq-cloud/migrate-to-automq/overview/1.webp?w=2500\u0026fit=max\u0026auto=format\u0026n=6t03b99H9kP_jCZq\u0026q=85\u0026s=db4bc7e99dcc2e9c49bf5f051329d23d 2500w`}),`\n`,_jsx(_components.p,{children:`Kafka Linking’s data synchronization links can achieve the following effects:`}),`\n`,_jsxs(_components.ul,{children:[`\n`,_jsxs(_components.li,{children:[`\n`,_jsx(_components.p,{children:`Topic partition numbers are completely consistent.`}),`\n`]}),`\n`,_jsxs(_components.li,{children:[`\n`,_jsx(_components.p,{children:`Message full synchronization, with offsets exactly aligned with the source cluster.`}),`\n`]}),`\n`,_jsxs(_components.li,{children:[`\n`,_jsx(_components.p,{children:`Consumer offsets are synchronized; the specific partitions’ consumer offsets for specific Consumer Groups in the source cluster are fully synchronized to the target cluster, maintaining consistency.`}),`\n`]}),`\n`]}),`\n`,_jsx(Heading,{level:`3`,id:`producer-proxy-link`,children:`Producer proxy link`}),`\n`,_jsx(OptimizedImage,{alt:`Producer proxy link provided by Kafka Linking has the following capabilities:`,src:`https://mintcdn.com/automq/6t03b99H9kP_jCZq/automq-cloud/migrate-to-automq/overview/2.webp?fit=max\u0026auto=format\u0026n=6t03b99H9kP_jCZq\u0026q=85\u0026s=75c59306668e2232fcbd3116b10d4a3f`,\"data-og-width\":`2560`,width:`2560`,\"data-og-height\":`984`,height:`984`,\"data-path\":`automq-cloud/migrate-to-automq/overview/2.webp`,\"data-optimize\":`true`,\"data-opv\":`3`,srcset:`https://mintcdn.com/automq/6t03b99H9kP_jCZq/automq-cloud/migrate-to-automq/overview/2.webp?w=280\u0026fit=max\u0026auto=format\u0026n=6t03b99H9kP_jCZq\u0026q=85\u0026s=b9d90c4d4699a97098e17ebc2075f1ab 280w, https://mintcdn.com/automq/6t03b99H9kP_jCZq/automq-cloud/migrate-to-automq/overview/2.webp?w=560\u0026fit=max\u0026auto=format\u0026n=6t03b99H9kP_jCZq\u0026q=85\u0026s=b7297bfe5589d416feb8f6d36a21a375 560w, https://mintcdn.com/automq/6t03b99H9kP_jCZq/automq-cloud/migrate-to-automq/overview/2.webp?w=840\u0026fit=max\u0026auto=format\u0026n=6t03b99H9kP_jCZq\u0026q=85\u0026s=5b834eaab465196f0009efebd0f4c19f 840w, https://mintcdn.com/automq/6t03b99H9kP_jCZq/automq-cloud/migrate-to-automq/overview/2.webp?w=1100\u0026fit=max\u0026auto=format\u0026n=6t03b99H9kP_jCZq\u0026q=85\u0026s=ccea41d5f2ae5b65dc06a7018f242cf2 1100w, https://mintcdn.com/automq/6t03b99H9kP_jCZq/automq-cloud/migrate-to-automq/overview/2.webp?w=1650\u0026fit=max\u0026auto=format\u0026n=6t03b99H9kP_jCZq\u0026q=85\u0026s=67bfd1cf9d37a8edc2976b3cc672f1fb 1650w, https://mintcdn.com/automq/6t03b99H9kP_jCZq/automq-cloud/migrate-to-automq/overview/2.webp?w=2500\u0026fit=max\u0026auto=format\u0026n=6t03b99H9kP_jCZq\u0026q=85\u0026s=3abd2ecf7450588c7f3a8e461c6dae6d 2500w`}),`\n`,_jsx(_components.p,{children:`Producer proxy link provided by Kafka Linking has the following capabilities:`}),`\n`,_jsxs(_components.ul,{children:[`\n`,_jsxs(_components.li,{children:[`\n`,_jsx(_components.p,{children:`Supports Producer rolling-switch access point migration, with no downtime during the switch, ensuring no disruption to writing processes.`}),`\n`]}),`\n`,_jsxs(_components.li,{children:[`\n`,_jsx(_components.p,{children:`Supports normal read/write operations on the source cluster during migration, with no impact, allowing applications to switch as needed.`}),`\n`]}),`\n`]}),`\n`,_jsx(Heading,{level:`2`,id:`next-steps`,children:`Next steps`}),`\n`,_jsx(_components.p,{children:`To understand the background and functionality of Kafka Linking, it is recommended to follow this sequence:`}),`\n`,_jsxs(_components.ul,{children:[`\n`,_jsxs(_components.li,{children:[`\n`,_jsxs(_components.p,{children:[_jsx(_components.strong,{children:`Prerequisites sorting:`}),` Identify the characteristics of the source cluster and business relationships that need migration, plan the migration batches, and check prerequisite resources. `,_jsx(_components.a,{href:`/automq-cloud/migrate-to-automq/prerequisites`,children:`Prerequisites▸`})]}),`\n`]}),`\n`,_jsxs(_components.li,{children:[`\n`,_jsxs(_components.p,{children:[_jsx(_components.strong,{children:`Review migration best practices:`}),` Create a runbook for each batch based on endpoints, client types, offset sources, and rollback requirements. `,_jsx(_components.a,{href:`/automq-cloud/migrate-to-automq/kafka-linking-best-practices`,children:`Kafka Linking best practices▸`})]}),`\n`]}),`\n`,_jsxs(_components.li,{children:[`\n`,_jsxs(_components.p,{children:[_jsx(_components.strong,{children:`Execute the migration plan:`}),` After completing the prerequisite review, follow the migration plan step by step. `,_jsx(_components.a,{href:`/automq-cloud/migrate-to-automq/executing-migration`,children:`Executing migration▸`})]}),`\n`]}),`\n`]})]})}function MDXContent(props={}){const{wrapper:MDXLayout}={..._provideComponents(),...props.components};return MDXLayout?_jsx(MDXLayout,{...props,children:_jsx(_createMdxContent,{...props})}):_createMdxContent(props)}return{default:MDXContent};function _missingMdxReference(id,component){throw new Error(`Expected `+(component?`component`:`object`)+\" `\"+id+\"` to be defined: you likely forgot to import, pass, or provide it.\")}","frontmatter":{},"scope":{"config":{},"pageMetadata":{"title":"Overview","description":"Migrate to AutoMQ Cloud with full Kafka compatibility. Adaptive elastic scaling, batch migration, and cost-efficient cloud-native infrastructure for reliable data synchronization.","href":"/automq-cloud/migrate-to-automq/overview"}}},"mdxSourceWithNoJs":null},"mdxExtracts":{"tableOfContents":[{"title":"Migration scenarios","slug":"migration-scenarios","depth":2,"children":[]},{"title":"Overview of Kafka Linking","slug":"overview-of-kafka-linking","depth":2,"children":[]},{"title":"Kafka Linking terminology and concepts","slug":"kafka-linking-terminology-and-concepts","depth":2,"children":[{"title":"Kafka Link","slug":"kafka-link","depth":3,"children":[]},{"title":"Source Cluster","slug":"source-cluster","depth":3,"children":[]},{"title":"Sink Cluster","slug":"sink-cluster","depth":3,"children":[]},{"title":"Mirror Topic","slug":"mirror-topic","depth":3,"children":[]},{"title":"Source Topic","slug":"source-topic","depth":3,"children":[]},{"title":"Consumer Group","slug":"consumer-group","depth":3,"children":[]}]},{"title":"Kafka Linking architecture","slug":"kafka-linking-architecture","depth":2,"children":[{"title":"Byte-to-Byte replication path","slug":"byte-to-byte-replication-path","depth":3,"children":[]},{"title":"Producer proxy link","slug":"producer-proxy-link","depth":3,"children":[]}]},{"title":"Next steps","slug":"next-steps","depth":2,"children":[]}],"codeExamples":{}},"jsLinks":["/_mintlify/custom/automq/48fec8bab1afa455/content/monitor.js","/_mintlify/custom/automq/c09aa9839083e17a/content/hubspot.js","/_mintlify/custom/automq/786ace9ed17adbd7/content/luckyorange-tracking.js"],"subdomain":"automq","siteName":"AutoMQ Documentation","title":"Overview - AutoMQ Documentation","navMaps":{"firstHrefInVersion":{},"firstHrefInLanguage":{"en":{"href":"/automq-cloud/migrate-to-automq/overview","matchLevel":0},"cn":{"href":"/zh/automq-cloud/migrate-to-automq/overview","matchLevel":1}}},"lastModified":"2026-09-02T04:50:15.364Z","originalFileLocation":"automq-cloud/migrate-to-automq/overview.mdx","locale":"en"},"headHtml":"\u003cscript data-mint-head>(function(){var d=document.documentElement,p=\"light\";if(!p){try{p=localStorage.getItem(\"isDarkMode\")}catch(e){}if(p==='true')p='dark';else if(p==='false')p='light';if(p!=='light'\u0026\u0026p!=='dark'\u0026\u0026p!=='system')p=\"light\"}var r=p==='system'?(matchMedia(\"(prefers-color-scheme: dark)\").matches?'dark':'light'):p;d.classList.remove(r==='dark'?'light':'dark');d.classList.add(r);d.setAttribute(\"data-theme-preference\",p)})();\u003c/script>\u003cmeta data-mint-head name=\"description\" content=\"Migrate to AutoMQ Cloud with full Kafka compatibility. Adaptive elastic scaling, batch migration, and cost-efficient cloud-native infrastructure for reliable data synchronization.\">\u003cmeta data-mint-head name=\"application-name\" content=\"AutoMQ Documentation\">\u003cmeta data-mint-head name=\"generator\" content=\"Mintlify\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"192x192\" href=\"/mintlify-assets/_mintlify/favicons/automq/ZRmM16tNeY4WJ6hO/_generated/favicon/android-chrome-192x192.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"apple-touch-icon\" type=\"image/png\" sizes=\"180x180\" href=\"/mintlify-assets/_mintlify/favicons/automq/ZRmM16tNeY4WJ6hO/_generated/favicon/apple-touch-icon.png\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"16x16\" href=\"/mintlify-assets/_mintlify/favicons/automq/ZRmM16tNeY4WJ6hO/_generated/favicon/favicon-16x16.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"32x32\" href=\"/mintlify-assets/_mintlify/favicons/automq/ZRmM16tNeY4WJ6hO/_generated/favicon/favicon-32x32.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"shortcut icon\" type=\"image/x-icon\" href=\"/mintlify-assets/_mintlify/favicons/automq/ZRmM16tNeY4WJ6hO/_generated/favicon/favicon.ico\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"192x192\" href=\"/mintlify-assets/_mintlify/favicons/automq/ZRmM16tNeY4WJ6hO/_generated/favicon-dark/android-chrome-192x192.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"16x16\" href=\"/mintlify-assets/_mintlify/favicons/automq/ZRmM16tNeY4WJ6hO/_generated/favicon-dark/favicon-16x16.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"32x32\" href=\"/mintlify-assets/_mintlify/favicons/automq/ZRmM16tNeY4WJ6hO/_generated/favicon-dark/favicon-32x32.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"shortcut icon\" type=\"image/x-icon\" href=\"/mintlify-assets/_mintlify/favicons/automq/ZRmM16tNeY4WJ6hO/_generated/favicon-dark/favicon.ico\" media=\"(prefers-color-scheme: dark)\">\u003cmeta data-mint-head property=\"og:title\" content=\"Overview - AutoMQ Documentation\">\u003cmeta data-mint-head property=\"og:description\" content=\"Migrate to AutoMQ Cloud with full Kafka compatibility. Adaptive elastic scaling, batch migration, and cost-efficient cloud-native infrastructure for reliable data synchronization.\">\u003cmeta data-mint-head property=\"og:site_name\" content=\"AutoMQ Documentation\">\u003cmeta data-mint-head property=\"og:url\" content=\"https://docs.automq.com/automq-cloud/migrate-to-automq/overview\">\u003cmeta data-mint-head property=\"og:type\" content=\"website\">\u003cmeta data-mint-head name=\"twitter:card\" content=\"summary_large_image\">\u003cmeta data-mint-head name=\"twitter:title\" content=\"Overview - AutoMQ Documentation\">\u003cmeta data-mint-head name=\"twitter:description\" content=\"Migrate to AutoMQ Cloud with full Kafka compatibility. Adaptive elastic scaling, batch migration, and cost-efficient cloud-native infrastructure for reliable data synchronization.\">\u003cmeta data-mint-head name=\"msapplication-config\" content=\"/mintlify-assets/_mintlify/favicons/automq/ZRmM16tNeY4WJ6hO/_generated/favicon/browserconfig.xml\">\u003cmeta data-mint-head name=\"apple-mobile-web-app-title\" content=\"AutoMQ Documentation\">\u003cmeta data-mint-head name=\"msapplication-TileColor\" content=\"#2449D4\">\u003clink data-mint-head rel=\"canonical\" href=\"https://docs.automq.com/automq-cloud/migrate-to-automq/overview\">\u003clink data-mint-head rel=\"alternate\" type=\"application/xml\" href=\"/sitemap.xml\">\u003clink data-mint-head rel=\"alternate\" type=\"text/markdown\" href=\"/automq-cloud/migrate-to-automq/overview.md\">\u003clink data-mint-head rel=\"alternate\" hreflang=\"en\" href=\"https://docs.automq.com/automq-cloud/migrate-to-automq/overview\">\u003clink data-mint-head rel=\"alternate\" hreflang=\"zh\" href=\"https://docs.automq.com/zh/automq-cloud/migrate-to-automq/overview\">\u003clink data-mint-head rel=\"alternate\" hreflang=\"x-default\" href=\"https://docs.automq.com/automq-cloud/migrate-to-automq/overview\">\u003cscript data-mint-head type=\"application/ld+json\">{\"@context\":\"https://schema.org\",\"@graph\":[{\"@type\":\"Organization\",\"@id\":\"https://docs.automq.com/#organization\",\"name\":\"AutoMQ Documentation\",\"url\":\"https://docs.automq.com\",\"logo\":{\"@type\":\"ImageObject\",\"url\":\"https://mintcdn.com/automq/s9vNxeyMGZ1r1DRV/logo/automq-black.svg?fit=max\u0026auto=format\u0026n=s9vNxeyMGZ1r1DRV\u0026q=85\u0026s=bcc93ae74a4143ae2b7602497b7b354b\"}},{\"@type\":\"WebSite\",\"@id\":\"https://docs.automq.com#website\",\"name\":\"AutoMQ Documentation\",\"url\":\"https://docs.automq.com\",\"publisher\":{\"@id\":\"https://docs.automq.com/#organization\"}},{\"@type\":\"WebPage\",\"@id\":\"https://docs.automq.com/automq-cloud/migrate-to-automq/overview#webpage\",\"url\":\"https://docs.automq.com/automq-cloud/migrate-to-automq/overview\",\"name\":\"Overview\",\"description\":\"Migrate to AutoMQ Cloud with full Kafka compatibility. Adaptive elastic scaling, batch migration, and cost-efficient cloud-native infrastructure for reliable data synchronization.\",\"dateModified\":\"2026-09-02T04:50:15.364Z\",\"isPartOf\":{\"@id\":\"https://docs.automq.com#website\"},\"breadcrumb\":{\"@id\":\"https://docs.automq.com/automq-cloud/migrate-to-automq/overview#breadcrumb\"}},{\"@type\":\"BreadcrumbList\",\"@id\":\"https://docs.automq.com/automq-cloud/migrate-to-automq/overview#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"AutoMQ Documentation\",\"item\":\"https://docs.automq.com\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Overview\",\"item\":\"https://docs.automq.com/automq-cloud/migrate-to-automq/overview\"}]},{\"@type\":[\"Article\",\"TechArticle\"],\"@id\":\"https://docs.automq.com/automq-cloud/migrate-to-automq/overview#article\",\"headline\":\"Overview\",\"name\":\"Overview\",\"description\":\"Migrate to AutoMQ Cloud with full Kafka compatibility. Adaptive elastic scaling, batch migration, and cost-efficient cloud-native infrastructure for reliable data synchronization.\",\"url\":\"https://docs.automq.com/automq-cloud/migrate-to-automq/overview\",\"mainEntityOfPage\":{\"@id\":\"https://docs.automq.com/automq-cloud/migrate-to-automq/overview#webpage\"},\"dateModified\":\"2026-09-02T04:50:15.364Z\",\"publisher\":{\"@id\":\"https://docs.automq.com/#organization\"},\"isPartOf\":{\"@id\":\"https://docs.automq.com#website\"}}]}\u003c/script>\u003cscript data-mint-head type=\"application/ld+json\">{\"@context\":\"https://schema.org\",\"@type\":\"WebSite\",\"name\":\"AutoMQ Documentation\",\"creator\":{\"@type\":\"Organization\",\"name\":\"Mintlify\",\"url\":\"https://mintlify.com\"}}\u003c/script>","siteName":"AutoMQ Documentation","nav":{"global":{"anchors":[{"anchor":"Github","icon":"github","href":"https://github.com/automq/automq"},{"anchor":"Slack","icon":"slack","href":"https://go.automq.com/slack"},{"anchor":"Telegram","icon":"Telegram","href":"https://t.me/+VgqhN9wqBGIzYmU1"},{"anchor":"Blog","icon":"newspaper","href":"https://www.automq.com/blog"}]},"languages":[{"language":"en","tabs":[{"tab":"Home","icon":"house","pages":[{"title":"Home","href":""}]},{"tab":"AutoMQ Open Source","icon":"github","pages":[{"title":"AutoMQ Open Source","href":"/automq/what-is-automq/overview"}]},{"tab":"AutoMQ BYOC","icon":"cloud","groups":[{"group":"Overview","icon":"readme","pages":[{"title":"What Is AutoMQ Cloud","href":"/automq-cloud/overview/what-is-automq-cloud"},{"title":"Glossary","href":"/automq-cloud/overview/glossary"},{"title":"Restrictions","href":"/automq-cloud/overview/restrictions"}]},{"group":"Getting Started","icon":"play","pages":[{"title":"Overview","href":"/automq-cloud/getting-started/overview"},{"group":"Install BYOC Environment","pages":[{"group":"AWS","pages":[{"title":"Prepare VPC","href":"/automq-cloud/getting-started/install-byoc-environment/aws/prepare-vpc"},{"title":"Install AutoMQ on AWS","href":"/automq-cloud/getting-started/install-byoc-environment/aws/install-automq-on-aws"}]},{"group":"Google Cloud","pages":[{"title":"Install AutoMQ on Google Cloud","href":"/automq-cloud/getting-started/install-byoc-environment/google-cloud/install-automq-on-gcp"}]},{"title":"OCI","href":"/automq-cloud/getting-started/install-byoc-environment/oci-install-automq"},{"group":"Azure","pages":[{"title":"Install AutoMQ on Azure","href":"/automq-cloud/getting-started/install-byoc-environment/install-env-on-azure"}]}]},{"title":"Experience AutoMQ","href":"/automq-cloud/getting-started/experience-automq"},{"title":"Client SDK Guide","href":"/automq-cloud/getting-started/client-sdk-guide"}]},{"group":"Deploy on Kubernetes","icon":"https://mintlify.s3.us-west-1.amazonaws.com/automq/images/kubernetes-svgrepo-com.svg","pages":[{"title":"Overview","href":"/automq-cloud/deploy-automq-on-kubernetes/overview"},{"title":"Deploy to AWS EKS","href":"/automq-cloud/deploy-automq-on-kubernetes/deploy-to-aws-eks"},{"title":"Deploy to Azure AKS","href":"/automq-cloud/deploy-automq-on-kubernetes/deploy-to-azure-aks"},{"title":"Deploy to Google Cloud GKE","href":"/automq-cloud/deploy-automq-on-kubernetes/deploy-to-google-cloud-gke"}]},{"group":"Subscriptions and Billings","icon":"receipt","pages":[{"title":"Overview","href":"/automq-cloud/subscriptions-and-billings/overview"},{"group":"BYOC Env Billings","pages":[{"title":"Usage-Based Billing for AWS","href":"/automq-cloud/subscriptions-and-billings/byoc-env-billings/usage-based-billing"},{"group":"Prepaid Billing for Others","pages":[{"title":"Prepaid Billing Overview","href":"/automq-cloud/subscriptions-and-billings/byoc-env-billings/billing-instructions-for-byoc"},{"title":"Manage Environment License","href":"/automq-cloud/manage-environments/manage-environment-license"}]}]}]},{"group":"Manage Environments","icon":"clipboard-list","pages":[{"title":"Overview","href":"/automq-cloud/manage-environments/overview"},{"title":"Upgrade Environment Version","href":"/automq-cloud/manage-environments/upgrade-environment-version"},{"group":"Manage Environment Ops Authing","pages":[{"title":"Overview","href":"/automq-cloud/manage-environments/manage-environment-ops-authing/overview"},{"title":"Set Ops Authing from AWS","href":"/automq-cloud/manage-environments/manage-environment-ops-authing/set-ops-authing-from-aws"},{"title":"Set Ops Authing from Google Cloud","href":"/automq-cloud/manage-environments/manage-environment-ops-authing/set-ops-authing-from-google-cloud"},{"title":"Set Ops Authing from OCI","href":"/automq-cloud/manage-environments/manage-environment-ops-authing/set-ops-authing-from-oci"},{"title":"Set Ops Authing from Azure","href":"/automq-cloud/manage-environments/manage-environment-ops-authing/set-ops-authing-from-azure"},{"title":"Set Ops Tunnel for Troubleshooting","href":"/automq-cloud/manage-environments/manage-environment-ops-authing/set-ops-tunnel-for-troubleshooting"}]}]},{"group":"Manage Identities and Access","icon":"fingerprint","pages":[{"title":"Overview","href":"/automq-cloud/manage-identities-and-access/overview"},{"title":"Member Accounts","href":"/automq-cloud/manage-identities-and-access/member-accounts"},{"title":"Role-Based Access Control","href":"/automq-cloud/manage-identities-and-access/role-based-access-control"},{"title":"Service Accounts","href":"/automq-cloud/manage-identities-and-access/service-accounts"},{"title":"Identity Providers and SSO Authentication","href":"/automq-cloud/manage-identities-and-access/identity-providers-and-sso-authentication"}]},{"group":"Managing AutoMQ","icon":"boxes","pages":[{"title":"Manage Instances","href":"/automq-cloud/managing-automq/manage-instances"},{"title":"Manage Topics","href":"/automq-cloud/managing-automq/manage-topics"},{"title":"Manage Consumer Groups","description":"Manage Consumer Groups in AutoMQ: view, modify, reset consumption offsets, and delete consumer groups in a Kafka-compatible, cloud-native environment.","href":"/automq-cloud/managing-automq/manage-consumer-groups"}]},{"group":"Migrate to AutoMQ","icon":"arrow-right-left","pages":[{"title":"Overview","href":"/automq-cloud/migrate-to-automq/overview"},{"title":"Prerequisites","description":"Ensure you verify all prerequisites before migrating to AutoMQ to ensure no impact on production business operations. AutoMQ provides cloud-native scalability and 100% API compatibility with Kafka.","href":"/automq-cloud/migrate-to-automq/prerequisites"},{"title":"Executing Migration","href":"/automq-cloud/migrate-to-automq/executing-migration"},{"title":"Kafka Linking best practices","href":"/automq-cloud/migrate-to-automq/kafka-linking-best-practices"}]},{"group":"Manage Security","icon":"globe-lock","pages":[{"title":"Overview","href":"/automq-cloud/manage-security/overview"},{"group":"Authentication","pages":[{"title":"SASL Authentication","href":"/automq-cloud/manage-security/authentication/sasl-authentication"},{"title":"Mutual TLS (mTLS) Authentication","href":"/automq-cloud/manage-security/authentication/mutual-tls-mtls-authentication"}]},{"title":"Data Encryption at Rest","href":"/automq-cloud/manage-security/data-encryption-at-rest"},{"title":"Manage Kafka ACLs","href":"/automq-cloud/manage-security/manage-kafka-acls"}]},{"group":"Kafka Connect","icon":"blocks","pages":[{"title":"Overview","href":"/automq-cloud/kafka-connect/overview"},{"title":"Manage Plugins","href":"/automq-cloud/kafka-connect/manage-plugins"},{"title":"Manage Connectors","href":"/automq-cloud/kafka-connect/manage-connectors"},{"group":"Source Connectors","pages":[{"title":"Azure IoT Hub Source Connector","href":"/automq-cloud/kafka-connect/source-connectors/azure-iot-hub-source-connector"},{"title":"Camunda Zeebe Source Connector","href":"/automq-cloud/kafka-connect/source-connectors/camunda-zeebe-source-connector"},{"title":"Couchbase Source Connector","href":"/automq-cloud/kafka-connect/source-connectors/couchbase-kafka-connect-couchbase-source-connector"},{"title":"Debezium MongoDB CDC Source Connector","href":"/automq-cloud/kafka-connect/source-connectors/debezium-mongodb-source-connector"},{"title":"Debezium MySQL Source Connector","href":"/automq-cloud/kafka-connect/source-connectors/debezium-mysql-source-connector"},{"title":"Debezium PostgreSQL Source Connector","href":"/automq-cloud/kafka-connect/source-connectors/debezium-postgresql-source-connector"},{"title":"Debezium SQL Server Source Connector","href":"/automq-cloud/kafka-connect/source-connectors/debezium-sqlserver-source-connector"},{"title":"Diffusion Source Connector","href":"/automq-cloud/kafka-connect/source-connectors/diffusion-source-connector"},{"title":"Elasticsearch Source Connector","href":"/automq-cloud/kafka-connect/source-connectors/elasticsearch-source-connector"},{"title":"IRC Source Connector","href":"/automq-cloud/kafka-connect/source-connectors/irc-source-connector"},{"title":"MongoDB Source Connector","href":"/automq-cloud/kafka-connect/source-connectors/mongodb-source-connector"},{"title":"Neo4j Source Connector","href":"/automq-cloud/kafka-connect/source-connectors/neo4j-source-connector"},{"title":"Redis Stream Source Connector","href":"/automq-cloud/kafka-connect/source-connectors/redis-source-connector"},{"title":"RSS Source Connector","href":"/automq-cloud/kafka-connect/source-connectors/rss-source-connector"},{"title":"Scylla CDC Source Connector","href":"/automq-cloud/kafka-connect/source-connectors/scylla-cdc-source-connector"},{"title":"Server Sent Events Source Connector","href":"/automq-cloud/kafka-connect/source-connectors/server-sent-events-source-connector"},{"title":"Shell Source Connector","href":"/automq-cloud/kafka-connect/source-connectors/shell-source-connector"},{"title":"Twitter Source Connector","href":"/automq-cloud/kafka-connect/source-connectors/twitter-source-connector"},{"title":"YugabyteDB Source Connector","href":"/automq-cloud/kafka-connect/source-connectors/yugabytedb-source-connector"}]},{"group":"Sink Connectors","pages":[{"title":"Ably Sink Connector","href":"/automq-cloud/kafka-connect/sink-connectors/ably-kafka-sink-connector"},{"title":"Adobe Experience Platform Sink Connector","href":"/automq-cloud/kafka-connect/sink-connectors/adobe-experience-platform-sink-connector"},{"title":"Amazon EventBridge Sink Connector","href":"/automq-cloud/kafka-connect/sink-connectors/amazon-eventbridge-sink-connector"},{"title":"Apache Iceberg Sink Connector","href":"/automq-cloud/kafka-connect/sink-connectors/apache-iceberg-sink-connector"},{"title":"ArangoDB Sink Connector","href":"/automq-cloud/kafka-connect/sink-connectors/arangodb-sink-connector"},{"title":"Azure IoT Hub Sink Connector","href":"/automq-cloud/kafka-connect/sink-connectors/azure-iot-hub-sink-connector"},{"title":"Camunda Zeebe Sink Connector","href":"/automq-cloud/kafka-connect/sink-connectors/camunda-platform-8-zeebe-sink-connector"},{"title":"ClickHouse Sink Connector","href":"/automq-cloud/kafka-connect/sink-connectors/clickhouse-sink-connector"},{"title":"Couchbase Sink Connector","href":"/automq-cloud/kafka-connect/sink-connectors/couchbase-kafka-connect-couchbase-sink-connector"},{"title":"Datadog Logs Sink Connector","href":"/automq-cloud/kafka-connect/sink-connectors/datadog-logs-sink-connector"},{"title":"Diffusion Sink Connector","href":"/automq-cloud/kafka-connect/sink-connectors/diffusion-sink-connector"},{"title":"Google BigQuery Sink Connector","href":"/automq-cloud/kafka-connect/sink-connectors/wepay-kafka-connect-bigquery-sink-connector"},{"title":"Lightstreamer Sink Connector","href":"/automq-cloud/kafka-connect/sink-connectors/lightstreamer-sink-connector"},{"title":"Milvus Sink Connector","href":"/automq-cloud/kafka-connect/sink-connectors/milvus-sink-connector"},{"title":"MongoDB Sink Connector","href":"/automq-cloud/kafka-connect/sink-connectors/mongodb-sink-connector"},{"title":"Neo4j Sink Connector","href":"/automq-cloud/kafka-connect/sink-connectors/neo4j-sink-connector"},{"title":"New Relic Sink Connector","href":"/automq-cloud/kafka-connect/sink-connectors/new-relic-sink-connector"},{"title":"Redis Sink Connector","href":"/automq-cloud/kafka-connect/sink-connectors/redis-sink-connector"},{"title":"ScyllaDB Sink Connector","href":"/automq-cloud/kafka-connect/sink-connectors/scylladb-sink-connector"},{"title":"Shell Sink Connector","href":"/automq-cloud/kafka-connect/sink-connectors/shell-sink-connector"},{"title":"SingleStore Sink Connector","href":"/automq-cloud/kafka-connect/sink-connectors/singlestore-sink-connector"},{"title":"Snowflake Sink Connector","href":"/automq-cloud/kafka-connect/sink-connectors/snowflake-kafka-sink-connector"},{"title":"Splunk Sink Connector","href":"/automq-cloud/kafka-connect/sink-connectors/splunk-kafka-sink-connector"},{"title":"Timeplus Sink Connector","href":"/automq-cloud/kafka-connect/sink-connectors/timeplus-sink-connector"},{"title":"Vectara Sink Connector","href":"/automq-cloud/kafka-connect/sink-connectors/vectara-sink-connector"},{"title":"Weaviate Sink Connector","href":"/automq-cloud/kafka-connect/sink-connectors/weaviate-kafka-sink-connector"}]}]},{"group":"Monitoring \u0026 Alert","icon":"telescope","pages":[{"title":"Monitoring \u0026 Alert Via Prometheus","href":"/automq-cloud/monitoring-alert/monitoring-alert-via-prometheus"},{"title":"Integrating Metrics with Datadog","href":"/automq-cloud/monitoring-alert/integrating-metrics-with-datadog"}]},{"group":"Table Topic","icon":"text-search","pages":[{"title":"Overview","href":"/automq-cloud/table-topic/overview"},{"title":"Table Topic Integration with AWS Glue","href":"/automq-cloud/table-topic/table-topic-integration-with-aws-glue"},{"title":"Table Topic Integration with AWS S3 Table","href":"/automq-cloud/table-topic/table-topic-integration-with-aws-s3-table"}]},{"group":"Best Practice","icon":"spotlight","pages":[{"title":"Kafka Client Config Tuning","href":"/automq-cloud/best-practice/kafka-client-config-tuning"}]},{"group":"Eliminate Inter-Zone Traffics","icon":"audio-lines","pages":[{"title":"Overview","href":"/automq-cloud/eliminate-inter-zone-traffics/overview"},{"title":"Broker Configuration","href":"/automq-cloud/eliminate-inter-zone-traffics/broker-configuration"},{"title":"Client Configuration","href":"/automq-cloud/eliminate-inter-zone-traffics/client-configuration"},{"title":"Monitor Cross-AZ Traffic","href":"/automq-cloud/eliminate-inter-zone-traffics/monitor-inter-zone-traffic"}]},{"group":"Release Notes","icon":"rocket","pages":[{"title":"Release Notes","href":"/automq-cloud/release-notes"}]},{"group":"Support","icon":"message-circle-question-mark","pages":[{"title":"Obtaining Services","href":"/automq-cloud/support/obtaining-services"},{"title":"Service Level Agreement","href":"/automq-cloud/support/service-level-agreement"},{"title":"Terms of Service","href":"/automq-cloud/support/terms-of-service"}]},{"group":"Appendix","icon":"book-text","pages":[{"title":"Cloud Resource List","href":"/automq-cloud/appendix/cloud-resource-list"},{"title":"Deploy AutoMQ Software Via Helm Chart","href":"/automq-cloud/appendix/deploy-automq-enterprise-via-helm-chart"},{"title":"Helm Chart Values Readme","href":"/automq-cloud/appendix/helm-chart-values-readme"},{"title":"Performance Benchmark","href":"/automq-cloud/appendix/performance-benchmark"},{"title":"AWS BYOC Console Upgrade Guide for Version 8.x","href":"/automq-cloud/appendix/byoc-console-upgrade-to-8.x-guide"},{"title":"GCP BYOC Console Upgrade Guide to v8.x","href":"/automq-cloud/appendix/gcp-byoc-console-upgrade-to-8.x-guide"},{"title":"Azure BYOC Console Upgrade Guide to v8.x","href":"/automq-cloud/appendix/azure-byoc-console-upgrade-to-8.x-guide"}]}]}]},{"language":"cn","pages":[{"title":"cn","href":"/zh/automq-cloud/migrate-to-automq/overview"}]}]},"title":"Overview - AutoMQ Documentation","buildId":"dpl_C3fsfi1EcrBns9Vx91gUSN1X3Hi4","deploymentId":"dpl_C3fsfi1EcrBns9Vx91gUSN1X3Hi4","dynamics":["a74be98ba7"],"chunks":["zoom-image-lightbox-Evwtz42K.js","PlusIcon-DYlJbUaT.js","lightbox-handle-r17bVUz3.js"]}
