tencent cloud

All product documents
TDMQ for CKafka
DocumentationTDMQ for CKafkaPractical TutorialConnecting Kafka Connect to CKafka
Connecting Kafka Connect to CKafka
Last updated: 2024-01-09 14:56:36
Connecting Kafka Connect to CKafka
Last updated: 2024-01-09 14:56:36
Kafka Connect currently supports two execution modes: standalone and distributed.

Starting Connect in Standalone Mode

Start Connect in standalone mode by running the following command:
bin/connect-standalone.sh config/connect-standalone.properties connector1.properties [connector2.properties ...]
Accessing CKafka is basically the same as accessing the open-source Kafka, except that you need to change the value of bootstrap.servers to the IP address assigned when you apply for the instance.

Starting Connect in Distributed Mode

Start Connect in distributed mode by running the following command:
bin/connect-distributed.sh config/connect-distributed.properties
In this mode, Kafka Connect stores the offset, configuration, and task status information in Kafka topics, which are configured in the following fields in connect-distributed:
config.storage.topic
offset.storage.topic
status.storage.topic
These topics need to be created manually to ensure that their attributes meet the requirements of Connect.
config.storage.topic should have only one partition and multiple replicas and be in compact mode.
offset.storage.topic should have multiple partitions and replicas and be in compact mode.
status.storage.topic should have multiple partitions and replicas and be in compact mode.
Set bootstrap.servers to the IP address assigned when you apply for the instance.
Configure group.id to identify the Connect cluster, which should be differentiated from the consumer group.
Was this page helpful?
You can also Contact Sales or Submit a Ticket for help.
Yes
No

Feedback

Contact Us

Contact our sales team or business advisors to help your business.

Technical Support

Open a ticket if you're looking for further assistance. Our Ticket is 7x24 available.

7x24 Phone Support
Hong Kong, China
+852 800 906 020 (Toll Free)
United States
+1 844 606 0804 (Toll Free)
United Kingdom
+44 808 196 4551 (Toll Free)
Canada
+1 888 605 7930 (Toll Free)
Australia
+61 1300 986 386 (Toll Free)
EdgeOne hotline
+852 300 80699
More local hotlines coming soon