Comparison with Apache Kafka

The details of TDMQ for CKafka and self-built open-source Kafka are as follows:
Project
Feature Item
TDMQ CKafka Version
Self-Built Kafka
Basic Feature
Topic Parameter Configuration
Support console adjustment of multiple parameters, including number of partitions, number of replicas, message cleanup policy, minimum sync replica count, duration of Segment sharding scrolling, message retention time, etc.
Command line configuration makes it difficult for business personnel to perform custom operations.
﻿
Change in Topic partition count
Support updating the Topic partition count on the console.
Command line configuration makes it difficult for business personnel to perform custom operations.
﻿
Sending Message
Support sending messages in the console.
It is not supported.
﻿
Consumption progress reset
Support resetting consumer offset on the console.
Manual backend configuration is complex and prone to errors.
﻿
Management ability
Support visualization management of clusters, topics, consumption groups, etc.; more fine-grained management capabilities can be provided through tags.
Support statistics on Topic production and consumption traffic, with traffic details clear at a glance.
Needs to be collocated with an open-source management system, with relatively weak ease of use.
Intelligent operations and maintenance
Disk automatic balancing
Support disk data balancing between Brokers for CKafka cluster instances with data skew problems, reduce the pressure of data skew on the cluster, and decrease the need for disk capacity.
It is not supported.
﻿
Intelligent inspection
Provide one-click diagnostic capability, can actively troubleshoot cluster issues and potential risks, and based on Tencent Cloud Expert experience, provide problem resolutions, automatically summarize health check results to generate reports, and achieve a closed-loop operation and maintenance experience.
It is not supported.
﻿
Intelligent Disk Configuration
Support automatic handling of disk water level. When the disk water level reaches the threshold, support dynamically adjusting message retention or automatically scaling the disk to avoid impacting the business.
It is not supported.
Isolation
Multi-instance
Creating multiple instances is supported based on one physical cluster.
It is not supported.
﻿
Bandwidth quota control
Each instance supports limiting usage based on bandwidth.
It is not supported.
﻿
Topic Traffic Throttling
Support traffic throttling in the Topic dimensionality, maximize the assurance of business reliability.
It is not supported.
﻿
Disk quota control
Each instance supports limiting usage by disk.
It is not supported.
﻿
Multiple Access Point Configuration
Supports configuring instance routing policy and setting access points in the specified VPC.
Unsupported. Sending messages requires specifying the Broker address, and receiving messages requires ZooKeeper coordination and scheduling. Not flexible enough.
﻿
Separation of control plane and data plane
The control plane and data plane are separated in architecture. Management and control operations are implemented by calling control components through the TencentCloud API SDK. Data plane operations are called through the open-source Kafka SDK, fully compatible with open source.
It is not supported.
﻿
Root Account Isolation
Based on the Tencent Cloud parent-child accounts system, implement data logical isolation between root accounts.
It is not supported.
Monitoring and Alarms
Out-of-the-Box
Mature standardized deployment and monitoring solutions, ready to use.
Not supported. Users need to self-build and maintain an open-source monitoring system. Moreover, if the monitoring system cannot meet the requirements, it is difficult to customize.
﻿
Monitoring Alarm
Provide rich monitoring metrics such as production and consumption peak bandwidth, production and consumption average bandwidth, production and consumption message count, disk utilization, instance connections, and unconsumed message count. Support multi-dimensional monitoring and alerts for instances, Topics, and consumption groups.
Not supported. Additional integration with open-source third-party components is required.
﻿
Metric Sorting
Support viewing the top 10 Topic production and consumption traffic and top 10 disk usage, and the top 10 consumption speed of Consumer Groups.
It is not supported.
﻿
Exception event log
Support viewing log details in the console, including consumer group coordinator log and controller log, for easy troubleshooting.
It is not supported.
High Availability
Cross-AZ High Availability Deployment
Support cross-AZ high-availability deployment and mature recovery plan. Support upgrading from single-AZ deployment to cross-AZ deployment.
Supported but more complicated, with deployment solutions and parameters to be designed.
﻿
Cross-Availability Zone Disaster Recovery
Support instance-level synchronization of data, support data replication and migration feature between instances in different regions, and ALL data and metadata of the instance will be synchronized.
Supported but more complicated, and the open-source solution has certain defects.
Security compliance
Topic-dimensional ACL access control
Support controlling access permissions based on user + IP range. Permission configuration supports down to the instance + Topic dimensionality, and support two modes: blocklist and allowlist.
Configuring parameters via the command line is cumbersome and prone to errors.
﻿
SASL password authentication
Support console configuration of SASL authentication.
Configuring parameters via the command line is cumbersome and prone to errors.
﻿
SSL authentication
Support console configuration of SSL certification.
Configuring parameters via the command line is cumbersome and prone to errors.
﻿
Manage operation permission control
Console operations are based on Tencent Cloud CAM permission control for secure and compliant access.
It is difficult to exercise granular control over management and control operation permissions.
﻿
Operations are traceable
Management and control operations are docked with CloudAudit and are traceable.
It is not supported.
Other
Online Upgrade Capability
CKafka provides the capability for version upgrades, allowing for seamless upgrades to the latest version when bugs or security vulnerabilities occur in the community edition.
Not supported. Manual operation is required. Manual upgrade may affect the business.
﻿
﻿
﻿

Was this page helpful?

You can also Contact Sales or Submit a Ticket for help.

Yes

Project	Feature Item	TDMQ CKafka Version	Self-Built Kafka
Basic Feature	Topic Parameter Configuration	Support console adjustment of multiple parameters, including number of partitions, number of replicas, message cleanup policy, minimum sync replica count, duration of Segment sharding scrolling, message retention time, etc.	Command line configuration makes it difficult for business personnel to perform custom operations.
		Change in Topic partition count	Support updating the Topic partition count on the console.	Command line configuration makes it difficult for business personnel to perform custom operations.
		Sending Message	Support sending messages in the console.	It is not supported.
		Consumption progress reset	Support resetting consumer offset on the console.	Manual backend configuration is complex and prone to errors.
		Management ability	Support visualization management of clusters, topics, consumption groups, etc.; more fine-grained management capabilities can be provided through tags. Support statistics on Topic production and consumption traffic, with traffic details clear at a glance.	Needs to be collocated with an open-source management system, with relatively weak ease of use.
Intelligent operations and maintenance	Disk automatic balancing	Support disk data balancing between Brokers for CKafka cluster instances with data skew problems, reduce the pressure of data skew on the cluster, and decrease the need for disk capacity.	It is not supported.
		Intelligent inspection	Provide one-click diagnostic capability, can actively troubleshoot cluster issues and potential risks, and based on Tencent Cloud Expert experience, provide problem resolutions, automatically summarize health check results to generate reports, and achieve a closed-loop operation and maintenance experience.	It is not supported.
		Intelligent Disk Configuration	Support automatic handling of disk water level. When the disk water level reaches the threshold, support dynamically adjusting message retention or automatically scaling the disk to avoid impacting the business.	It is not supported.
Isolation	Multi-instance	Creating multiple instances is supported based on one physical cluster.	It is not supported.
		Bandwidth quota control	Each instance supports limiting usage based on bandwidth.	It is not supported.
		Topic Traffic Throttling	Support traffic throttling in the Topic dimensionality, maximize the assurance of business reliability.	It is not supported.
		Disk quota control	Each instance supports limiting usage by disk.	It is not supported.
		Multiple Access Point Configuration	Supports configuring instance routing policy and setting access points in the specified VPC.	Unsupported. Sending messages requires specifying the Broker address, and receiving messages requires ZooKeeper coordination and scheduling. Not flexible enough.
		Separation of control plane and data plane	The control plane and data plane are separated in architecture. Management and control operations are implemented by calling control components through the TencentCloud API SDK. Data plane operations are called through the open-source Kafka SDK, fully compatible with open source.	It is not supported.
		Root Account Isolation	Based on the Tencent Cloud parent-child accounts system, implement data logical isolation between root accounts.	It is not supported.
Monitoring and Alarms	Out-of-the-Box	Mature standardized deployment and monitoring solutions, ready to use.	Not supported. Users need to self-build and maintain an open-source monitoring system. Moreover, if the monitoring system cannot meet the requirements, it is difficult to customize.
		Monitoring Alarm	Provide rich monitoring metrics such as production and consumption peak bandwidth, production and consumption average bandwidth, production and consumption message count, disk utilization, instance connections, and unconsumed message count. Support multi-dimensional monitoring and alerts for instances, Topics, and consumption groups.	Not supported. Additional integration with open-source third-party components is required.
		Metric Sorting	Support viewing the top 10 Topic production and consumption traffic and top 10 disk usage, and the top 10 consumption speed of Consumer Groups.	It is not supported.
		Exception event log	Support viewing log details in the console, including consumer group coordinator log and controller log, for easy troubleshooting.	It is not supported.
High Availability	Cross-AZ High Availability Deployment	Support cross-AZ high-availability deployment and mature recovery plan. Support upgrading from single-AZ deployment to cross-AZ deployment.	Supported but more complicated, with deployment solutions and parameters to be designed.
High Availability		Cross-Availability Zone Disaster Recovery	Support instance-level synchronization of data, support data replication and migration feature between instances in different regions, and ALL data and metadata of the instance will be synchronized.	Supported but more complicated, and the open-source solution has certain defects.
Security compliance	Topic-dimensional ACL access control	Support controlling access permissions based on user + IP range. Permission configuration supports down to the instance + Topic dimensionality, and support two modes: blocklist and allowlist.	Configuring parameters via the command line is cumbersome and prone to errors.
		SASL password authentication	Support console configuration of SASL authentication.	Configuring parameters via the command line is cumbersome and prone to errors.
		SSL authentication	Support console configuration of SSL certification.	Configuring parameters via the command line is cumbersome and prone to errors.
		Manage operation permission control	Console operations are based on Tencent Cloud CAM permission control for secure and compliant access.	It is difficult to exercise granular control over management and control operation permissions.
		Operations are traceable	Management and control operations are docked with CloudAudit and are traceable.	It is not supported.
Other	Online Upgrade Capability	CKafka provides the capability for version upgrades, allowing for seamless upgrades to the latest version when bugs or security vulnerabilities occur in the community edition.	Not supported. Manual operation is required. Manual upgrade may affect the business.

tencent cloud

Sign Up

Log in

Compute

Microservice

Data Migration

Database SaaS Tool

Data Security

Application Security

Big Data

Image Creation

Internet of Things

Stream Services

Cloud Real-time Rendering

Management and Audit Tools

Edge Computing

Serverless

Relational Database

Networking

Business Security

Domains & Websites

Face Recognition

AI Platform Service

Middleware

Media On-Demand

Game Services

Developer Tools

Container

Essential Storage Service

Enterprise Distributed DBMS

CDN and Acceleration

Security Services

Enterprise Applications

Tencent Big Model

Natural Language Processing

Communication

Media Process Services

Education Sevices

Monitor and Operation

Distributed cloud

Data Process and Analysis

NoSQL Database

Network Security

Cloud Security

Office Collaboration

Voice Technology

Optical Character Recognition

Interactive Video Services

Media SDK

Cloud Resource Management

More