Topic is the name of a category where messages can be stored and published. CKafka uses the concept of topic externally, that is, a producer writes messages to a topic, while a consumer read messages from it. To implement horizontal scaling, a topic actually consists of multiple partitions. When a performance bottleneck occurs, you can scale out the topic by adding more partitions.
This document describes how to create a topic in the CKafka console.
2. In the instance list, click the ID/Name of your instance to enter the instance details page.
3. On the instance details page, click Topic Management at the top and click Create.
4. In the Create Topic window, set the Partition Count, Replica Count, and other parameters.
Name: The topic name. It cannot be changed once entered and can contain only letters, digits, underscores, or symbols ("-" and ".").
Partition Count: It is a concept in physical partition, where one topic can contain one or more partitions. CKafka uses partition as an allocation unit. For more information on how to configure the partition count, see Configuration Guide for Common Parameters in CKafka.
Replica Count: The number of partition replicas that are used to ensure the high availability of the partition. To ensure data availability, two replicas are enabled by default. Replicas are also counted into the number of partitions. For example, if you create 1 topic with 6 partitions and 2 replicas for each partition, then you have a total of 12 partitions (1 x 6 x 2).
Note:
A single-replica topic cannot guarantee high availability. Select the partition count with caution.
Tag: Set a resource tag. For more information, see Tag Overview.
Preset ACL Policy: Select the preset ACL policy. For more information on ACL policy, see Configuring ACL Policy.
5. Click Submit.
Step 2. Configure advanced topic parameters
1. On the instance list page, click the ID/Name of the target instance to enter the instance details page.
2. On the instance details page, select Topic Management.
3. In the Operation column, click Edit > Show advanced configuration and set the following parameters:
The parameters are as detailed below:
Parameter
Default Value
Valid Values/Value Range
Description
cleanup.policy
delete
delete/compact
Log can be deleted by retention time, or can be compacted by key (the compact mode is required for kafka connect).
min.insync.replicas
1
-
When "producer" sets "request.required.acks" to 1, "min.insync.replicas" will specify the minimum number of replicas.
unclean.leader.election.enable
true
true/false
This parameter specifies whether a replica not in ISR can be set as a leader.
segment.ms
-
1 – 90 days
The segment shard rolling duration in ms.
retention.ms
The message retention period of the instance.
60,000 ms–90 days
The message retention period at the topic level.
retention.bytes
The message retention size of the instance.
1–1,024 GB
Message retention size for a topic = partition count * retention.bytes. If both the message retention period and message retention size are set for a topic, the actual message retention will be determined by which threshold is reached first.
max.message.bytes
-
1 KB–12 MB
The maximum message size at the topic level. If this parameter is left empty, it will be 1 MB by default.
Yes
No
Was this page helpful?