tencent cloud

Feedback

Release Notes

Last updated: 2024-06-27 11:53:37

    April 2023

    Update
    Description
    Release Date
    Documentation
    Enhanced Flink UI security control
    Flink UI supports access allowlist configuration.
    2023-04-17
    Optimized the ClickHouse connector
    Optimization is made to alleviate this issue: Joining of multiple streams causes many data changes. As a result, the data sink has much pressure on ClickHouse.
    2023-04-17
    Optimized job log level configurations
    Users can configure the log level of jobs in batches.
    2023-04-17
    Optimized database connection via JDBC
    The error in splicing Oracle JDBC statements using composite primary keys is fixed.
    2023-04-17
    Optimized capabilities related to monitoring metrics
    The system supports display and alarm configuration for Kafka job latency metrics.
    2023-04-17
    Optimized FileSystem
    The system supports compression formats such as Snappy for sinking data in Raw format to FileSystem.
    2023-04-17

    March 2023

    Update
    Description
    Release Date
    Documentation
    Optimized dependency management
    The logic for deleting dependencies and dependency versions is optimized.
    2023-03-17
    Supported the Iceberg connector of the new version
    The Iceberg connector of the new version is supported.
    2023-03-17
    Optimized the job startup message
    Before a user starts a job, the system will check whether there are sufficient subnet IPs for the configured parallelism. If no, it will prompt the user.
    2023-03-17
    Supported SQL version comparison
    Users can compare SQL code and configurations of different versions of a SQL job.
    2023-03-03
    Optimized the Redis connector
    The performance of Redis dimensional table query is improved (greatly improved in the scenario of a lot of empty results), and Flink 1.14 SQL jobs can use the Redis connector.
    2023-03-03
    Supported the StarRocks connector
    The system supports the StarRocks connector based on the open-source starrocks-connector-for-apache-flink v1.2.4. Data can be read from and written to StarRocks via Flink. (Flink 1.13 | 1.14)
    2023-03-03
    Optimized MySQL CDC
    The system ignores the data change‍s of non-DDL fields in MySQL CDC.
    2023-03-03
    Supported the MongoDB CDC of the new version
    The MongoDB CDC of the new version is supported.
    2023-03-03
    Optimized cluster purchase
    A user other than a super admin can click to purchase a cluster.
    2023-03-03
    -
    Added display of abnormal jobs and idle cluster CUs
    Cluster overview is added to the job management module, which displays the statistics of the clusters associated with this workspace, including total number of clusters, total number of CUs, and number of idle CUs. The total number of jobs with metric alarms and that of jobs with events are added to the job overview section, and support clicking for quick filtering.
    2023-03-03
    Optimized the database/table reference feature
    Users can edit DDL instead of creating a new one. They can edit WITH parameters (except connector). A change record button is added to the View DDL page for users to view the DDL change records, which facilitates tracking.
    2023-03-03

    February 2023

    Update
    Description
    Release Date
    Documentation
    Optimized batch job deletion
    The logic of displaying jobs for batch deletion is optimized so that folders containing only jobs that cannot be deleted will no longer be selected by default.
    2023-02-09
    Added the SQL Server CDC connector
    The SQL Server CDC connector is added. SQL Server CDC can only be used a source so as to read full data or incremental data from the SQL Server database. (Flink 1.14)
    2023-02-09
    Supported Doris catalog
    The catalog feature of Cloud Data Warehouse for Apache Doris is introduced to avoid manual registration of Doris tables, improving job development efficiency and ensuring correct schema mapping.
    2023-02-09
    -
    Supported transactions by Doris (data sink)
    The system supports end-to-end Exactly-Once for writing to Doris.
    2023-02-09
    -
    Upgraded the hadoop-shaded package
    The flink-hadoop-shaded package has compatibility issues due to a low version (2.7.5) and is upgraded to the latest version 2.8.3.
    2023-02-09
    -
    Upgraded the KonaJDK version
    The KonaJDK version is upgraded to avoid deadlocks.
    2023-02-09
    -
    Optimized MySQL CDC
    The issue that the MySQL CDC string key data is not evenly distributed is fixed so that string primary key chunks are evenly distributed and jobs no longer encounter OOM.
    MySQL CDC connection merge supports the Kudu data sink. The Kudu connector is refactored with the new Flink Sink API.
    The TDSQL GTID issue that caused job failures is fixed.
    2023-02-09
    Optimized Ingress
    The rules of deleting and adding Ingress are optimized.
    2023-02-09
    -
    Optimized event alarms
    The system allows users to configure alarms for "job stopped" events after being redirected to EventBridge.
    2023-02-09
    Optimized job copy creation
    After a user creates a copy of a job, the copy can carry a savepoint for fast job migration and restoration.
    2023-02-09
    Optimized variable management
    A variable name now supports 100 characters.
    2023-02-09
    Supported auto scaling of jobs as scheduled
    Users can set the start and stop time, object, and scaling proportion for auto tuning.
    2023-02-09
    -
    Optimized checkpoint management
    The latest five checkpoints are retained for a job by default. Users can configure the number of checkpoints to retain in advanced parameters.
    2023-02-09

    January 2023

    Update
    Description
    Release Date
    Documentation
    Optimized the JDBC (data sink)
    Users can configure parameters to determine whether to ignore the Delete operation.
    2023-01-16
    Optimized the support for Cloud Data Warehouse for PostgreSQL
    Cloud Data Warehouse for PostgreSQL (flink-connector-cdw-postgre) v2.0 is supported.
    2023-01-16
    Optimized the Kafka connector
    The incorrect database/table subscription issue is fixed for the Kafka connector.
    2023-01-16
    Optimized the COS connector
    The COS connector META-INF Shade error is fixed, and Flink 1.14 SQL jobs can use the COS connector.
    2023-01-16
    Fixed TopN operator issues
    This issue is fixed: An error may occur due to status mismatch when TopN operators of Flink encounter functions such as now().
    2023-01-16
    -

    December 2022

    Update
    Description
    Release Date
    Documentation
    Optimized MySQL CDC monitoring metrics
    The following monitoring metrics are added: CurrentFetchEventtimeLag, CurrentEmitEventtimeLag, taskmanager_job_task_backpressuredtimemspersecond, and taskmanager_job_task_dataskewcoefficient.
    2022-12-16
    Supported automatic table creation in Hive by database sync SQL
    Database sync SQL supports automatic creation of missing tables in Hive.
    2022-12-16
    -
    Supported extraction of metadata fields in database sync
    In database sync, metadata fields such as the database name, table name, and timestamp can be extracted.
    2022-12-16
    -
    Supported more data types for ClickHouse
    ClickHouse supports Map, Array, and Row data types.
    2022-12-16
    Supported Data Lake Compute (DLC)
    The system supports writing to native tables managed in DLC. (Flink 1.14)
    2022-12-16
    Supported TDMQ for Pulsar
    The Pulsar SQL connector allows users to query data in Pulsar topics or write data to Pulsar using simple SQL queries or Flink Table API. (Flink 1.13|1.14)
    2022-12-16
    Optimized metadata fields supported by MySQL CDC
    MySQL CDC supports access of metadata fields such as Pos, File, and Gtid.
    2022-12-16
    Optimized chunk division by MySQL CDC composite primary key
    Users can select a column as the division key in an MySQL CDC composite primary key scenario.
    2022-12-16
    Supported a dynamic key in ZADD by the Redis connector
    The Redis connector allows a dynamic field to be used as the key in ZADD mode.
    2022-12-16
    Optimized the FileSystem connector
    The FileSystem connector supports the compress algorithm.
    2022-12-16

    September 2022

    Update
    Description
    Release Date
    Documentation
    Optimized the MySQL CDC performance
    The performance for reading incremental data from MySQL CDC is optimized.
    2022-09-16
    MySQL CDC Database
    Upgraded the COS connector version
    The COS connector version is upgraded.
    2022-09-16
    Supported custom role permissions
    Custom role permissions are supported.
    2022-09-05
    Optimized Doris performance
    The Doris write performance is optimized.
    2022-09-05
    -
    Supported Kafka source merge and database sync
    The system supports Kafka source merge and database sync (a single topic and multiple schemas).
    2022-09-05
    Supported custom job log levels
    Users can customize the log level when configuring running log collection for a job.
    Users can customize the log level when querying job logs.
    2022-09-05
    
    
    Contact Us

    Contact our sales team or business advisors to help your business.

    Technical Support

    Open a ticket if you're looking for further assistance. Our Ticket is 7x24 avaliable.

    7x24 Phone Support