tencent cloud

Feedback

Query Acceleration for Tencent Cloud DLC

Last updated: 2024-08-02 12:43:41
    This document describes how to accelerate queries on Tencent Cloud DLC using Tencent Cloud TCHouse-D (TCHouse-D).

    Prerequisites

    The Tencent Cloud TCHouse-D cluster has been purchased.
    The Tencent Cloud DLC service has been activated.
    Note:
    1. Cross-regional Federal DLC is not supported. Plan your environment accordingly to ensure that Tencent Cloud TCHouse-D and DLC are in the same region and VPC;
    2. DLC stock native tables created before June 12, 2024 are not supported for query (storage path of the DLC stock native table is lakefs://***, and this format is not yet compatible)—— DLC new native tables created after June 12 (storage path is cosn://***) and all DLC external tables are supported.

    Operation Steps

    1. Enter the Tencent Cloud TCHouse-D console, and select the Tencent Cloud TChouse-D cluster which requires DLC query acceleration on the Cluster List page. Click the cluster name to enter the cluster.
    
    
    
    2. The account enabling Lakehouse must have administrative permissions for DLC. You can use the root account (or a sub-account with DLC administrator permissions) to perform this operation.
    
    
    
    3. The account enabling Lakehouse Integration must have administrative privileges for DLC. Please use the root account (or a sub-account with DLC administrator privileges) to perform this operation.
    Note:
    1. After clicking the Lakehouse
    2. If you are using a sub-account without DLC administrator privileges, please refer to the document Data Lake DLC Sub-account Permission Management to have an account with DLC administrator privileges grant you access.
    
    
    
    4. After clicking the Lakehouse switch, enter the configuration page.
    Field
    Field description
    Catalog name
    It is customized as needed, should not start with a number, can include numbers, letters, and _, and should not exceed 50 characters. Tencent Cloud TCHouse-D will retrieve metadata of the data lake DLC in Catalog mode.
    SecretId/SecretKey
    You can fill in the SecretId/SecretKey for the root account or sub-account. If you fill in the SecretId/SecretKey for a CAM sub-account, DLC-related CAM policies will be authorized for this sub-account simultaneously (including DLC full read-write policy and DLC bucket access policy). Note: Ensure that the sub-account requires enabling Lakehouse must have CAM full read-write permissions (QcloudCamFullAccess).
    Enable Metadata Auto-refresh
    No: Only manual metadata refresh is supported. Yes: You can configure the metadata refresh time. At the configured time, metadata will be periodically retrieved and updated from DLC.
    
    
    
    5. After completing the configuration, click the Bind Policy and Enable button to complete the Lakehouse enabling configuration.
    Field
    Field description
    Edit
    Click Edit to modify the catalog name, SecretId, SecretKey, and Metadata automatic refresh method.
    Manual Update
    Click the Manual Update button to manually refresh and retrieve the DLC metadata.
    
    
    
    6. Before querying DLC using Tencent Cloud Data TCHouse-D, users need to go to the Tencent Cloud Data TCHouse-D console's Account Management to grant query permissions for the DLC database table.
    
    
    
    
    
    
    7. After authorization, you can query accelerated DLC through the MySQL Client or click the SQL Workspace quick link to enter SQL Workspace, where you can query accelerated DLC using Tencent Cloud TCHouse-D.
    
    
    
    8. In SQL Workspace, you can view authorized database tables on the left side of the page and conduct queries in the SQL editor as needed.
    
    
    
    Contact Us

    Contact our sales team or business advisors to help your business.

    Technical Support

    Open a ticket if you're looking for further assistance. Our Ticket is 7x24 avaliable.

    7x24 Phone Support