This document describes how to accelerate queries on Tencent Cloud DLC using Tencent Cloud TCHouse-D (TCHouse-D).
Prerequisites
Note:
1. Cross-regional Federal DLC is not supported. Plan your environment accordingly to ensure that Tencent Cloud TCHouse-D and DLC are in the same region and VPC;
2. DLC stock native tables created before June 12, 2024 are not supported for query (storage path of the DLC stock native table is lakefs://***, and this format is not yet compatible)—— DLC new native tables created after June 12 (storage path is cosn://***) and all DLC external tables are supported.
Operation Steps
1. Enter the Tencent Cloud TCHouse-D console, and select the Tencent Cloud TChouse-D cluster which requires DLC query acceleration on the Cluster List page. Click the cluster name to enter the cluster. 2. The account enabling Lakehouse must have administrative permissions for DLC. You can use the root account (or a sub-account with DLC administrator permissions) to perform this operation.
3. The account enabling Lakehouse Integration must have administrative privileges for DLC. Please use the root account (or a sub-account with DLC administrator privileges) to perform this operation.
Note:
1. After clicking the Lakehouse
4. After clicking the Lakehouse switch, enter the configuration page.
|
Catalog name | It is customized as needed, should not start with a number, can include numbers, letters, and _, and should not exceed 50 characters. Tencent Cloud TCHouse-D will retrieve metadata of the data lake DLC in Catalog mode. |
SecretId/SecretKey | You can fill in the SecretId/SecretKey for the root account or sub-account. If you fill in the SecretId/SecretKey for a CAM sub-account, DLC-related CAM policies will be authorized for this sub-account simultaneously (including DLC full read-write policy and DLC bucket access policy). Note: Ensure that the sub-account requires enabling Lakehouse must have CAM full read-write permissions (QcloudCamFullAccess). |
Enable Metadata Auto-refresh | No: Only manual metadata refresh is supported. Yes: You can configure the metadata refresh time. At the configured time, metadata will be periodically retrieved and updated from DLC. |
5. After completing the configuration, click the Bind Policy and Enable button to complete the Lakehouse enabling configuration.
|
Edit | Click Edit to modify the catalog name, SecretId, SecretKey, and Metadata automatic refresh method. |
Manual Update | Click the Manual Update button to manually refresh and retrieve the DLC metadata. |
6. Before querying DLC using Tencent Cloud Data TCHouse-D, users need to go to the Tencent Cloud Data TCHouse-D console's Account Management to grant query permissions for the DLC database table. 7. After authorization, you can query accelerated DLC through the MySQL Client or click the SQL Workspace quick link to enter SQL Workspace, where you can query accelerated DLC using Tencent Cloud TCHouse-D. 8. In SQL Workspace, you can view authorized database tables on the left side of the page and conduct queries in the SQL editor as needed.
Was this page helpful?