This document describes how to accelerate queries against Tencent Cloud Data Lake Compute (DLC) through Tencent Cloud TCHouse-D (TCHouse-D).
Prerequisites
Note:
1. Cross-region or cross-federal DLC is not supported. Please plan your environment properly to ensure that the Tencent Cloud TCHouse-D and DLC are in the same region and the same VPC.
2. The DLC native tables created before June 12, 2024 cannot be queried (with the storage path lakefs://***, because this format is not compatible currently). It only supports the DLC native tables (with storage path cosn://***) created after June 12, 2024 and all the DLC external tables.
Operation Steps
1. Enter the Tencent Cloud TCHouse-D console, and select the Tencent Cloud TChouse-D cluster which requires DLC query acceleration on the Cluster List page. Click the cluster name to view the cluster. 2. In the Lakehouse Integration page, you can see whether Lakehouse Integration is enabled. Click on the switch to enable Lakehouse Integration.
3. To enable Lakehouse Integration, you need to have the administrator permissions on DLC. Please use the root account (or a sub-account with the administrator permissions on DLC) to perform this operation.
Note:
1. You may skip this step if you already have administrator permissions on DLC.
2. If you are using a sub-account without the administrator permissions on DLC, please refer to the document Sub-Account Permission Management and get granted through an account that has administrator permissions on DLC. 4. Click on the Lakehouse Integration switch and enter the configuration page.
|
Catalog name | Customized as needed. It can contain up to 50 characters consisting of digit, letters, and _, but can not start with a digit. Tencent Cloud TCHouse-D will pull metadata from DLC through Catalog method. |
SecretId/SecretKey | It can be the SecretId/SecretKey of the root account or sub-account. Note: If you enter the SecretId/SecretKey of a CAM sub-account, please grant that sub-account with the full read-write permissions (QcloudCamFullAccess) in advance. |
Enable Metadata Auto-refresh | No: It supports manual metadata refresh only. Yes: Metadata refresh time can be specified to have metadata periodically pulled from DLC and updated. |
5. After configuring the above, click the Bind and enable button to complete enabling Lakehouse integration.
|
Edit | Click Edit to modify the Catalog name, SecretId, SecretKey, and Metadata automatic refresh mode. |
Manual Update | Click the Manual Update button to manually refresh and pull the metadata from DLC. |
6. Before querying DLC through Tencent Cloud Data TCHouse-D, go to the Tencent Cloud Data TCHouse-D console and then Account Management to grant query permissions on the DLC database table. 7. After the authorization, go to the MySQL Client or click SQL Workspace to enter the SQL workspace where you can accelerate query DLC through Tencent Cloud TCHouse-D. 8. In the SQL workspace, you can view the authorized database tables on the left side of the page and conduct queries through the SQL editor as needed.
Was this page helpful?