Feature Overview
WeData SQL Exploration feature is designed for data developers and business analysts, providing a convenient and fast data query and analysis IDE. It supports connecting to big data engines such as EMR and DLC for data exploration. Currently covered data sources include: EMR-Hive, EMR-Kyuubi, EMR-Trino, DLC, TCHouse-X.
Note
Currently, SQL exploration is in the public beta stage. You can experience the "Data Exploration Experience Resource Group" for free. After the public beta, billing will be based on the usage of the queries.
Operation step
Enter the SQL Exploration page
1. Log in to the Data Development and Governance Platform WeData Console.
2. click the Project List in the left menu, and find the target project for the Notebook Exploration feature.
3. After selecting a project, click to enter the Data Development module.
4. click SQL Exploration in the left menu.
Database and Table
Database and Table Query
1. Select a data source, and all databases and table information under that data source will be displayed below.
2. Support searching by entering the table name.
3. click Data Table Name to quickly query table field names, field types, and description information.
Quick operations
1. In the left directory tree, select a Data Table and click More > Copy SQL > Copy Table Name to copy the query statement and the Table Name of the data table.
2. In the script editing area on the right, you can quickly paste the copied content.
Script
New Folder
Method One: Switch to the "Script" tab, click "+", and select New Folder.
Method Two: Click the "More" button on the directory tree, and select New Folder.
Enter the folder name, select the parent folder, and click Confirm to create it successfully.
New Query Script
Method One: Click "+", and select New Query Script.
Method Two: Click the "More" button on the directory tree, and select New Query Script.
Enter the script name, select the script type and parent folder, and click Confirm to create it successfully.
1. Configure data sources, computing resources, and execution resources for the current query script.
|
Data Destination | The currently supported data source types include EMR-Hive, EMR-Kyuubi, EMR-Trino, DLC, and TCHouse-X. Note: EMR-Hive, EMR-Kyuubi, and EMR-Trino data sources currently only support system data sources, and do not support custom data sources yet. |
Computing Resources | Engine computing resources used for specific data read and write operations:
When selecting EMR-Hive or EMR-Kyuubi data sources, the dropdown options are the queue information of the corresponding EMR cluster; When selecting EMR-Trino data sources, there is no need to choose computing resources; When selecting DLC data sources, the dropdown options are the computing resources bound to the DLC engine. |
Execute Resources | The computing resources used to execute the current query script currently only support selecting the "Data Exploration Experience Resource Group". Note: During the invitation testing phase, users can try for free the "Data Exploration Experience Resource Group," which supports performance parameters of 20 concurrent sessions per main account. After the invitation testing ends, commercial billing will be implemented. |
2. Enter SQL statements in the code editing area (marker 4). The currently supported SQL statements include DDL, DML, DQL, etc.
3. Click "Format" button (marker 3) to format the current code segment.
4. Click "Run" button (marker 1) to execute the current script. The results will be returned in the area below (marker 4). If there are multiple SQL statements, multiple results will be returned.
5. Click "Save" button (marker 2) to save the current script content for quick access next time.
Was this page helpful?