Data Lake Compute (DLC) supports using user-defined functions to process and build data, as well as managing functions.
Creating a Function
1. Log in to the DLC Console and select the service region. Ensure the logged-in account has database operation permissions. 2. Go to the Data Management Page and click the database name where you want to create the function.
3. Select the function, then click the Create Function button to enter the function creation menu.
The function packet supports local uploads or the use of existing JAR files in COS. Local uploads only support JAR format, with a maximum size of 5 MB.
Select the Spark cluster to run the function. There will be no fees incurred during the execution.
It is recommended to save the function package to the system for easy management and use. You can also mount it to a specified COS path.
Viewing Function Information
1. Log in to the DLC Console and ensure the account has database operation permissions. 2. Go to the Data Management Page and click the database name where the function is located.
3. Select the function to view its build status. If the build fails, you can edit and resubmit it.
4. Click the Function Name to view detailed information about the function.
Editing Function Information
1. Log in to the DLC Console and select the service region, and ensure the logged-in account has database operation permissions. 2. Go to the Data Management Page and click the database name where the function is located.
3. Select the function, then click the Edit button to enter the function information editing page.
Currently, you cannot modify the function name, storage method, or upload method. If you need to change this information, you must recreate the function.
After the function information is modified, it will be rebuilt. Please operate with caution.
Deleting a Function
For functions that are no longer needed, you can delete them.
1. Log in to the DLC Console and select the service region. Ensure the logged-in account has database operation permissions. 2. Go to the Data Management Page and click the database name where the function is located.
3. Select the function, then click the delete button to remove the function that is no longer needed.
Note
After deletion, the data under this function will be cleared and cannot be recovered. Please operate with caution.