WeData provides batch operations for tasks, enabling users to quickly modify task attributes, submit, and delete tasks.
Operation Entry
Log in to the WeData console. In the Data Development > Orchestration Space left menu, you can access batch operations for tasks.
Operation Type
Modify Resource Group
You can batch modify the selected tasks’ integrated resource group and schedule resource group. The system will automatically determine if there are data computation tasks and integrated tasks among the selected tasks. If such tasks exist, options for the schedule resource group and integrated resource group will automatically pop up. The schedule resource group and integrated resource group for the selected tasks will be modified to the corresponding resource groups.
Modify person in charge
You can batch modify the person in charge for the selected tasks. The batch operation will change the person in charge of the selected tasks to the chosen person.
Modifying Data Source
Note:
Currently, batch modification of the data source supports selected tasks of the same type. The supported task types are Hive SQL, JDBC SQL, DLC SQL, Spark SQL, TCHouse-P, Trino.
You can batch modify the data source of the selected tasks. The batch operation will change the data source of the selected tasks to the data source selected from the dropdown.
Modify Task Parameters
Note:
The operation of modifying task parameters must meet one of the following conditions:
DLC SQL tasks with the same engine type, and the engine type cannot be empty.
Selected tasks are all of type TCHouse-X;
Selected tasks are all of type Spark, SparkSQL, PySpark.
You can batch modify the parameters of the selected tasks. The specific format of parameter input will differ depending on the task type.
For SparkSQL, PySpark, and Spark tasks using the EMR engine, the parameter input content is as follows. Two modification methods are provided: Overwrite and Addition.
Overwrite: Existing application parameters of the task will be deleted and replaced with the batch-configured application parameters.
Addition: Existing application parameters of the task will not be deleted, and the batch-configured application parameters will only be added to the task's application parameters.
Modify Scheduling Period
Note:
Batch modification of the scheduling period will only change the scheduling period of the selected tasks. It will not change the configuration of upstream and downstream dependencies. This may lead to errors in upstream and downstream task dependencies, resulting in task submission failure.
For example, if downstream task B depends on upstream hourly task A and uses a custom Definition interval range, the custom Definition interval range will not change automatically after modification, which may result in task submission failure.
You can batch modify the scheduling period of the selected tasks. The modifiable content is consistent with the scheduling policy in the task's scheduling settings. Batch operation will change the scheduling policy of the selected tasks to the configured scheduling policy.
Modify Scheduling Advanced Settings
You can batch modify the advanced scheduling configuration of the selected tasks. The modifiable content is consistent with the advanced settings in the task's scheduling settings. Batch operation will change the advanced scheduling settings of the selected tasks to the configured content.
Modify Scheduling Parameters
You can batch modify the scheduling parameters of the selected tasks. The modifiable content is consistent with the content in Task Attributes > Scheduling Parameters. Batch operation will set the scheduling parameters of the selected tasks to the input scheduling parameters.
Submit Task
Note:
In the case where the task submission approval is enabled in Project Management > Basic Information Configuration > Approval Configuration, the task submission will first go to the approval center. The task will be truly submitted to Task Operation and Maintenance only after approval.
Whether the task is successfully submitted depends on the task's configuration and the status of upstream tasks.
You can batch submit the selected tasks. Currently, the tasks that can be submitted include:
Draft Task.
Tasks submitted for scheduling but still needing modifications.
1. Enter the bulk operation interface and filter by checking Display Submittable Tasks Only at the top of the list.
2. Select the tasks you need to submit, choose Submit version and start scheduling as the submission method, fill in the change description, and click Confirm.
Deleting task
Note:
Deletion is only effective for tasks with the status "Stopped, Draft, New, Pending Review, Approval Rejected". Other tasks will not be deleted.
Batch deletion will remove the selected tasks, and by default, they will go to the Recycle Bin after deletion. The system will automatically skip tasks that cannot be deleted.
Batch operation records
All types of batch operations are recorded in the Batch Operation Records, where you can check the progress and results of batch operations in the Batch Operation Records.
1. In the bulk operation interface, click Batch Operation Records.
2. Enter the Batch Operation Records interface to view the progress and results of all types of batch operations.
3. Meanwhile, you can switch between the operation success list and the operation failure list to see which types of batch operations failed.
Yes
No
Was this page helpful?