General Development Process

Recent Pages

General Development Process

Last updated: 2024-11-01 16:26:14

Enter the Orchestration Space page
1. log in to  WeData console.
2. Click the Project List in the left menu and find the target project for which you need to operate the development process.
3. After selecting a project, click to enter the Data Development module.
4. Click on the Orchestration Space in the left menu.
Workflow Operation Steps
New Folder
Click and select Create Folder, enter the folder name, and choose the target folder.
﻿
﻿
﻿
Note:
WeData supports creating multi-level folder directories. You can save the newly created folder to the root directory or other already existing folders.
Create New Workflow
1. Select the target folder in the left directory tree, right-click and choose Create New Workflow.
﻿
2. In the pop-up window for creating a new workflow, enter the workflow name and select the target folder, then click Confirm.
﻿
Note:
Workflows only support uppercase and lowercase letters, numbers, and underscores, and can include up to 100 characters.
Design Workflow
Create and Edit Tasks
1. Select the newly created workflow in the left directory tree, click the 
﻿
 button at the end, and choose Create New Task from the pop-up menu.
﻿
2. Select the task type that needs to be configured in the Workflow. Task Scheduling supports various task types to meet different development scenarios, such as  DataInLong, EMR, DLC, TCHouse, TDSQL, General, etc.
3. After creation (or double-clicking the task node name in the directory tree), task editing is done in the opened Task Tab Page.
4. After configuring multiple computing tasks, orchestrate them on the Workflow canvas to establish the upstream and downstream dependencies of the Task Nodes.
﻿
Submit Workflow
1. After editing the workflow, click the 
﻿
 icon in the toolbar to submit the nodes in the workflow to the Scheduling System.
2. View the details of the task nodes to be submitted this time in the submission dialog, and enter the relevant Change Description. 
3. Click Confirm to submit the workflow to the Operations Phase.
﻿
4. Submitted nodes will not appear in the popup if their content hasn't changed, but any changes to their attributes will be submitted normally. Go to Operation and Maintenance >Task Operation and Maintenance page.
﻿
Computing Task Operation Steps
Task Node Development supports various task types to meet different development application scenarios.
Create Task Node
Select the workflow, then click Create New Task and choose the type of computational task to create.
﻿
﻿
﻿
Configure Task Node
1. After creation, perform code development of the corresponding type on the Computational Task Canvas.
﻿
2. Configure task attributes and scheduling policies. Click Task Attribute﻿,Scheduling Settings on the right side of the task to configure the task’s Basic Information and Scheduling Information in the panel.
﻿
3. Select the Data source, Resource Queue, and Schedule Resource Group required for computing task execution.
﻿
4. Execute the Run feature to test whether the computational task results meet the expectations.
﻿
Submit Task Node
1. After configuring the computation code, task attributes, scheduling policies, and computing resources, and verifying that the test task runs as expected, Save and Submit the computational task to complete the task node configuration.
﻿
2. After configuring each computational task step-by-step, proceed to the workflow level orchestration configuration according to the Workflow Operation Steps, and then submit for scheduling and execution.
﻿