Build a Pipeline from the Workflow

In summary

  • The Workflow makes it easy to visualize and organize the Pipeline of a Schedule

  • Only the Schedule Owner and contributors can manage Task Workflow

  • All DC-Maestro users can consult the Workflow of a Public Schedule

  • The number and type of tasks is not limited

  • Select a task in the Workflow for display the detail, modify it or delete it

  • If applicable, a task is always executed after the task that precedes it, and only on success

  • Hover over tasks to display detailed information on linked items

  • Activate the accentuation option Accentuation in the Workflow menu to highlight direct links upstream and downstream of a task.

Workflow view

The Workflow makes it easy to visualize and organize a Pipeline of tasks.
Only the Schedule Owner and contributors can create, edit, and delete tasks.

Tasks can be linked together to define an execution order.

If tasks are not linked, DC-Maestro sends all execution requests simultaneously.

task no link
Workflow -No task is linked

If tasks are linked, DC-Maestro sends the execution requests according to the order defined in the Workflow.
In the example below, the exposure will be executed after the 2 persistence tasks, and only if these are executed successfully.

task linked
Workflow -All tasks are linked
To follow step by step the creation of a Pipeline, go to the tutorial page Building a Workflow.

Workflow menu

Editing tasks and the Pipeline is done from the Workflow tab.

workflow page
Workflow -Workflow View
Buttons
  • Save Saves all Pipelines tasks and links

  • Reorganize Reorganize all elements

Action menu
  • Connection failed Undo last action (maximum 10)

  • Zoom Zoom in / Zoom out Zoom out

  • Show Show / Hide Hide grid

  • Lock Lock / Unlock Unlock items

The menu on the right allows you to add and modify Workflow tasks.

Task menu
  • Add Selection of tasks to add in the Workflow

  • Settings Selected task settings

A task settings vary depending on its type. To select a DataChain item click on Select then select the item from the list.
To edit an item already selected, click on Edit.

You can see detailed information about the selected item in the menu on the right.
To see the item’s page in DataChain, click on the ID number in the grey box.

ID hover

If you are working in DataChain in another tab, and a Project other than that of the item is already selected, the item cannot be found.
In this case, select the Project linked to the Schedule and then click again on the identifier from DC-Maestro.
If you are not part of the Project linked to Planning, it will not be possible to see the corresponding item in DataChain.

If the instance is unreachable, if the DataChain element is deleted, or if the user does not have sufficient rights, this information is inaccessible and the following message is displayed next to the identifier:

Element DataChain inaccessible

Tasks removed from the Pipeline’s Workflow will no longer be executed.
A deleted task is still visible from the execution history, but it is no longer possible to access its execution log.