Build a Pipeline from the Workflow

In summary

  • The Workflow makes it easy to visualize and organize the Pipeline of a Schedule

  • Only the Schedule Owner and contributors can manage Task Workflow

  • All DC-Maestro users can consult the Workflow of a Public Schedule

  • A function allows you to calculate the optimal workflow for updating the output elements of a Project

  • Select a task in the Workflow for display the detail, modify it or delete it

  • If applicable, a task is always executed after the task that precedes it, and only on success

  • Hover over tasks to display detailed information on linked items

  • Activate the accentuation option Accentuation in the Workflow menu to highlight direct links upstream and downstream of a task.

Workflow view

The Workflow makes it easy to visualize and organize a Pipeline of tasks.
Only the Schedule Owner and contributors can create, edit, and delete tasks.

Tasks can be linked together to define an execution order.

If tasks are not linked, DC-Maestro sends all execution requests simultaneously.

task no link
Workflow -No task is linked

If tasks are linked, DC-Maestro sends the execution requests according to the order defined in the Workflow.
In the example below, the exposure will be executed after the 2 persistence tasks, and only if these are executed successfully.

task linked
Workflow -All tasks are linked
To follow step by step the creation of a Pipeline, go to the tutorial page Building a Workflow.
If no peristance action is required only the Dashboard and API Publications update tasks will be present.
It is possible to create the workflow of a chain without output (exhibitions or publication) by configuring an export to a final datablock and launching the automatic calculation from this task. This does not work at dashboard level.

If the result of the automatic calculation is empty, this may mean that there are no output elements found in the chain (exhibitions, publications, exports) or that you do not have sufficient Datachain rights to these elements.

Generate a calculation

For the workflow generated to be consistent with the project, the user launching the workflow calculation must have full rights to the project elements.

The automatic workflow generation function can be accessed via the action menu by clicking on the icon Automatic calculation .

menu workflow maestro
Workflow -Action menu

When the automatic calculation is triggered, a configuration modal is displayed which allows the export tasks to be included or not.

Only registered export jobs are taken into account in the calculation.
generation auto wf maestro
Workflow -Configuration mode

As soon as the calculation is complete, the new Workflow is displayed on the screen +. You must save the changes to retain the new workflow.

If several independent processing chains (i.e. which do not share any elements in common) are present in the Project, these two chains will appear disjoint in the Workflow.
You will need to link them together in the interface if necessary.
If there is no link, these chains will be executed in parallel.

Pour éviter les incohérences de mise à jour des données, il n’est pas recommandé de définir plusieurs Planifications Maestro sur un même Projet DataChain.
Il est préférable de dupliquer le Projet s’il contient plusieurs chaîne disjointes à automatiser et de conserver des chaines de traitement unique par Projet.

Workflow menu

Editing tasks and the Pipeline is done from the Workflow tab.

workflow page
Workflow -Workflow View
Buttons

  • Save Saves all Pipelines tasks and links

  • Reorganize Reorganize all elements

Action menu

  • Connection failed Undo last action (maximum 10)

  • Zoom Zoom in / Zoom out Zoom out

  • Show Show / Hide Hide grid

  • Lock Lock / Unlock Unlock items

The menu on the right allows you to add and modify Workflow tasks.

Task menu

  • Add Selection of tasks to add in the Workflow

  • Settings Selected task settings

A task settings vary depending on its type. To select a DataChain item click on Select then select the item from the list.
To edit an item already selected, click on Edit.

You can see detailed information about the selected item in the menu on the right.
To see the item’s page in DataChain, click on the ID number in the grey box.

ID hover

If you are working in DataChain in another tab, and a Project other than that of the item is already selected, the item cannot be found.
In this case, select the Project linked to the Schedule and then click again on the identifier from DC-Maestro.
If you are not part of the Project linked to Planning, it will not be possible to see the corresponding item in DataChain.

If the instance is unreachable, if the DataChain element is deleted, or if the user does not have sufficient rights, this information is inaccessible and the following message is displayed next to the identifier:

Element DataChain inaccessible

Tasks removed from the Pipeline’s Workflow will no longer be executed.
A deleted task is still visible from the execution history, but it is no longer possible to access its execution log.
Related pages