Schedules Management

In summary

  • The Scheduling is used to manage and automate execution of task pipelines as Workflow

  • A Schedule is linked to a single DataChain Project: this determines which DataChain elements are available for task execution

  • The user who creates a schedule is automatically assigned as the Schedule Owner: this account is used to send execution requests to third-party applications

  • Only the Owner of the Schedule can delete it, add contributors (users or groups)

  • The owner and the contributors can modify* the parameters, the task pipeline and launch *executions

  • Confidentiality* allows you to define whether Scheduling is Private (visible only to the Owner and contributors) or Public (visible to all DC-Maestro users)

  • All past executions are visible in the history tab

  • The Project can be modified and tasks mapped to elements of the new Project

To follow step by step the creation of a Schedule, go to the tutorial page Create a Schedule.

Introduction to Schedules

Schedules are the central element of data processing automation in DC-Maestro.
It allows to manage, describe and automate a Pipeline of tasks.

A Schedule contains a lot of information (metadata) of different kinds.
Some are generated automatically by DC-Maestro, others are managed by the Owner and contributors of the Schedule.

To learn more about managing tasks in a Schedule, visit Task Management.

Workflow

The Workflow contains all the information relating to the Pipeline.

When executing a Schedule, an execution request is sent for all the tasks in the Pipeline.
Depending on their scheduling, the tasks will be all or partially executed.

To learn more about executions and the impact of task scheduling, go to the paragraph on the executions page relating to the execution order of tasks.

History

The history is used to display all the Pipeline executions at a specific time.
Each execution generates a global execution status and for each task.
Each task execution generates an execution log.

To learn more about the history and the execution log, see Schedule Execution.

Settings

The Parameters tab contains all the information relating to Planning and its execution.

Settings

Zone 1
  • Confidential: defines access restrictions

    • Private: visible and modifiable only by the Owner and users and members of groups added as contributors.

    • Public: visible in read-only mode to all DC-Maestro users, but modifiable only by the Owner and contributors.

  • Status: defines whether the schedule is active or inactive (can no longer be run, whether manually or automatically)

  • Name: short description of the schedule, visible in the lists

  • Description: long description to provide additional information about the schedule (context, objective, etc.)

  • Tags: keywords used to classify Schedules and simplify searches and item grouping.

Zone 2
  • DataChain Project: Project in which the DataChain elements available or used for task execution are located (a single Project per pipeline).

  • Owner: the user in whose name the tasks are run

  • Contributors: users and groups who can perform multiple actions on Planning (apart from deleting it and managing contributors).

  • Creation date: date on which the schedule was created

  • Last modified date: date of the last modification (including all modifications).

Zone 3
  • Type of execution: specifies whether the schedule is to be executed automatically

    • manual: suitable for runs where the update frequency cannot be defined, or for testing a schedule being created

    • Automatic: runs at the defined frequency, but can also be run manually.

  • Frequency: defines how often automatic schedules are run

Planning roles

Schedule Owner

The Owner is the user who created the schedule: tasks are executed in his name, according to his rights and permissions in DataChain Core, even if it is another user (contributor or administrator) who has started the execution.

To secure the execution of the schedule, the schedule creator must enter his DataChain password.

Only the owner can delete the schedule and manage groups and users.

Contributors

Users and groups added as contributors can perform actions on Planning, apart from managing contributors and deleting Planning.
When a contributor triggers the execution of the pipeline, it is always executed in the name of the Owner, i.e. with regard to his/her rights and permissions on the elements of the tasks defined in the pipeline.

From the list of executions, the icon Contributor indicates that you are a contributor on this schedule.

The elements associated with the tasks are available according to the rights of the contributing user, so it is possible that he may have access to a schedule which includes tasks linked to DataChain elements to which he does not have access. In this case, they will not be able to see these elements.

Example

The user UA has access to the Project My Project and all the elements it contains.
From DC-Maestro, it creates a task pipeline with different elements of the My Project and adds the user UB.

If UB does not have access to the DataChain project linked to this Schedule, he will be able to add tasks but will not be able to link them to DataChain elements or see the elements already associated with existing tasks.

Managing contributors

Only the Owner can manage contributors.
Contributors can be users or groups of users.

Contributors have the same rights to the schedule as the Owner, but cannot delete it or manage contributors.

To add contributors, select the "Settings" tab and then click on Edit next to the contributors area to open contributor manager page.

image:interface/contributors-manager.svg [Contributor management]

From the add zone at the top left, search and select from the list the group or user you wish to add.

Groups and users are added to their respective tables as you go along.

As soon as you click on Save, the contributors are added and can start working.

Added groups and users are visible from the settings page when you click on the relevant item.

User list. Groups list

Modify a Schedule Project

It is possible to modify the Project of a Schedule and map the existing Workflow tasks to the elements of the new Project.
This function preserves the organisation of the Workflow and the execution history of the Schedule, for example if you have duplicated a Project to create a new version.

To modify the Project, click on the icon Remapper .

When you select the new Project, DC-Maestro calculates and selects the most likely elements to be mapped.
You can modify and select each element to be mapped.
It is not necessary to map all items to modify the Project, but only mapped items will be retained.

The modification is effective at the end of the process: it is no longer possible to return to the previous state of the Workflow.