Guide: Create a Schedule

Only DC-Maestro users can create and manage Schedules.
Summary of steps

Planning is created!
You can Add tasks manually or use the automatic calculation function.

Introduction

Scheduling allows you to describe and define a set of tasks (Pipeline), which may or may not be scheduled and which are represented in the form of a Worklfow +. It can be run manually or automatically, without you being logged in.

The Owner account is always used when executing DataChain tasks, even if it is a Contributor who launches an execution from DC-Maestro.

The rights on the elements and your global permissions of the Owner condition the access to the elements of the DataChain Projects as well as the correct execution of the tasks.
If a Contributor adds a task to an item to which the Owner does not have access, DataChain will refuse to execute the task and it will fail.
Conversely, a contributor does not need to have access to the Project or to the orchestrated elements to launch an execution: if the Owner has sufficient access, the execution will be successful.

Select Working Instance

To create a Schedule, you must have selected an available DataChain Instance from the list of Instances.

List of instances with one instance selected as Working Instance

The selected instance is called Working Instance and will remain visible in the left menu.

To create a Schedule, DC-Maestro must be able to communicate with the Working Instance.
If the Working Instance is connected, the icon Instance connected is displayed.
If the connection is lost, the icon Connection failed will be displayed.
In this case, it will not be possible to create a Schedule or modify the Pipeline.

Enter your password

To create a new Schedule, click on the Create a Schedule button located in the left menu.

The user who creates a Schedule automatically becomes its Owner.
This means that all DataChain tasks will be executed according to their profile, and therefore their DataChain rights and permissions.
The task execution history, visible from DataChain Core, therefore indicates the Owner user’s profile as the task trigger.

In order to secure the Schedule execution and allow DC-Maestro to execute the tasks even if you are not connected, enter your password then click on button Validate.

Security mode

Project

The first step in creating a Schedule is to select a Project.
Only Projects of which you are a member are visible.
The choice of Project defines the scope of the Schedule and therefore determines the DataChain elements available for task execution.

It is not possible to run tasks on elements from different Projects in the same Schedule.

When you click on a Project card, you automatically move on to the next step. If you wish to change Projects, click on the button Previous button.

The Project can be modified later and the tasks mapped to the elements of the new Project.

Complete the metadata and set the privacy parameter.

Only the label is mandatory, but we recommend that you briefly describe the Schedule goal and add a tag to simplify research and understanding.
These elements can be modified after the initialization step.

The share type defines the confidentiality of Planning.

  • Public: all the elements that make up the Schedule can be consulted in read-only mode by all DC-Maestro users

  • Private: the Schedule is only visible to the owner and contributors

In all cases, only the owner and contributors can modify or delete elements (metadata, tasks, execution, …​) of a Schedule.

Set execution type and frequency

During the initialization step, it is recommended to choose a manual execution, in order to execute the Pipeline and automate it whenever you want.

In all cases, all the parameters can be modified later.

By default, autorun is set to run every day at 6am (UTC).

To modify this setting, you can either use the form or the CRON language.

The orchestration time zone is UTC.
When you set the execution frequency, you must take the difference into account +. For example, if you want to schedule an execution every day at 18:00, and the server indicates 12:00 whereas your computer indicates 13:00, you must subtract one hour, i.e. set the CRON to 17:00. The server time can be viewed at any time in the top menu.

Once all the fields have been correctly filled in, click on Summary to go to the last step.

Save Schedule

After checking all the elements, click on Save to create the new Planning and launch the integration phase.
You can now add tasks manually or generate a Worklfow using automatic generation.

The integration time in the orchestrator can vary from a few seconds to a few minutes +. During this integration phase, Planning cannot be executed.
If you try to run Planning during this phase, a warning message is displayed.
It is possible to modify the Schedule during this phase and build the Workflow.

As soon as the integration phase is finished, you can test the execution from the list of Schedules by clicking on icon Play Play.

Related pages