Release notes

Version 1.8

Compatible with DataChain Core instances from version 8.5.4 and 8.6 if Beta Tester.

Improvements

Execution: Force a Schedule to stop while it is running

Caution: using this feature may prevent a processing chain from executing correctly

It is now possible to make a stop request by clicking on the STOP icon visible when a Schedule is running.
It may happen that stopping is not possible at a given moment and that the request is unsuccessful.
In this case, click STOP again to try again.
If the execution is very fast, icon will not appear.

This action is particularly useful when a DC-Maestro job remains visible as ‘running’ even though no job is running in DataChainCore. + This may be due to synchronisation problems. This may be due to synchronisation problems with DataChainCore, when updating the instance for example.

Instance DataChain Core: private URL

It is now possible to specify a private URL in addition to the existing public URL.
To add a private address, the administrator must uncheck the ‘Same as public address’ option in the parameters of the instance concerned.

When you first connect to this version, it is possible that the Instance is unreachable. In this case, a DC-Maestro Administrator must edit the Instance in order to check and uncheck the option and save again.

New task: Updating API Publication data

IMPORTANT : the HandleData API Publication (Exposition V2) is only available to Beta Testers of version 9.0 DC-Core

A new task is available to automate the updating of API Publication data (new version of API Exposures).
2 options

  • force publication of the API

  • force the status to Available

Patches

  • Tasks

    • DataBlock export: all saved exports are now correctly taken into account during an automatic chain calculation.

  • Execution

    • Recurrence: the creation of recurrences */0 on hours and weeks, which used to block the orchestrator, is now prohibited and blocked by the interface.

Version 1.7

Compatible with DataChain Core instances in versions equal to or higher than 8.5.4.

Enhancements

Schedule creation

It is no longer necessary to select a task to create a schedule : all task additions are now made from the Workflow.
It’s now possible to run a schedule without a task, for example to check its integration with the orchestrator.

Automatic generation of a Workflow

The automatic generation calculates all persistence tasks to be carried out in order to optimise the performance of updates to all the shared elements of a Project (publication of dashboards and APIs, etc.).
If the Workflow contains export tasks that have already been configured, they can be included in the calculation.

It’s necessary to unpersisted all the elements of a Project running in production so that DC-Maestro can accurately optimise the update of the processing chain.
In order to guarantee optimal processing, we recommend keeping a single execution chain per Project.

Change Schedule Project

A new function allows you to modify a schedule’s project and map existing workflow tasks to elements of the new project.
When you select a new Project, DC-Maestro automatically associates the most likely items to be mapped.
It is not necessary to map all items to modify the Project, but only mapped items will be retained.
This function preserves the organisation of the Workflow and the Planning execution history.

The modification is effective at the end of the process: it is no longer possible to return to the previous state of the Workflow.

Corrections

  • Tasks

    • DataBlock Exposure: the list of DataBlocks now only shows DataBlocks that have an API Exposure.

  • Planning

    • Alerts: the alert in the event of failure for the Owner is now active by default during creation.

Version 1.6

Compatible with DataChain instances in versions equal to or higher than 8.5.0._

Improvement

Projects and linked elements DataChain Core

  • Linked projects

    • Clicking on a DataChain Core project label from the run list or schedule details page opens the project home page in a new tab.

You must be a member of the Project to access it.

  • Related items

    • From the Workflow, clicking on the Id of an item opens the item page in a new tab.

You must have sufficient rights to access them.

Schedules

  • Notification in the event of execution failure

    • It is possible to receive emails when one or more tasks in a schedule fail to run.
      By default, the Owner receives an email in the event of failure.
      Notifications can be activated or deactivated for the Owner and/or Contributors from the "Settings" tab of a Schedule.

List of executions

  • Private / Public

    • An icon just before the schedule label now indicates the type of schedule access from the run list.

Workflow

  • Save position ** The organisation of the task pipeline has been improved.

    • The organisation of the task pipeline you have defined is now saved.

It is necessary to click on the "Reorganize" button when you return to the Schedules Workflow page for the first time.
Then adjust the positions if you wish and save the workflow.

  • Last execution status

    • Information (date, duration and status) about the last time a task was run is now visible from the Workflow. The execution log can be accessed by clicking on the task status icon.

  • Copy the label of DataChainCore elements.

    • From the Workflow menu, click on the button to copy the label of a DataChainCore item. You can use this to replace the task label, for example.

  • *Task appearance

    • A few adjustments have been made to the visual appearance of the tasks to make the Workflow easier to read.

  • * Overview of tasks*

    • Detailed information

      • A tooltip with information on linked items is now displayed under the hovered task

    • The top-level chain is highlighted

      • The hovered task and its first neighbors are highlighted in the task pipeline. Click the button to enable enable or disable disable the effect.

Corrections

  • Workflow

    • Read-only*: Workflow is now always locked when viewed in read-only mode. All information on tasks and related items is displayed correctly. Zoom: zooming out is now limited to prevent items from disappearing.

  • Scheduling

    • Changing the "Active/Inactive" status no longer resets changes made to metadata.

  • Tasks

    • DataBlock export*: it is no longer possible to add 2 identical tasks linked to the same DataBlock/Export model pair.

Version 1.5

Compatible with DataChain instances in versions equal to or higher than 8.3.

Improvements

  • Planning: the actions available in the menu on the run monitoring page have been enhanced. You can now directly

    • Modify run parameters

    • Add and remove Contributors

    • Make public or private

    • Activate or deactivate

    • Delete permanently

  • Execution log: a button can now be used to copy the entire contents of the execution log to the clipboard

Corrections

  • Workflow

    • An error which was blocking the display of tasks in Workflow when there was a carriage return at the beginning of a task label has been corrected. Carriage returns at the beginning of a line are now automatically suppressed for labels.

  • Planning

    • DataChain projects in which a user is a group member are now visible in DC-Maestro.

Version 1.5

Compatible with DataChain instances in versions equal to or higher than 8.3._

Improvement

  • Planning: the actions available in the menu on the run monitoring page have been enhanced.
    You can now directly

    • Modify run parameters

    • Add and remove Contributors

    • Make public or private

    • Activate or deactivate

    • Delete permanently

  • Runtime log: a button can now be used to copy the entire contents of the runtime log to the clipboard.

Corrections

  • Workflow

    • An error which was blocking the display of tasks in Workflow when there was a carriage return at the start of a task label has been corrected.
      Carriage returns at the start of a line are now automatically suppressed for labels.

  • Planning

    • DataChain projects in which a user is a group member are now visible in DC-Maestro

Version 1.4

Compatible with DataChain instances in versions equal to or higher than 8.3.

Enhancement

Instances

  • Connexion: when you reconnect to DC-Maestro, you are automatically redirected to the Planning list of the last selected work instance.

  • Creation: you are informed if an Instance already exists with the same address and creation is blocked.

Planning

  • Real-time display: execution schedule display speed has been improved

  • Task order: the logical order and the real order in which tasks are executed are now clearly distinguishable.

    • From the execution tracking page ("Tasks" column): the order and number of visible tasks is calculated on the basis of the last known Workflow record. Each task displays its last known execution status.

    • From the history tab of a Schedule: the order and number of tasks visible correspond to the actual execution order.
      Each task displays the current known status for that run.

  • Workflow : When tasks are not fully set up, you are now warned and invited to delete them so that you can save the task workflow.

Corrections

  • Sorting on lists of DataChain elements

    • sorting is now performed on all array data.

    • sorting by last modification date is now available again.

  • Contributors

    • Users who are not part of a group can now see the Private Schedules for which they are a Contributor in the list.

    • It is once again possible to delete all groups added as contributors using automatic selection.

Version 1.3.0

Version 1.3 DC-Maestro is compatible with DataChain instances in versions equal to or higher than 8.2.

Enhancement

Planning

  • Collaborate on a schedule: the owner of a schedule can now add groups and users as contributors. Contributors can perform all the usual actions except deleting and managing the list of Contributors.

Learn more about Contributors.

  • Activate and inactivate a Schedule: non-automated Schedules can now be inactivated.
    When inactive, a Schedule can no longer be executed (manually or automatically).

  • Deleting a Schedule*: it is now possible to delete an execution even if it has already been run.
    Note that all traces relating to actions carried out on DataCHain Core elements via Maestro are still visible from GenericsData and HandleData.

It is not possible to deactivate a Schedule during execution or integration.

Tasks

  • DataBlock export*: a new DataBlock export task is now available for automation.
    2 parameters are expected

    • DataBLock: the element containing the data to be exported

    • Export model: the element describes the export mode to be used

Unlike the other persistence, publication and exhibition tasks, export tasks are not unique.

Runs

  • Improvements to the execution list: the reading and amount of information available from the execution list has been improved.

    • CRON frequency and the next Scheduled run are now visible in local time and on hover in UTC.

    • last run is now displayed in local time and when hovering over UTC

    • inactive Schedules are greyed out at the beginning of the line.

    • actions are available from the action button

Executions are defined in UTC time: the execution frequency displayed in the CRON is therefore in this format and differs from the date and time of the next execution displayed in local time.

  • Improved task status management: the blocked status is now displayed when a task could not be executed because it is linked to a previous failed task.

Miscellaneous

  • Line breaks in text boxes*: paragraphs with line breaks located in description boxes are now managed and visible in all displays, including tooltips.

Corrections

  • Sorting on execution history: sorting is now done correctly on the page.

  • Correction to the path to the documentation: update to the new documentation for the DataChain platform

  • Formats accepted for CRON: an error prevented numbers containing 0 from being added and.
    Spaces and certain special characters are now prohibited

  • Task log: fixed redirection from the task log page

Version 1.2.0

Enhancement

Administration

  • Actions as DC-Maestro administrator: you can now access the list of existing Schedules (public and private) in order to take action on executions in an emergency.
    From the Schedule administration page, you can

    • Pause an automatic Schedule

    • Execute a Schedule (if it is not already running)

    • Start a Schedule run

It is not possible to access details of schedule or make other changes in the administrator view. These actions are still available in standard schedule view.

Executions

  • Force refresh of the list of DataChain items: from the item selection mode, you can click on the "Refresh" button to retrieve all the data updated in DataChain Core.

  • Control of the uniqueness of DataChain elements: in order to guarantee the consistency of value chains, each DataChain element can now only be added once for the same task. Example: if the DatBlock *DBA* is selected for the Persistence task in Schedule P1, then it is no longer possible to select it for Persistence tasks (in this Schedule or another, as long as it has been saved).

Enhancement

  • Automatic logout: you are now warned when your session is about to expire (10 and 2 minutes before logout) to prompt you to save your work in progress.

Corrections

  • CRON: we’ve tightened control over CRON from the interface and API so that we no longer generate an error when sending a character not supported by the orchestration server.

  • DataChain projects: now display the last modification date instead of the creation date.

Version 1.1.0

Enhancement

Instances

  • Access to Schedules: you can now access the list of instance-related Schedules directly from the selected instance map by clicking on View

Schedules

  • Time zone: an area now shows the orchestrator time in the top menu and when editing an automatic Schedule Orchestrator-time-and-status.
    This allows you to quickly calculate the actual execution time in case the orchestrator has a time difference with DC-Maestro.

Tasks

  • Workflow: the automatic reorganization algorithm has been improved.

📌 You will soon be able to choose a specific organisation for each Schedule.

Security

  • Token: It is now possible to update all tokens linked to existing Schedule. From your user account page, click on Update token and validate the action to immediately update the tokens of all the Schedules you own from this newly generated token.

  • Learn more

📌 You will be able to manage several tokens thereafter.

Miscellaneous

  • Tooltips: numerous tooltips have been added to truncated texts to facilitate reading.

  • Loading: a temporary display is now shown on loading pages

  • Tags: tags are now limited to 10 per item and can no longer exceed 20 characters or contain special characters such as "-" and "_"

Corrections

  • Publications: the list now shows only active, non-expired and non-archived publications

  • History

    • manual executions performed in parallel with scheduled automatic executions are now displayed in descending order

    • History tabs are now correctly reset when changing pages

  • Real-time run update: a random error that stopped the automatic real-time run updates on the Schedules page has been corrected.