Maintain

Contents:

• Restoring backups
  • How-to restore backups
• YAML
  • Job
  • Path
  • Rules
    • RetentionRule
    • OptimizeRule
    • VacuumRule
    • BackupRule
  • Using variables
  • Examples

The maintenance platform aids in the maintenance of the data within the Smart Data Plaform, fully controlled by YAML definition files. It is build by Athora Netherlands and meant for internal use only.

Scope

This package seeks to automate common data maintenance tasks like:

• Removing expired data from tables (retention)

• Running optimisation tasks on data (delta table optimisation)

• Set Access Tiers (hot, cool, archive) on data

This package does NOT ingest data of any sort, this is the job of the ingest framework.

This package also does NOT set permissions on the data. This is for now handled by the SDP 1.0 Framework and will be moved to a seperate package in the future.