ADP documentation
=================

**Date**: |today| **Version**: |version| 3.0.0


:mod:`adp` is a suite of tools to ingest, deliver and maintain data using `OSS pyspark <https://spark.apache.org/docs/latest/api/python/index.html>`__.


The main components of `adp` include:

- **Core Module**: Reusable components for building data products. These components can are mainly used in the other three modules but can also be directly used by data engineers and data scientists.
- **Ingestion Module**: Tools for ingesting data from various sources into a Azure Data Lake Storage (ADLS). Configurable using YAML files.
- **Delivery Module**: For transforming, reading, and writing data in a consistent manner.
- **Maintenance Module**: Utilities for optimizing, cleaning, and managing data lifecycle.

.. toctree::
   :caption: Release Notes
   :maxdepth: 1

   release_notes/index

.. toctree::
   :caption: Functional Documentation
   :maxdepth: 2

   core/index
   ingest/index
   delivery/index
   maintain/index

.. toctree::
   :caption: Technical Documentation
   :maxdepth: 2

   autogenerated_token_page

.. autosummary::
	:toctree: _autosummary
	:template: module.rst
	:recursive:

	adp.core
	adp.ingest
	adp.delivery
	adp.maintain