adp.ingest

Modules

cdc

CDC functionality for adp.ingest

dataclasses

datatypes

Functionality to enable datatype escalation

exceptions

Custom exceptions for ingests

ingest

Ingest module to run ingests based on YAML definitions

schema

Extends schema related functionality from pyspark to support nested data structures

sources

transform

Functions that transform dataframes to silver (merge) and bronze (append)

udf

Custom UDF's to apply on columns of a dataframe.