adp.ingest.ingest

Ingest module to run ingests based on YAML definitions

Functions

bronze(ingest, entity, snapshot)

Append the snapshot to the bronze layer

from_string(yaml)

Runs an ingest for a given YAML string

preprocess(ingest, entity, df)

Preprocess the new snapshot of the data

run_ingest(ingest)

Run the ingest for all entities in the ingest

silver(ingest, entity, snapshot)

Merge data to the delta table in the silver layer