adp.maintain.datasource.DataSource

class adp.maintain.datasource.DataSource(path: str)

A DataSource is a reference to a Delta table in the data lake. It can retrieve a Spark DataFrame from the specified path, or overwrite the table at that path with a new DataFrame.

__init__(path: str) → None

Methods

__init__(path)
get_dataframe()	Retrieves a Spark DataFrame for the DataSource
overwrite(dataframe)	Replaces the current DataFrame at the DataSource location with a new DataFrame

get_dataframe() → DataFrame

Retrieves a Spark DataFrame for the DataSource

overwrite(dataframe: DataFrame) → None

Replaces the current DataFrame at the DataSource location with a new DataFrame