Release Notes

3.0.0 (2025-11-11)

This release brings significant improvements and a streamlined experience for all users of the SDP package. The package has been unified into a single installable module, making setup and usage easier than ever. Most users will notice:

• Simpler Installation & Setup: SDP has been renamed to ADP and is now a single package.

• Consistent API & Validation: All configuration and data validation now use Pydantic, making errors clearer and configuration more robust.

• Improved Testing & Reliability: Every module is now covered by unit and integration tests.

• Open Source & Vendor Independence: The package is now fully built using open source and does not depend on any proprietary Spark vendor resources (Databricks).

• Modular Pipelines: Azure Pipelines have been restructured for easier customization and maintenance.

What should you check?

• If you manually installed sdp.core, sdp.delivery, sdp.ingest and sdp.maintain, you now need to install adp instead.

• If you use YAML configuration files, most workflows will continue to work.

• If you use custom code or import SDP modules directly, note that many internal functions and classes are now private and some modules have been reorganized or removed.

For a detailed list of technical breaking changes, see Breaking Changes.