Core

The core module of the Smart Data Platform (ADP) provides shared utilities for all other ADP modules. It contains essential components for authentication, data access, logging, configuration, and error handling.

Key features of the core module include:

  • Authentication: Secure access to cloud resources and databases.

  • ADLS (Azure Data Lake Storage): For interacting with Azure storage.

  • backup: For managing data backups via the Backup API.

  • DBSQL: Interfaces for Databricks SQL operations.

  • Logging and Log Analytics: Structured logging and integration with Azure Log Analytics.

  • Retry and Error Handling: Retry logic and custom exception classes.

  • Secrets Management: Secure retrieval and management of secrets.

  • Settings: Centralized configuration and environment management.

The core module is designed to be imported and used by all other ADP modules.