drift module
Module overview
Public callables from __all__
| Callable | Type | Summary | Related helpers |
|---|---|---|---|
check_partition_drift |
function | Check partition-level drift using keys, partitions, and optional watermark baselines. | — |
check_profile_drift |
function | Compare profile metrics against a baseline profile and drift thresholds. | — |
check_schema_drift |
function | Compare a current dataframe schema against a baseline schema snapshot. | — |
summarize_drift_results |
function | Summarize schema, partition, and profile drift outcomes into one decision. | — |
Internal helpers
| Helper | Related public callables |
|---|---|
_build_pandas_partition_snapshot |
— |
_build_pandas_schema_snapshot |
— |
_build_partition_hash |
— |
_build_spark_partition_snapshot |
— |
_build_spark_schema_snapshot |
— |
_column_hash |
— |
_hash |
— |
_is_closed_partition |
— |
_is_missing_table_error |
— |
_json_dumps |
— |
_resolve_change_behavior |
— |
_safe_spark_collect |
— |
_utc_now_iso |
— |
_write_metadata_rows |
— |