Skip to content

_spark_create_governance_metadata_dataframe

Internal helper
This page documents an internal implementation helper, not a primary public API.
Source code in src/fabricops_kit/governance.py
294
295
296
297
298
299
def _spark_create_governance_metadata_dataframe(spark, rows: list[dict]):
    if not rows:
        return None
    normalized = [to_jsonable(dict(r)) for r in rows]
    json_rows = [json.dumps(r, sort_keys=True) for r in normalized]
    return spark.read.json(spark.sparkContext.parallelize(json_rows))