Mamadou SAMBA
10/06/2025, 3:45 PMsome_dataset:
type: spark.SparkDataset
file_format: delta
filepath: "gs://<bucket-prefix>${runtime_params:env}-dataset/app_usages"
Airflow correctly sends an empty string ('') for the env parameter,
but Kedro interprets it as None.
So the final path becomes:
gs://<bucket-prefix>None-dataset/
instead of:
gs://<bucket-prefix>-dataset/
Here’s the simplified Airflow call:
"params": build_kedro_params(
[
f"project={get_project_id()}",
f"env={env_param}", # env_param = ''
]
)
It looks like Kedro converts empty strings from runtime parameters into None during parsing.
Has anyone else run into this issue with Kedro interpreting empty strings as None?Chris Schopp
10/07/2025, 12:59 PMcustom_resolver = {"env_param": lambda env_param: env_param if env_param else ""}Mamadou SAMBA
10/08/2025, 8:19 AM