Chandan Malla
09/27/2023, 7:05 AMmarrrcin
09/27/2023, 7:14 AMfrom kedro.pipeline.modular_pipeline import pipeline
pipeline(
inputs={"<name of the dataset within the modular pipeline": "name of the dataset from the *root* data catalog"},
namespace="your_ns",
# ... other pipeline params
)
Note that "<name of the dataset within the modular pipeline"
is WITHOUT the namespaceChandan Malla
09/27/2023, 7:15 AMmarrrcin
09/27/2023, 7:16 AMyour_ns.dataset_name:
type: xyz
Chandan Malla
09/27/2023, 7:17 AMmarrrcin
09/27/2023, 7:17 AMKedro >= 0.18.12
:
"{namespace}.dataset_name":
type: xyz
filepath: "path/to/data/{namespace}/file.csv"
Chandan Malla
09/27/2023, 7:18 AMmarrrcin
09/27/2023, 7:19 AM"{namespace}.data_from_{month}":
type: xyz
filepath: "path/to/data/{namespace}/{month}.csv"
Chandan Malla
09/27/2023, 7:20 AMmarrrcin
09/27/2023, 7:21 AMMar
, Jan
, `Feb`… etc in some kind of a listChandan Malla
09/27/2023, 7:22 AMmarrrcin
09/27/2023, 7:22 AMChandan Malla
09/27/2023, 7:25 AM