Mohamed El Guendouz
11/03/2024, 5:44 PMkedro-airflow
tool, is it possible to create a separate DAG for each pipeline in the project rather than a single DAG per project? If so, how can I configure each DAG to specify start times and other parameters for each DAG corresponding to each pipeline in the project?Mohamed El Guendouz
11/03/2024, 6:26 PMkedro airflow create -p <pipeline_name>
. For configuration options, here’s what’s available:
• `-e, --env`: Set the Kedro configuration environment, default is local
.
• `-j, --jinja-file`: Template file for the DAGs.
• `--params`: Pass extra parameters to the context initializer.
• `--conf-source`: Path to the configuration folder or archived file for the DAG.Juan Luis
11/04/2024, 11:14 AMMohamed El Guendouz
01/16/2025, 5:38 PM