Marc Gris
11/10/2023, 7:35 AMkedro-airflow
and am having a little concern. Please correct me if I’m wrong.
Since individual nodes are turned into airflow tasks as instances of the KedroOperator
whose execute()
method creates a new session
, if one were to use versioned datasets, one would be in for a little surprise:
A single airflow run would produce non-homogeneously timestamped artifacts… Correct ?
Thanks in advance for your inputs / comments.
M.marrrcin
11/10/2023, 10:07 AMMarc Gris
11/10/2023, 10:11 AMJuan Luis
11/10/2023, 11:26 AMkedro-airflow
is not on this Slack, so for specific questions you mightbe luckier opening an issue on GitHub and tagging @sbrugman
🙂Artur Dobrogowski
11/21/2023, 1:15 PMMarc Gris
11/22/2023, 12:29 PM