Hello, everyone! In a single kedro run command, I ...
# questions
l
Hello, everyone! In a single kedro run command, I need to run a pipeline multiple times using different snapshot dates. Anyone knows how can I achieve that? For example: Run DS and DE pipelines -> 2022-01-01 Run DS and DE pipelines -> 2022-02-01 Run DS and DE pipelines -> 2022-03-01
m
Is the date a parameter?
If so, you can create a file with those dates and e.g. use xargs: provided that my_dates.txt is:
Copy code
2022-01-01
2022-02-01
2022-03-01
then
Copy code
cat my_dates.txt | xargs -I@ kedro run -p ds_and_de --params "date:@"