Hello team,
I need to run a pipeline daily, and my input datasets will be in different folders every day.
Like, d:\data\{run_date}\dataset1.csv
Is it possible to use a parameter in the catalog.yml file to substitute {run_date} with the actual value? Or what is the other way to achieve this?