Hey all may be a simple ques, In kedro catalog ho...
# questions
t
Hey all may be a simple ques, In kedro catalog how can I dynamically append timestamp to catalog file names:
Copy code
reporting_nodes.node_tracking:
  type: pandas.CSVDataSet
  filepath: ${raw_base_path}/reporting_nodes/node_tracking.csv
I need something like:
Copy code
reporting_nodes.node_tracking:
  type: pandas.CSVDataSet
  filepath: ${raw_base_path}/reporting_nodes/node_tracking_{$current_timestamp}.csv
a
There’s an example in this section using a custom resolver with
OmegaConfigLoader
-> https://docs.kedro.org/en/stable/configuration/advanced_configuration.html#how-to-use-resolvers-in-the-omegaconfigloader
i
fwiw if what you're wanting is just to save a new output dataset for each time you run the pipeline and indicate when it was run, there's 2 other things you could do: • dataset versioning: https://docs.kedro.org/en/stable/data/data_catalog.html#dataset-versioning • partitioned dataset, and adding the current timestamp into the partition name: https://docs.kedro.org/en/0.17.5/05_data/02_kedro_io.html#partitioned-dataset
👍 1
👍🏼 3