Kedro is an open-sourced Python framework for creating maintainable and modular data science code.

Kedro

```catalog.yml:

inspection_output:
  type: pandas.SQLQueryDataSet
  credentials: postgresql_credentials
  table_name: shuttles
  layer: model_output
  save_args:
    index: true```

You’re using SQLQueryDataSet not SQLTableDataSet

can you also version these datasets? or is it best practice to do so by a custom created column?

We don’t support this on the SQL side unfortunately. You could use append only mode and add a timestamp column although this may get very tall over time.

You may also consider a simple subclass that does this automatically

okay nice, is there any way to attain the timestamp kedro uses to version datasets during runtime? I want to give the same timestamp to multiple tables, which are written in different nodess.

it’s created in the session object, if you really want to you could create a hook that sets this as an environment variable  and then you can reuse that. In the future this will be easier to configure.