I have a list of tables stored in a SQL database that have the same structure, more or less. e.g. "financial_101223", "financial_111223", etc... Every couple of days there's a new table added. Since the list of tables is continuously growing - I'm using a python script to find all tables that have a certain string pattern in their name and then query them (select * from x) and append the rows to get one table. Is there an elegant way to do this using kedro's catalog? Thanks in advance, Gilad.

Hi, a combination of PartitionDataset with SqlTableDataset is the way to go: https://docs.kedro.org/en/stable/data/partitioned_and_incremental_datasets.html You will be able to filter the table names inside the node before loading data

@Yolan Honoré-Rougé Can you give me a rough sketch of the implementation? I couldn't really get it from the docs