https://kedro.org/ logo
#questions
Title
# questions
h

Hervé Lauwerier

11/09/2022, 3:25 PM
Hello everyone! Is it possible to use a jinja generated catalog in order to generate all the nodes in a pipeline. I haven’t found a way yet to generate every node that would save every table to GCP with an identity function. The catalog contains around 150 tables to backup and I would like to avoid declaring every node.
m

marrrcin

11/09/2022, 3:35 PM
What is the source of your 150 table list? Where are they specified?
h

Hervé Lauwerier

11/09/2022, 3:35 PM
Within my jinja templating
m

marrrcin

11/09/2022, 3:36 PM
Can you use PartitionedDataSet instead?
h

Hervé Lauwerier

11/09/2022, 3:39 PM
My source is a bunch of tables from a SQL Server (multiple databases (not all) and multiple tables within those databases(not all))