Hello everyone! Is it possible to use a jinja gene...
# questionsh
Hervé Lauwerier
11/09/2022, 3:25 PMHello everyone! Is it possible to use a jinja generated catalog in order to generate all the nodes in a pipeline. I haven’t found a way yet to generate every node that would save every table to GCP with an identity function. The catalog contains around 150 tables to backup and I would like to avoid declaring every node.
m
marrrcin
11/09/2022, 3:35 PMWhat is the source of your 150 table list? Where are they specified?
h
Hervé Lauwerier
11/09/2022, 3:35 PMWithin my jinja templating
m
marrrcin
11/09/2022, 3:36 PMCan you use PartitionedDataSet instead?
h
Hervé Lauwerier
11/09/2022, 3:39 PMMy source is a bunch of tables from a SQL Server (multiple databases (not all) and multiple tables within those databases(not all))