can we use parameters from parameters.yml into spark sql ? Something like params.yml

x = 123

node.py

df = spark.sql(''''select * from table where x = '{x}' ''')

it would have to be via a node

the thing is when i try the above , its passing the variable directly as a string generated sql : `select * from table where x = `{x}``

in a node or catalog entry?

node

then you need to do python string interpolation with

.format

or

f

strings

so

spark.sql('''f"my query"''')

cool

🚀