Hi everybody, i'm not new to kedro, but i'm new to using kedro, pyspark and databricks at the same time.
The logs appear after all the jobs have been completed, is it there a way to see the logs as they occur? I think is more a databricks question
Thanks in advance!
hi @Nok Lam Chan, in the meantime I took databricks out of the equation, ran the project directly on spark, in different configurations, and I got the logs as the project was executing, so... it's not kedro nor spark.
Now I think it's something on how my company configured databricks.
Thanks for taking your time on my obscure problem 🙂
Nok Lam Chan
03/23/2023, 5:33 PM
You are welcome! free feel to report any issues u have.