https://kedro.org/ logo
#questions
Title
# questions
t

tom kurian

11/22/2023, 3:54 PM
Hi Team A qq, i am running a kedro pyspark pipeline in hadoop using yarn I am getting an error as follows:
Copy code
Exception in thread "main" org.apache.spark.SparkException: When running with master 'yarn' either HADOOP_CONF_DIR or YARN_CONF_DIR must be set in the environment.