datajoely
02/02/2023, 3:58 PMArtur Dobrogowski
02/02/2023, 4:02 PMArtur Dobrogowski
02/02/2023, 4:03 PMArtur Dobrogowski
02/02/2023, 4:03 PMdatajoely
02/02/2023, 4:03 PMbefore_pipeline_run
hook is better, you get a created data catalog and you can check what pipeline is running and then mutate the catalog thereArtur Dobrogowski
02/02/2023, 4:04 PMArtur Dobrogowski
02/02/2023, 4:04 PMArtur Dobrogowski
02/02/2023, 4:04 PMdatajoely
02/02/2023, 4:04 PM--pipeline
name was passed from the CLI I thinkdatajoely
02/02/2023, 4:04 PMpipeline_name
Artur Dobrogowski
02/02/2023, 4:05 PMArtur Dobrogowski
02/02/2023, 4:05 PMArtur Dobrogowski
02/02/2023, 4:06 PMdatajoely
02/02/2023, 4:06 PMArtur Dobrogowski
02/02/2023, 4:06 PMdatajoely
02/02/2023, 4:07 PMdatajoely
02/02/2023, 4:07 PMArtur Dobrogowski
02/02/2023, 4:07 PMIPython.embed()