which kind of hook do you want to run

Question

Artur Dobrogowski · Answer

the one I ve linked after data catalog creation

Artur Dobrogowski · Answer

I need to load some items and initialize some singleton class with the data

Artur Dobrogowski · Answer

and I want it to run only in inference pipeline

datajoely · Answer

I think a `before pipeline run` hook is better you get a created data catalog and you can check what pipeline is running and then mutate the catalog there

Artur Dobrogowski · Answer

yes I m afraid that before pipeline run will be run every time the pipeline is executed

Artur Dobrogowski · Answer

and I want to package that pipeline as a serving endpoint for mlflow

Artur Dobrogowski · Answer

and I would like it to run only once for initialization

datajoely · Answer

but you can check which ` pipeline` name was passed from the CLI I think

datajoely · Answer

via `pipeline name`

Artur Dobrogowski · Answer

yeah I m not familiar enough to get to know where I can get that context in kedro

Artur Dobrogowski · Answer

so that s why I m asking where to get that info

Artur Dobrogowski · Answer

well I ll do test with before pipeline as I m not sure if it will work or not

datajoely · Answer

I m 99 sure it will work

Artur Dobrogowski · Answer

I mean for it to run only once or many times

datajoely · Answer

so you can find some hacky ways to maintain state like writing a file to disk the 1st time and checking for it s presence

datajoely · Answer

a nice way to do this is to create a hook put a breakpoint in and then play around with the objects live

Artur Dobrogowski · Answer

yeah I often do that by embedding `IPython embed `