hi everyone, can we initiate multiple sessions in kedro? if yes, could anyone help me with it? kedro version - 0.18 i am building a web application where in i have to trigger the different pipelines of a kedro project based on button clicks on the dash ui. as of now, individually it is working, but when one session is running, if i tries to trigger another session it gives a runtime error.

Do you need to keep track of the session_id? If not you can try to use the lower level component such as

DataCatalog

,

Runner

without the Session. You will need to orchestrate them a little bit like this i.e.

context = session.load_context()
catalog = context.catalog
runner = SequentialRunner()
runner.run(<pipeline>, catalog)

Thanks for this Nok. Let me look into it.

Can you share the questions here?

Hi @Nok Lam Chan Assuming one had to “_keep track of the session_id_”… What is the best way to do it ?

catalog._save_version

? Thx

hey @Nok Lam Chan, i ended up using multiprocessing instead.

Assuming one had to “_keep track of the session_id_”…

What is the best way to do it ?

catalog._save_version

?

session.session_id

. catalog.__save__version is relatively new change and it’s internal API that shouldn’t be relied on.

Thx @Nok Lam Chan Now that you say it, it just sounds completely obvious. I guess I just got lazy and since I had the catalog object available I used the

_save_version

attribute 😉 Thx again M