Muhammed Afnas
09/21/2023, 11:03 AMNok Lam Chan
09/21/2023, 12:36 PMDataCatalog
, Runner
without the Session.
You will need to orchestrate them a little bit like this
i.e.
context = session.load_context()
catalog = context.catalog
runner = SequentialRunner()
runner.run(<pipeline>, catalog)
Muhammed Afnas
09/21/2023, 2:08 PMNok Lam Chan
09/22/2023, 10:22 AMMarc Gris
09/22/2023, 1:18 PMcatalog._save_version
?
ThxMuhammed Afnas
09/22/2023, 1:19 PMNok Lam Chan
09/22/2023, 1:30 PMAssuming one had to “_keep track of the session_id_”…
What is the best way to do it ?
?catalog._save_version
session.session_id
. catalog.__save__version is relatively new change and it’s internal API that shouldn’t be relied on.Marc Gris
09/22/2023, 1:33 PM_save_version
attribute 😉
Thx again
M