Dotun O
03/21/2023, 1:28 PMdatajoely
03/21/2023, 1:28 PMDotun O
03/21/2023, 1:29 PMdatajoely
03/21/2023, 1:29 PMDotun O
03/21/2023, 1:31 PMdatajoely
03/21/2023, 1:32 PMkedro ipython
or kedro jupyter notebook
to get the live catalog outside of a run too?Dotun O
03/21/2023, 1:32 PMdatajoely
03/21/2023, 1:33 PMafter_catalog_created
or the after_context_created
hooks are the earliest point you can do thatDotun O
03/21/2023, 1:33 PMdatajoely
03/21/2023, 1:39 PMafter_catalog_created
gives you a live catalog which you can mutate with catalog.add(xxxx, replace=True)
you can also use the _exists()
private method for your puproses
https://docs.kedro.org/en/stable/kedro.framework.hooks.specs.DataCatalogSpecs.htmlDotun O
03/21/2023, 1:43 PMdatajoely
03/21/2023, 1:46 PMDotun O
03/21/2023, 2:27 PMdatajoely
03/21/2023, 2:28 PMload().limit(5)
.