Question on dataset factories and

catalog.list()

I have a dataset that looks like this:

"{experiment}.model":
  type: pickle.PickleDataset
  filepath: data/06_models/{experiment}/model.pickle
  versioned: true

I have a bunch of namespaced training pipelines that output a model. When I do a

catalog.list()

inside a notebook / ipython terminal no entries captured by this factory show up. This is likely expected behavior. But is there a way to list datasets that get created from my namespaced pipelines?

Ah nice I guess the closest thing would be

kedro catalog resolve

then Thanks Yury!

Yes @Ian Whalen , you can steal the logic there. The reason why list does not work it because you also need a pipeline to determine what catalog entry to create. I don’t have access to a laptop now, but if you haven’t found the answer i will get back to this next Monday.

catalog resolve

is basically what I wanted! But if i'm making a wishlist I would love to be able to do the same thing in a notebook I was trying to do something like

models = {}

for model_dataset in [d for d in catalog.list() if ".model" in d]:
    models[model_dataset] = catalog.load(model_dataset)

I could get it all from

catalog resolve

but its a little extra work

https://github.com/kedro-org/kedro/issues/3312 I also have a little plugin implemented before but never make it public.