https://kedro.org/ logo
#questions
Title
# questions
i

Iñigo Hidalgo

10/02/2023, 4:28 PM
Is there a way to make a pipeline collapsible in viz without adding a namespace? I have some pipelines which have grown too much and I am trying to organize them by logical slices and I want to make those slices collapsible in kedro-viz to attain more of a high-level view. I would like to avoid having to go into my catalog and prepending
namespace.
to every dataset.
r

Rashida Kanchwala

10/02/2023, 4:29 PM
For pipelines that are not namespace pipeline, you can also use the dropdown view to select particular pipelines.
i

Iñigo Hidalgo

10/02/2023, 4:30 PM
it's a single pipeline for which I am trying to make subpipelines collapsible the way namespace ones are :)
I can just do the namespace thing and do the renaming, but was wondering if there was a similar behavior supported with a different parameter inside of the Pipeline constructor class
r

Rashida Kanchwala

10/02/2023, 4:32 PM
Well, namespace is the best way if you want to have open/collapse pipelines on Kedro-viz. Otherwise, you could use tags but that would basically hide and show nodes based on the tag associated with it.
i

Iñigo Hidalgo

10/02/2023, 4:33 PM
Thanks @Rashida Kanchwala 🙂 I will go with namespace then 👍
d

datajoely

10/02/2023, 4:38 PM
also try autoreload mode when adding namespaces
i

Iñigo Hidalgo

10/02/2023, 4:41 PM
I live in
--autoreload
hahahaha @datajoely
So clutch
🚀 2
j

Juan Luis

10/02/2023, 4:52 PM
maybe some points here are "can we use namespaces in Kedro without namespacing datasets?" and/or "can Kedro Viz use something else to group pipelines (like subdirectories)?"
👍 1
d

datajoely

10/02/2023, 4:53 PM
Yup - namesapces are powerful but cumbersome / verbose to refactor
and you have to change them in python and yaml
i

Iñigo Hidalgo

10/05/2023, 3:07 PM
@Juan Luis agree on your assessment, but also idk about the potential value vs effort. for me it would just be a nice-to-have but not necessarily life-changing. though maybe when communicating to different audiences it would be nice to collapse the "nitty-gritty" to only focus on different flows (@Yetunde, related to something you asked me some weeks back)
j

Juan Luis

10/16/2023, 6:20 AM
casually found this on the Dagster issue tracker https://github.com/dagster-io/dagster/issues/14182 people find the Kedro Viz approach valuable for large pipelines
👀 1