Hi Team, I am developing a kedro pipeline in which I pass around

MemoryDataSet

from nodes. By default kedro, deep copies the memoery dataset which leads to loss of information so I created a catalog entry with

copy_mode

set to

assign

. This solves our basic problem of objects being retained as is but messes up the DAG order displayed in kedro viz. Any solutions?

This shouldn’t happened, how is the DAG changed in the frontend viz? Can you provide some screenshot maybe?

Apologies, issue got resolved 😅 🤦 Works wonders now! Thanks @Nok Lam Chan 🙂

That’s great! Do you know what was the issue?

Yep, the fact that I am new to kedro and forgot to click on base grouping name "icon" for MemoryDataSets rendered in kedro viz 😂 I have all my datasets named as

atw.dataset1

,

atw.dataset2

... So these got grouped together and all nodes showed up at the same level without dependancy/connections 🤦

can you change to a

-

instead of your

.

prefix delimiter, I think this is interfering with a diff feature in Viz ?

@datajoely Yep now grouping doesn't occur. Can you explain a bit more why this happens?

The notation of

.

has special meaning of modular pipeline in Kedro

@Nok Lam Chan we should build in some validation Viz side so users dont fall into this trap?

Essentially you can view it as a Super node https://docs.kedro.org/en/stable/nodes_and_pipelines/modular_pipelines.html