Marc Gris
07/20/2023, 2:47 PMlocal/catalog.yml
does not override the `base/catalog.yml`…
Any idea what could cause this behavior ?
Thx
M.Nok Lam Chan
07/20/2023, 2:53 PMyml
files?
p.s. I know I still owe some answer to other questions you asked, will get back to it.Marc Gris
07/20/2023, 2:54 PM{{ table }}.db_columns
in base
does get created in the catalog…local
does not impact base
, is it possible to work on / run the other pipelines in my project :
• without commenting things out in base
• and without having to create a local db
?
Thanks in advance for your advice / suggestions
Regards
M.
P.S: of course, it is not out of lazyness that I’m reluctant to comment in base
😅 … It’s just that “messing with `base`” to be able to work locally feels “off”.Nok Lam Chan
07/20/2023, 3:15 PMMarc Gris
07/20/2023, 3:16 PMNok Lam Chan
07/20/2023, 3:17 PMlocal
are mean to override, in this case when you commented it out it simply means nothing to override.Marc Gris
07/20/2023, 3:22 PMlocal
to “ignore” things in base
, i.e something like
conf/local/catalog.yml
dataset:
type: to_ignore
What do you think ? 🙂
Would that deserve a feature request ?Nok Lam Chan
07/20/2023, 3:31 PMand without having to create a local dbI guess I am not clear about this yet, why do you need to create a local db? From my understanding this dataset doesn’t concern your pipeline, so whether or not it exists (or not), shouldn’t affect your pipeline.
Marc Gris
07/20/2023, 3:33 PMkedro run -p my-pipeline-without-db
would raise an error since the creation of the catalog is “modular-pipeline-agnostic”Nok Lam Chan
07/20/2023, 3:39 PMlocal
to remove certain entries, I understand the idea of not touching base
and use local as the only source of change. But if the above problem is fixed, I don’t see a strong need for this. If you think this is important, feel free to open an issue for this too, but I suggest do them separately.Marc Gris
07/20/2023, 3:42 PMNok Lam Chan
07/20/2023, 3:45 PMMarc Gris
07/20/2023, 3:46 PMIñigo Hidalgo
07/20/2023, 4:11 PMMarc Gris
07/21/2023, 9:02 AMpipeline_c
depends on a sql datasets, that kedro run -p pipeline_a -pipeline_b
would work without any problem (and without having to “muddle” with anything)…Nok Lam Chan
07/21/2023, 10:02 AMMarc Gris
07/21/2023, 10:04 AM