Hi maybe I missing something. I am trying to use d...
# questions
j
Hi maybe I missing something. I am trying to use dataset factories on kedro catalog. I need to everytime a output ends in
_query
(pattern
"{name}_query"
) to be save as text on
text.TextDataSet
on
data/{name}_query.txt
, the code on the catalog is
Copy code
"{name}_query":
  type: text.TextDataSet
  filepath: data/{name}_query.txt
and on the pipeline
n
What is the problem or error?
j
Hi maybe I missing something. I am trying to use dataset factories on kedro catalog. I need to everytime a output ends in
_query
(pattern
"{name}_query"
) to be save as text on
text.TextDataSet
on
data/{name}_query.txt
, the code on the catalog is
Copy code
"{name}_query":
  type: text.TextDataSet
  filepath: data/{name}_query.txt
and on the pipeline
Copy code
kedro.pipeline.node(
                func=build_fcd_cache_full_query,
                inputs=["groupped_polygons", "params:sampling"],
                outputs="fcd_cache_full_query",
                name="build_fcd_cache_full_query"
            )
But I get this on execution, like is a MemoryDataSet and it did not create the file.
n
What is the version of Kedro?
j
It is version 0.18.4
dataset factory is only introduced after 0.18.12
can you try to upgrade this with
pip install -U kedro
?
j
Okay I will do it, sorry I read 0.18.2
n
Don’t worry, I figured the version was not highlighted. I am making the changes now. https://github.com/kedro-org/kedro/pull/3401 Cc @Ahdra Merali @Sajid Alam for review
thankyou 2