https://kedro.org/ logo
#questions
Title
# questions
j

Jose Luis Lavado Sánchez

12/07/2023, 4:53 PM
Hi maybe I missing something. I am trying to use dataset factories on kedro catalog. I need to everytime a output ends in
_query
(pattern
"{name}_query"
) to be save as text on
text.TextDataSet
on
data/{name}_query.txt
, the code on the catalog is
Copy code
"{name}_query":
  type: text.TextDataSet
  filepath: data/{name}_query.txt
and on the pipeline
n

Nok Lam Chan

12/07/2023, 4:54 PM
What is the problem or error?
j

Jose Luis Lavado Sánchez

12/07/2023, 4:55 PM
Hi maybe I missing something. I am trying to use dataset factories on kedro catalog. I need to everytime a output ends in
_query
(pattern
"{name}_query"
) to be save as text on
text.TextDataSet
on
data/{name}_query.txt
, the code on the catalog is
Copy code
"{name}_query":
  type: text.TextDataSet
  filepath: data/{name}_query.txt
and on the pipeline
Copy code
kedro.pipeline.node(
                func=build_fcd_cache_full_query,
                inputs=["groupped_polygons", "params:sampling"],
                outputs="fcd_cache_full_query",
                name="build_fcd_cache_full_query"
            )
But I get this on execution, like is a MemoryDataSet and it did not create the file.
n

Nok Lam Chan

12/07/2023, 4:57 PM
What is the version of Kedro?
j

Jose Luis Lavado Sánchez

12/07/2023, 4:58 PM
It is version 0.18.4
dataset factory is only introduced after 0.18.12
can you try to upgrade this with
pip install -U kedro
?
j

Jose Luis Lavado Sánchez

12/07/2023, 5:16 PM
Okay I will do it, sorry I read 0.18.2
n

Nok Lam Chan

12/07/2023, 5:18 PM
Don’t worry, I figured the version was not highlighted. I am making the changes now. https://github.com/kedro-org/kedro/pull/3401 Cc @Ahdra Merali @Sajid Alam for review
thankyou 2