https://kedro.org/ logo
#questions
Title
# questions
g

Gregor Höhne

10/24/2023, 11:40 AM
Hi, having an output of a pipeline "viz_detailed_metrics". Can I somehow autogenerate a MLflow metrics dataset using the same output? Something like "standard_metrics"? catalog.yml:
Copy code
"{model}.{experiment}.viz_detailed_metrics":
  type: tracking.JSONDataSet
  filepath: data/09_tracking/{model}_{experiment}_viz_detailed_metrics.json
  versioned: True

"{model}.{experiment}.standard_metrics":
  type: kedro_mlflow.io.metrics.MlflowMetricsDataSet
  dataset:
    type: tracking.JSONDataSet
    filepath: data/09_tracking/{model}_{experiment}_viz_detailed_metrics.json
    versioned: True
d

datajoely

10/24/2023, 11:57 AM
g

Gregor Höhne

10/24/2023, 1:49 PM
I do use dataset factories but I would like to create a MLflow metric dataset without having to create another output in my pipeline. Is there a way to achieve this?
d

datajoely

10/24/2023, 2:51 PM
no you need to be explicit here
return the name thing twice from your funtion
we try and avoid magic