Vassilis Kalofolias
02/27/2023, 11:15 AMkedro-mlflow
and I have problems tracking a simple dict using MlflowMetricsDataSet
in my catalog.
It seems to me that mlflow.log_metrics()
accepts a normal dict, but the data expected by MlflowMetricsDataSet
needs a different format (I get an exception that a key value
doesn't exist). Does anyone have experience using it?Yolan Honoré-Rougé
02/28/2023, 8:44 PMsave
and load
method will handle the same object. TBH I think nobody loads metrics from mlflow with this dataset, and it will make the API simpler and more consistent with mlflow to be able to log simply a dict
. You can open an issue so I'll keep track of it and fix it one day, but it is quite low priority so if you want to change thing soon, feel free to open a PR!
The good news is that MlflowMetricDataSet
can handle this, so you can return a tuple at the end of a node instead of a dict and it will work except if you have dynamic names in your metric dict, since you have to write a catalog entry for each of themVassilis Kalofolias
03/01/2023, 7:42 AMMlflowMetricDataSet
and eventually open a ticket.