Hello, everyone! After updating to kedro 0.18.14,...
# questions
j
Hello, everyone! After updating to kedro 0.18.14, I'm a little confused about using PartitionedDataset with kedro-datasets. I have a PartitionedDataset in my catalog and I have already installed kedro-datasets 1.7.1
Copy code
my_dataset:
  type: PartitionedDataset
Do I need to do something else to stop receiving the warning below?
Copy code
KedroDeprecationWarning: 'PartitionedDataset' has been moved to `kedro-datasets` and will be removed in Kedro 0.19.0.
d
nope deprecation warnings are just that a warning - you can suppress them if you want
🙁 1
the main point is when 0.19.x comes soon it will be a little different and we’re trying to give people notice of the change
👍 1
j
is there a way to instruct Kedro to pick
PartitionedDataset
from
kedro_datasets
rather than
<http://kedro.io|kedro.io>
from the dataset definition? 🤔
n
@Juan Luis Yes - you can always use the full path which is
type: kedro_datasets.partitions.PartitionedDataset
Hm… actually this is because we move from kedro.io -> kedro_datasets.partitioned namespace.
👍 1
If you use this, do you still have the warning?
Copy code
my_dataset:
  type: partitioned.PartitionedDataset
I think there were some discussion that where should these “core” datasets live when move from
<http://kedro.io|kedro.io>
, is this intended? We need to have migration guide for this because installing
kedro-datasets
won’t work out of the box. Cc @Sajid Alam
j
@Nok Lam Chan, the full path didn't work for me :(
Class 'partitions.PartitionedDataset' not found or one of its dependencies has not been installed.
Do I need to install something else?
n
Can u upgrade to 1.8.0 kedro-datasets
a
kedro-datasets with the
PartitionedDataset
isn’t out yet (I think)
j
@Nok Lam Chan, the last version of kedro-datasets in pypi is 1.7.1: https://pypi.org/project/kedro-datasets/
s
As @Ankita Katiyar said we haven’t released the version of kedro-datasets that has
PartitionedDataset
and
IncrementalDataset
We should hopefully have it out this sprint. 😄
j
Ok. I will wait for the new version. Thank you all! 🙂
🚀 1
Are any updates also being planned for kedro-viz 6.6.0? Some
JSONDataSet, PlotlyDataSet, MetricsDataSet
imports are being made, with a capital S. This also throws some warnings. I just found some old issues on github about this.