https://kedro.org/ logo
#questions
Title
# questions
j

Júlio Resende

10/19/2023, 4:36 PM
Hello, everyone! After updating to kedro 0.18.14, I'm a little confused about using PartitionedDataset with kedro-datasets. I have a PartitionedDataset in my catalog and I have already installed kedro-datasets 1.7.1
Copy code
my_dataset:
  type: PartitionedDataset
Do I need to do something else to stop receiving the warning below?
Copy code
KedroDeprecationWarning: 'PartitionedDataset' has been moved to `kedro-datasets` and will be removed in Kedro 0.19.0.
d

datajoely

10/19/2023, 4:42 PM
nope deprecation warnings are just that a warning - you can suppress them if you want
🙁 1
the main point is when 0.19.x comes soon it will be a little different and we’re trying to give people notice of the change
👍 1
j

Juan Luis

10/19/2023, 4:43 PM
is there a way to instruct Kedro to pick
PartitionedDataset
from
kedro_datasets
rather than
<http://kedro.io|kedro.io>
from the dataset definition? 🤔
n

Nok Lam Chan

10/19/2023, 4:49 PM
@Juan Luis Yes - you can always use the full path which is
type: kedro_datasets.partitions.PartitionedDataset
Hm… actually this is because we move from kedro.io -> kedro_datasets.partitioned namespace.
👍 1
If you use this, do you still have the warning?
Copy code
my_dataset:
  type: partitioned.PartitionedDataset
I think there were some discussion that where should these “core” datasets live when move from
<http://kedro.io|kedro.io>
, is this intended? We need to have migration guide for this because installing
kedro-datasets
won’t work out of the box. Cc @Sajid Alam
j

Júlio Resende

10/19/2023, 4:57 PM
@Nok Lam Chan, the full path didn't work for me :(
Class 'partitions.PartitionedDataset' not found or one of its dependencies has not been installed.
Do I need to install something else?
n

Nok Lam Chan

10/19/2023, 4:58 PM
Can u upgrade to 1.8.0 kedro-datasets
a

Ankita Katiyar

10/19/2023, 5:03 PM
kedro-datasets with the
PartitionedDataset
isn’t out yet (I think)
j

Júlio Resende

10/19/2023, 5:07 PM
@Nok Lam Chan, the last version of kedro-datasets in pypi is 1.7.1: https://pypi.org/project/kedro-datasets/
s

Sajid Alam

10/19/2023, 5:07 PM
As @Ankita Katiyar said we haven’t released the version of kedro-datasets that has
PartitionedDataset
and
IncrementalDataset
We should hopefully have it out this sprint. 😄
j

Júlio Resende

10/19/2023, 5:12 PM
Ok. I will wait for the new version. Thank you all! 🙂
🚀 1
Are any updates also being planned for kedro-viz 6.6.0? Some
JSONDataSet, PlotlyDataSet, MetricsDataSet
imports are being made, with a capital S. This also throws some warnings. I just found some old issues on github about this.
10 Views