Join Slack
Powered by
Hello team! Is it possible to call a subdataset fr...
# questions
s
Sasha Collin
01/03/2023, 9:17 PM
Hello team! Is it possible to call a subdataset from a partitioned dataset directly from a pipeline? ie doing something like this:
Copy code
node(func=func, inputs="partitioned_dataset_name:dataset_name", ....)
thanks!
d
Deepyaman Datta
01/04/2023, 4:57 PM
Partitions are lazily loaded, so you can pass the partition key as a parameter but use the full partitioned dataset (it's not going to load all the partitions).
s
Sasha Collin
01/04/2023, 4:57 PM
ok clear, thx !
2
Views
Open in Slack
Previous
Next