05/18/2023, 11:31 PM
K Hi Everyone! K Quick question: In one of my nodes I have a function
that takes a dataframe as input, makes some stuff and
output a python
Is there any way to save that dict in the data catalog? . as a workaround I was saving it as a pandas csv and later transforming it back to a dict. but I'm tired of doing that. Thanks in advance 😄
05/18/2023, 11:32 PM
Maybe a using Pickle dataset?
05/18/2023, 11:37 PM
hey good idea!
it worked!!! thanks a lot 🦜
05/19/2023, 2:51 AM
Also, you don't have to persist everything. If you don't need to save a dictionary to disk, you can just leave it as a MemoryDataSet.