How to import Custom json encoder class into data cataloge
I’ve a df which stores lists in a column. I am saving the df with all columns in json using
config_new:
type: json.JSONDataSet
filepath: data/01_raw/new_config.json
save_args:
indent: 6
It’s saving all columns ok , except the column with list as string. As in:
“T”:[{
“Col1”: “9”
“Col2”: “[“7”,”9”,”0”,”5”]”
}]
As you can see above col2 list is coming out as string
I am using json encoder class as below in a python script and saving it under src :
import json
...