How to import Custom json encoder class into data cataloge
I’ve a df which stores lists in a column. I am saving the df with all columns in json using
config_new:
  type: json.JSONDataSet
  filepath: data/01_raw/new_config.json
  save_args:
    indent: 6
 
It’s saving all columns ok , except the column with list as string. As in:
“T”:[{
“Col1”: “9”
“Col2”: “[“7”,”9”,”0”,”5”]”
}]
As you can see above col2 list is coming out as string
I am using json encoder class as below in a python script and saving it under src :
import json
 ...