Hello everyone! how do we mention encoding in data...
# questions
m
Hello everyone! how do we mention encoding in data catalogue while writing a csv file? Under default setting words like its not able to show phonetics based character. eg crédito becomes cr√©dito with the current setting. Thank you for the help! 🙂
j
hi @mrinalini nag! I suppose you're using
pandas.CSVDataset
? if so, use `load_args`:
Copy code
ds:
  type: pandas.CSVDataset
  filepath: <s3://bucket/data.csv>
  load_args:
    encoding: iso-8859-1
gratitude thank you 1
let us know if that helps
m
i am able to pass encoding as a parameter. however this encoding is not working properly for some sentences.
d
@mrinalini nag we need to identify in what encoding output comes on from argos
j
you'll have to figure out the proper encoding, maybe
latin-1
? or
utf-8
👍 2