Hi everyone, I´m loading a csv file as pandas data...
# questions
p
Hi everyone, I´m loading a csv file as pandas dataset, some columns are dates [%m %d %Y] (US format) and I want to get them loaded as a date type with format [%Y %m %d], what should I add to the catalog YAML? or should I do the change in a node? ''' dataset: type: pandas.CSVDataset filepath: data\01_raw\DataSet.csv load_args: dtype: { 'Order ID': object, #columns set as object dtype 'Transaction ID': object, 'Listing ID': object, } '''
j
hey @Pablo Biosca! you can try adding the
parse_dates
parameter to
load_args
https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.read_csv.html for example
Copy code
dataset:
  type: pandas.CSVDataset
  filepath: data\01_raw\DataSet.csv
  load_args:
    dtype: ...
    parse_dates: ["date_col1", "date_col2"]
p
Thank you!
🙌🏼 1