Is there a way in kedro in which I can overwrite the info lo

Question

Is there a way in kedro in which I can overwrite the info log file every time it executes Currently it is appending new run logs

Nok Lam Chan · Answer

you will need to change the type of logger it is using

tom kurian · Answer

can you give me an example if possible

Nok Lam Chan · Answer

``` info file handler class logging handlers RotatingFileHandler level INFO formatter simple filename info log maxBytes 10485760 10MB backupCount 20 encoding utf8 delay True``` This is the default

Nok Lam Chan · Answer

Do you need to overwrite the file completely Or you want to keep the record having `info1 log` `info2 log` etc

datajoely · Answer

or you could use an `after pipeline run` hook to just truncate the file

datajoely · Answer

ugly but would work

tom kurian · Answer

I need to overwrite everytime

Nok Lam Chan · Answer

Nok Lam Chan · Answer

I guess it is as simple as changing `mode w` I haven t tested though

tom kurian · Answer

let me try slightly smiling face

tom kurian · Answer

``` info file handler class logging handlers RotatingFileHandler level INFO formatter simple filename logs info log maxBytes 10485760 10MB backupCount 20 encoding utf8 delay True mode w``` i tried this but still it is appending the logs

Nok Lam Chan · Answer

No Kedro magic is involved all pure python `logging` I just tried and it works Thanks for asking the question I didn t know this before too slightly smiling face The simple solution is don t use `RotatingFileHandler` use the basic one ``` info file handler class logging FileHandler level INFO formatter simple filename info log delay True encoding utf8 mode w```