The Canada Revenue Agency charges installment interest on late income tax payments. However, if you incur a penalty it is possible to eliminate or reduce the charge by paying your next installment early. More information can be found on the CRA website at:
http://www.cra-arc.gc.ca/tx/ndvdls/tpcs/ncm-tx/pymnts/nstlmnts/ntrst-eng.html