Jacob Rees-Mogg refuses to apologise for partygate comments