Tory ministers quit in droves