Liberal Party has had a 'women's problem' for a 'very long time'