Voters who stayed at home for local elections will back Tories at general election, claims minister