We've lost the next election, says conservative MP Charles Walker