Prime Minister dodges Downing Street party questions