Pressure grows on Boris Johnson as No. 10 stay silent on Downing Street party