Michael Gove 'saddened by EU refusing to negotiate' on Brexit