Wade's ex-lawyer says he was speculating when he told attorney about Fani Willis relationship