Expert fears partisan actors may replace election workers who quit over threats