Learning Against All Odds