Polling parties leave for tomorrow by-elections