If voters want fewer migrants, why don’t pollies listen?