There’s not much place for the loyalists – especially the loyalists who left – in standard American history.