Quite apart from the problem of the vote, it’s bad for the image of Parliament that people take the trouble to come up and are not allowed to see their MP