You mustn’t expect prime ministers to enjoy themselves. If they do, they mustn’t show it – the population would be horrified