My Lords, I support the comments of the noble Lord, Lord Lipsey, on the National Student Survey, and will speak to Amendments 194 and 201 standing in my name. Before doing so I would like to underline that we are talking about the use of measures to give ratings. With respect to the comments made by the noble Baroness, Lady Blackstone, I think that there is a huge difference between what is useful internally and what is suitable for a high-profile, high-stakes national rating system. In my first amendment I have suggested, or requested, that any measures used should be criteria-referenced, and therefore provide a substantive rating and indication of attainment or degree of attainment. I am slightly alarmed that this is even at issue, and take issue with the noble Lord, Lord Willetts, when he suggests that benchmarking is the way forward.
I have an example from the rail regulator. We can be told what proportion of trains are late, which is a substantive measure: we can have a target—which in fact it has—which says that it is reasonable that there should be X per cent, and then you fall this far short. We can be told whether a given rail company is doing better or worse than the others. This year it is really pretty easy for everybody to do better than Southern, but does that mean that they are all doing well? I do not think that you can conclude that.
If you have benchmarked or relative measures, the problem is that all that you are being told is how people stand relative to each other. We might have a system in which the quality of teaching was excellent across the board, yet in which half the institutions would by definition be below average; or we could have a system in which all the institutions were doing rather poor-quality teaching, yet in which half of them would be above average. That is not the sort of system that we wish to use. We would not wish to imply to students that that gave them helpful information. A measure that is bad does not become good by being made relative; and a measure that is good is good in its own right, not simply by being turned into something in which you rank people on the curve. That is an important aspect of how the Office for Students approaches the sorts of ratings that it gives and the way in which it conceives of them.