Most people in the UK higher education sector probably want the research excellence framework to deliver both generous funding for world-leading research and reasonable funding for the broad base that underpins it.
In practice, however, the formula that turns REF scores into allocations of 鈥渜uality-related鈥 (QR) funding already puts most of its emphasis on work that is rated 4* (鈥渨orld-leading in terms of originality, significance and rigour鈥). That focus 鈥 which sounds good to politicians 鈥 is only likely to intensify further. So the incentive for universities to maximise their submission of 4* work is absolute. And the increased flexibility in the rules for 2021 gives them greater ability to do聽so.
Instead of four outputs being required for every researcher selected for submission, the draft , published in July, requires universities to submit a minimum of one and a maximum of five for every research-active staff member. This will allow institutions to make more selections from the strongest publication portfolios.
Moreover, the required average of 2.5 outputs per full-time equivalent staff member is not demanding for research-intensive institutions. A humanities department in which most staff produced one 4*聽monograph (double-weighted in assessment) plus one 4*聽article over the seven-year period of assessment would enjoy a near-100聽per cent 4*聽outcome.
探花视频
Of course, some individuals will produce fewer outputs, or outputs that do not fit neatly within a unit of assessment, and it will not be possible for departments to 鈥渉ide鈥 them completely this time around by not submitting them. But most elite institutions will not struggle to find one excellent output per researcher over seven years 鈥 and there are mechanisms for taking into account extenuating individual circumstances that make even that impossible.
Grade-point averages approaching the maximum 4.0 are all the more likely given that assessors are likely to interpret the definition of 鈥渨orld-leading鈥 broadly. While directing the course of a whole discipline is a rare achievement, doing so in a tightly defined subfield might be realistic. Since assessors鈥 judgements affect their discipline鈥檚 relative standing, they have an incentive to adopt such flexible criteria.
探花视频
The result is likely to be that QR funding becomes even more concentrated in research-intensives than it is already. There are caveats. Small units with a mixed portfolio might struggle to present all their research as world-leading even on a generous interpretation. And elite research units might not produce 4*聽impact as consistently as 4*聽outputs. But, in most cases, they only need one impact case study for every 15 researchers.
While a glut of GPAs approaching 4.0 might sound great for those institutions awarded such scores, drawing a tight boundary between the research elites and the rest would have obvious drawbacks for institutions that do excellent research with an applied focus, or only in pockets. It would also fail to distinguish meaningfully within that elite, focusing on tiny differences in GPA that are unlikely to reflect material differences in quality but that would nevertheless occupy inordinate amounts of institutional attention.
Such an outcome also risks rendering invisible the broad base of research that exists even at leading institutions, making it appear that all researchers can consistently produce genuinely world-leading work. This will only serve to ratchet up the pressure on individuals further, while doing scholarship a disservice by failing to value more incremental or locally focused work.
So what is the solution? Increasing the volume requirement would increase the burden on assessors and researchers alike. But if the REF is to continue, it should adopt the broader grading scale that the funders originally advocated. That would have included an extra 5*聽category that could have been reserved for world-leading research, strictly defined.
探花视频
Perhaps that would only have resulted in further grade inflation, but this could be policed by strict enforcement of standards through the auditing of panels awarding excessive numbers of top grades. A less punitive but probably more effective measure would be to adjust the funding formula to better reward research graded聽4* or even聽3*.
That way, we could have a less elitist set of assessment outcomes and a healthier research culture.
Dominic Dean is a research quality officer at the University of Sussex. He writes in a personal capacity.
POSTSCRIPT:
Print headline:聽REF 2021 plays to elite鈥檚 strength
Register to continue
Why register?
- Registration is free and only takes a moment
- Once registered, you can read 3 articles a month
- Sign up for our newsletter
Subscribe
Or subscribe for unlimited access to:
- Unlimited access to news, views, insights & reviews
- Digital editions
- Digital access to 罢贬贰鈥檚 university and college rankings analysis
Already registered or a current subscriber?









