探花视频

The perils of REF 'irradiation'

Academics have internalised research assessment to such a degree that the effects may be irreversible, fears Thomas Harrison

Published on
April 24, 2014
Last updated
July 9, 2018

Source: Miles Cole

In one of the 鈥淟etters from London鈥 in which Julian Barnes described British life and politics for readers of The New Yorker (15聽November 1993), he illustrates the impact of Thatcher鈥檚 ideology on our lives through the example of carol singers.

At the time that Thatcher came to power, he says, they would stand outside your house, sing a few carols and then ring your bell to see if you wanted more. Then, 鈥渉alfway through the rule of Thatch鈥, they began to sing only when they had checked that you 鈥渨ere there to listen and pay up鈥. After a full decade of Thatcherism, Barnes peered out of his house one evening to see two boys at a distance. 鈥溾夆楥arols?鈥, one of them asked, spreading his hands in a business-like gesture.鈥 It was as if 鈥渉e had just acquired a job lot of tunes off the back of a lorry and could perhaps be persuaded to cut me in鈥. Thatcherism was not a reversible phenomenon, Barnes then realised, but 鈥渁n irradiation of the soul鈥.

The first attempt to measure the quality of British academic research 鈥 as 鈥渙utstanding鈥, 鈥渁bove average鈥, 鈥渁verage鈥 or 鈥渂elow average鈥 (even those terms seem quaint now) 鈥 took place in 1986 at the height of Thatcher鈥檚 dominance. And just as Thatcherism represented, in Barnes鈥 image, not just a pendulum swing but a rehanging of聽the whole clock at a different angle, so research assessment in all its guises 鈥 the research selectivity exercise, the research assessment exercise and now the research excellence framework 鈥 has transformed academic life in ways of which we are not always even conscious. No聽longer just a periodic 鈥渆xercise鈥, but a 鈥渇ramework鈥, it聽structures our daily lives.

I聽have grown up with research assessment, as I聽grew up with Thatcher. First, I聽prospered by it. My first permanent job came at a time when I聽was (in terms of publications) like a聽full-fed calf ready for market. Since then I鈥檝e聽operated as a low-level enforcer of this research economy, trying to ensure that our plans for research 鈥渙utputs鈥, 鈥渞esearch environment鈥 and the verifiable 鈥渋mpact鈥 of our work outside academia are fulfilled in spite of all the obstacles of work and life, and drafting and redrafting innumerable words of fact-crammed strategic prose.

探花视频

ADVERTISEMENT

As a REF coordinator married to another REF coordinator, moreover, in the run-up to the recent REF deadline there was no escape even at home. A rare evening of not working saw us collapsed in front of a documentary in which academic vets tracked the movement of domestic cats around a Home Counties village. One by one, villagers pronounced that their understanding of their seemingly sleepy moggie had been transformed on discovering that he or she had been marauding far and wide. Instantly we turned to聽each other: 鈥淚f聽only we had such clear evidence of impact鈥 was the unspoken thought.

Until now, I鈥檝e always been 鈥 at least in part 鈥 an apologist for research assessment, not least for its effect in ring-fencing some time for research. But, more and more, I聽wonder.

探花视频

ADVERTISEMENT

First, there is the clear evidence of the negative impact on gender equality, as discussed in a聽recent article in these pages (鈥Hear us, by聽thunder!鈥, Features, 20 March). Or the immense damage done to individuals鈥 morale and to the cohesiveness of a department when a given colleague鈥檚 contribution is not deemed worthy of inclusion. Then there is the false wedge that REF has driven between books for a wide audience and weighty 鈥淩EF-able鈥 research. (I聽doubt I am alone in sometimes hearing an inner voice telling me to slap on a聽few more footnotes for good measure.)

And then, what end does this industry serve? From one cycle to another, we鈥檝e all become increasingly professional players of the game. (A colleague remembers the proud claim made in a 1996 submission that 鈥渢he department has its own photocopier鈥 鈥 unthinkable now.) We are all looking for marginal gains, in competition against colleagues and friends in our own disciplines, for a diminished pot of money. And, all the while, our main focus has shifted to the recruitment of fee-paying students.

Above all, perhaps, for me, it is the perverse incentives of this world of research assessment, its artificiality and the sense of dislocation between the daily business of research and its marketisation that disturbs: seeing the prizewinning products of the best US universities ruled out of contention for UK jobs, for lack of sufficient 鈥淩EF-able鈥 outputs; finding oneself recommending that a colleague or graduate should delay the publication of her monograph tactically until after a REF 鈥渃ensus date鈥. And then the occasional realisation of just how deeply embedded the 鈥渧alues鈥 of research assessment are inside myself, of the effort that is needed to remember the real value of research.

My wife thought that a year of reading nothing but poetry might be a cure 鈥 not that that was ever feasible. I聽worry that the irradiation is irreversible.

探花视频

ADVERTISEMENT

Thomas Harrison is聽Rathbone professor of ancient history and classical archaeology at the University of Liverpool.

Register to continue

Why register?

  • Registration is free and only takes a moment
  • Once registered, you can read 3 articles a month
  • Sign up for our newsletter
Please
or
to read this article.

Reader's comments (2)

Why not start with a poem by Constantinos Cavafis - translated by his brother in English - which I posted before as comfort to the individual's morale when his or her "contribution is not deemed worthy of inclusion". I hope readers will forgive the repeat - after all, in 1996 a photocopy would have shown acceptable impact :) Addition Whether I am happy or unhappy, it is not my care to examine. But of this have I the joy to be aware that in their immense addition 鈥 their detestable addition with the myriad rows of figures, I am not recorded there of the many units one. Of me there is no recognition in their numeration. And this joy suffices my ambition. ** Many will want the carols back - the genuine participation for the common good - a communication on how to become a better society, getting to know our world and how to change it鈥 隆in the direction of our choice!
I am most struck by the post-REF turn in these articles (see also Bigsby). In most institutions, the REF cycle is an endless hamster wheel, whereby after the REF is before the REF

Sponsored

Featured jobs

See all jobs
ADVERTISEMENT