Academic Funding

We’re At Work on the Next Iteration of REF Academic Funding
© HEFCE copyright material is reproduced with the permission of Higher Education Funding Council for England (HEFCE) and may be accessed in its original form here:[INSERT LINK] .

We’re At Work on the Next Iteration of REF

December 17, 2014 971

The wait is over, the results of the Research Excellence Framework (REF) will be released to the world Thursday. In the run up to the big announcement it isn’t surprising that there is plenty of commentary about the REF, its perceived strengths and weaknesses, its costs and benefits, the funding outcomes, and of course the future of and planning for the next exercise. An example of the latter is a letter from the presidents of the British Academy and Royal Society in last week’s THE calling for a thorough evaluation of the costs of the REF, to inform future planning.

HEFCE logo

This article by Steven Hill originally appeared under the tile “Time for REFlection” on the HEFCE blog. It is © HEFCE copyright material and is reproduced with the permission of Higher Education Funding Council for England (HEFCE) and may be accessed in its original form HERE. Click HERE for details on this license. (H/T to LSE Impact of Social Sciences blog.)

In my team, we have actually been thinking about the future of the exercise for close to two years already. We believe an essential starting point is gathering robust evidence about the process that we are just completing, as well as getting up-to-date evidence on wider questions of research assessment. So, working with the other UK Funding Bodies, we have an extensive and detailed programme of work underway, or due to be commissioned, that will provide a solid foundation on which to debate the future during 2015.

While all of these activities are in the public domain, the aim of this post is to present them together, to give a sense of the overall programme.

  1. One focus of the evaluation is on the impact element of the REF. This element is new, not just for the UK but globally, so it is essential that we subject what we have done to suitable scrutiny. During 2013 and 2014 we commissioned RAND Europe to investigate the costs, benefits and implications for institutions preparing submissions to the exercise. And now, RAND are carrying out a second phase of the evaluation working with REF panel members to evaluate the assessment process for impact. These studies will provide an in depth review of the impact element from all angles.
  2. At the same time, we have also commissioned Digital Science and Kings College London to carry out a synthetic analysis of the case studies submitted to the REF, that will provide not only evidence on the impact that research in HEIs makes, but will also provide valuable information on the types of impact that feature in the REF, and how impact varies by discipline.
  3. To further our understanding of the implications of the REF within institutions, at the beginning of this year we also invited feedback from HEIs on the process. More than 100 HEIs (out of the 154 who submitted) responded, and provided a wealth of information on costs, benefits, problems and solutions.
  4. We are also seeking feedback from REF panel members, and are running a series of focus groups with them. These are already providing valuable insight.
  5. While the impact studies described already are examining the costs associated with that element, we have also commissioned from Technopolis a further study to estimate the costs and benefits of the rest of the exercise. A particular focus will be the costs of the provisions made for special staff circumstances. These provisions have been welcomed by institutions and researchers alike, but we know that there have been associated cost implications.
  6. We are also about to commission work to examine the position of multi- and inter-disciplinary research in the REF, as a part of wider work, some of it planned jointly with RCUK. We are also doing some work to look at the extent to which outputs submitted to the REF reflect collaborations between institutions.

Taken together these evaluations will provide a rounded and complete evaluation of the REF. But it is also important that we consider wider issues beyond the current exercise. A central part of this is the independent review on the use of metrics in research assessment that is being led by professor James Wilsdon. While this study is broader than just a consideration of the use of metrics in national research assessments, it is going to provide important evidence to inform the thinking about future REF exercise.

Once the solid foundation of evidence is built during the course of 2015, we can then begin the debate about the future, with researchers and HEIs, of course, at its heart.


Steven Hill is head of research policy at HEFCE.

View all posts by Steven Hill

Related Articles

A Community Call: Spotlight on Women’s Safety in the Music Industry 
Insights
March 22, 2024

A Community Call: Spotlight on Women’s Safety in the Music Industry 

Read Now
Charles V. Hamilton, 1929-2023: The Philosopher Behind ‘Black Power’
Career
March 5, 2024

Charles V. Hamilton, 1929-2023: The Philosopher Behind ‘Black Power’

Read Now
Did the Mainstream Make the Far-Right Mainstream?
Communication
February 27, 2024

Did the Mainstream Make the Far-Right Mainstream?

Read Now
SSRC Links with U.S. Treasury on Evaluation Projects
Announcements
February 1, 2024

SSRC Links with U.S. Treasury on Evaluation Projects

Read Now
The Use of Bad Data Reveals a Need for Retraction in Governmental Data Bases

The Use of Bad Data Reveals a Need for Retraction in Governmental Data Bases

Retractions are generally framed as a negative: as science not working properly, as an embarrassment for the institutions involved, or as a flaw in the peer review process. They can be all those things. But they can also be part of a story of science working the right way: finding and correcting errors, and publicly acknowledging when information turns out to be incorrect.

Read Now
Connecting Legislators and Researchers, Leads to Policies Based on Scientific Evidence

Connecting Legislators and Researchers, Leads to Policies Based on Scientific Evidence

The author’s team is developing ways to connect policymakers with university-based researchers – and studying what happens when these academics become the trusted sources, rather than those with special interests who stand to gain financially from various initiatives.

Read Now
NSF Responsible Tech Initiative Looking at AI, Biotech and Climate

NSF Responsible Tech Initiative Looking at AI, Biotech and Climate

The U.S. National Science Foundation’s new Responsible Design, Development, and Deployment of Technologies (ReDDDoT) program supports research, implementation, and educational projects for multidisciplinary, multi-sector teams

Read Now
0 0 votes
Article Rating
Subscribe
Notify of
guest

This site uses Akismet to reduce spam. Learn how your comment data is processed.

0 Comments
Inline Feedbacks
View all comments