Researchers Talk About University Impact and How to Measure It

November 25, 2020 2654

Universities in Australia are facing great financial challenges and a swathe of redundancy programs is under way. Many senior academics are retiring early. Those that remain are picking up more teaching load. Research and teaching programs are both at risk of being seriously compromised.

Beyond the individual loss for people who have built careers exploring important research challenges, what may be less apparent is our collective loss as a society if academics are deprived of the time to explore tough questions that we need answers for.

It might be hard to look beyond the immediate crisis in higher education, but universities will remain crucial social institutions. Now is the right time to continue the conversation about what they are and who they serve. And what are their impacts?

As part of our Impact at UTS podcast series, we spoke to researchers about how they navigate collaboration, engagement – with communities, industry and government – and impact. The breadth and depth of these impact stories reveal many inter-related insights, which we present later in this article. (You can listen to a full podcast episode at the end.)

Why does university research impact matter?

Universities are uniquely placed to explore complex problems that our collective future depends on. They can do so in a rigorous, ethical, collaborative and enduring way. Peer review regulates subjectivity and biases.

Investing the time to confront complex problems is often beyond the appetite and patience of a corporate agenda driven by other imperatives, including short-term survival. Nationally, Australia continues to lag in OECD rankings for research and development. This is obviously not desirable, and it’s a symptom of bigger problems in the university sector.

The sector has rightly begun to question inward-looking measures of success and KPIs, which are largely based on quantifying research grants in and publications out. Only other researchers care about such things.

Here, we ask why is the research worth doing in the first place? What does it contribute beyond the esteem of academic colleagues?

The COVID-19 crisis has intensified the need to revisit the relationship universities have with society. Every academic needs to grapple with questions of why or when research should be prioritized over teaching and upskilling job seekers and job keepers.

The Conversation logo
This article by Martin Bliemel and Julian Zipparo originally appeared on The Conversation, a Social Science Space partner site, under the title “Who cares about university research? The answer depends on its impacts”. This essay is based on the Impact at UTS podcast series. The audio series examines how a diverse range of researchers embed knowledge exchange and impact in their research strategy.

The challenges of assessing impact

While a shift away from crude input-output metrics towards research impact sounds appealing, assessing impact is much harder to do at scale.

And, perhaps more importantly, many academics are highly specialized. Some are amazing curriculum designers, teachers, grant writers, researchers, report writers, administrators, team managers, stakeholder engagers (if that’s a real word) etc. So, among academics, it’s only natural that some will focus on impact more than others.

Academics create value in myriad ways, and rarely do you find a “purple squirrel” – someone who excels at the full spectrum of work to be done. But, if impact is increasingly relevant to all academics, then a shift towards impact opens questions about performing as a team or individually.

There is also understandable skepticism and change resistance to the “impact agenda” among academics. They are already time-poor and highly scrutinized. Any additional reporting and accountability requirements, such as the Australian Research Council’s engagement and impact assessment, feel like the last straw for academics, especially those who are busy chasing yesterday’s KPIs.

The research engagement and impact agenda needs to be worked through with great care. For a start, measurement of anything indelibly changes it, and new KPIs can introduce perverse responses and behaviors.

Focusing on engagement and impact also reinvigorates important value questions. There is always a risk that fundamental research is viewed as having no foreseeable impact. Yet it has given us so many unexpected and significant societal benefits.

A classic example is radio-astronomy research by CSIRO and Macquarie University leading to wi-fi, which is an enabling technology for further innovations. Similarly, there was no guarantee of success at the start of decades of experimenting involved in innovations like HPV vaccines, cochlear implants and solar panels. Each innovation has directly and indirectly improved millions of lives.

Binary thinking about research versus impact, or applied versus fundamental research, is misguided, as societal benefits rely upon both sides of those coins. The tension of research versus teaching is similarly unproductive.

Robert Langer in his lab
Few researchers will have the impact of Robert Langer, but they can learn from what researchers like him do. (Photo: Science History Institute/Wikipedia, CC BY)

Learning from researchers with impact

We can look to outliers or “purple squirrels” to learn about research excellence with impact. Robert Langer is an outstanding example. One of his ventures, Moderna, is a leader in developing a COVID-19 vaccine.

Langer’s lab at MIT has generated thousands of articles and patents, raising billions of dollars to spin out over 40 companies. This work includes treating multiple forms of cancer, endometriosis, eczema, vocal cord damage and more, and has affected the lives of billions. His papers with industry collaborators are also discussed more widely than papers published by academics only.

Research by Robert Langer and his colleagues is estimated to have affected the lives of 2 billion people. Global outliers like Langer are certainly inspiring, but can feel inaccessible for the average researcher.

For our Impact at UTS podcast series, we spoke to highly acclaimed but more accessible researchers about how they navigate collaboration, engagement and impact. We cast a wide net. Their work spans a variety of disciplines and issues, including rebuilding reefs, Indigenous rights and self-determination, beach safety, solving crime through trace detection, access to clean water, autonomous vehicles, and more.

What did these researchers tell us?

These impact stories consistently reveal many inter-related insights, including:

  • Researchers’ desires to effect positive change align with the shift towards valuing benefits
  • Researchers can be faithful to standards of academic rigor, ethics and independence while having material impact
  • Complex problems demand multi- or transdisciplinary approaches, which often have engagement built in
  • Engagement starts before a research project is formalized, and continues during and after it — gone are the days of throwing mono-disciplinary publications behind a paywall in the hope someone will discover it, make sense of the jargon and bridge the research-policy gap
  • Engagement is based on shared values, which become shared language and shared understandings
  • Formal agreements are important, but impactful collaboration is far from being transactional or contractual
  • It’s a team effort — there might be one chief investigator, but it’s often a team of researchers and several non-university stakeholders.

Fulfilling universities’ public purpose

These insights reveal a more holistic and integrated picture of research engagement with communities, industry and government. By engaging with research end-users early, researchers get a real understanding of the problem. This helps inform their research, leading to greater impact and adoption.

The lessons learned should resonate with academics from any discipline or stage of career. They are also useful to non-academics as they select which academic or university to reach out to.

Despite the COVID-19 chaos, what endures is that universities are institutions with a public purpose. In Australia, publicly funded agencies employ a significant proportion of the research workforce. University research thus plays a critical role in addressing complex problems and national needs.

A focus on the benefits that accrue from university research provides an opportunity for universities to enhance public trust and confidence in the value of their research. An engaged and supportive public may just be the most effective pathway towards creating the political will to adopt coherent, evidence-based policy.

For researchers, greater impact contributes to a virtuous research life cycle, including more sustainable funding. Last, but certainly not least, being able to draw on excellent research with impact in the classroom creates cutting-edge education and lifelong learning experiences in a way that more authentically includes the voices of the people impacted by the research.

Subscribe to the Impact at UTS podcast on your favourite podcast app: Apple Podcasts, Spotify, Stitcher. Impact at UTS was made by Impact Studios at the University of Technology Sydney – an audio production house that combines academic research with audio storytelling for real-world impact.

Martin Bliemel, Associate Dean of Research; Course Director, Diploma in Innovation, University of Technology Sydney and Julian Zipparo, Executive Manager, Research Engagement, UTS; PhD candidate in Higher Education, UNSW

Martin Bliemel (pictured) is the associate dean of Research at University of Technology Sydney's Faculty of Transdisciplinary Innovation. He is also the course director for the Diploma in Innovation, a short premium degree that adds value to any undergraduate degree by emphasizing entrepreneurial, innovative, creative and collaborative capability development towards solving complex, networked or wicked problems. Julian Zipparo is an executive manager at the UTS Research Office, and is finalizing a PhD thesis at the University of New South wales on the topic of institutional diversity in Australian higher education. His areas of interest and expertise include research engagement, policy and management, as well as research strategy development in higher education.

View all posts by Martin Bliemel and Julian Zipparo

Related Articles

Addressing the United Kingdom’s Lack of Black Scholars
Higher Education Reform
February 8, 2024

Addressing the United Kingdom’s Lack of Black Scholars

Read Now
Connecting Legislators and Researchers, Leads to Policies Based on Scientific Evidence
January 25, 2024

Connecting Legislators and Researchers, Leads to Policies Based on Scientific Evidence

Read Now
Your Data Likely Isn’t Best Served in a Pie Chart
January 16, 2024

Your Data Likely Isn’t Best Served in a Pie Chart

Read Now
Research Integrity Should Not Mean Its Weaponization
January 11, 2024

Research Integrity Should Not Mean Its Weaponization

Read Now
When University Decolonization in Canada Mends Relationships with Indigenous Nations and Lands

When University Decolonization in Canada Mends Relationships with Indigenous Nations and Lands

Community-based work and building and maintaining relationships with nations whose land we live upon is at the heart of what Indigenizing is. It is not simply hiring more faculty, or putting the titles “decolonizing” and “Indigenizing” on anything that might connect to Indigenous peoples.

Read Now
The Social Sciences Are Under Attack in Higher Education

The Social Sciences Are Under Attack in Higher Education

The social sciences have been a consistent target for political operatives around the United States in recent years., and recent actions at the state level have opened a new front in the long-running conflict.

Read Now
Philip Rubin: FABBS’ Accidental Essential Man Linking Research and Policy

Philip Rubin: FABBS’ Accidental Essential Man Linking Research and Policy

As he stands down from a two-year stint as the president of the Federation of Associations in Behavioral & Brain Sciences, or FABBS, Social Science Space took the opportunity to download a fraction of the experiences of cognitive psychologist Philip Rubin, especially his experiences connecting science and policy.

Read Now
0 0 votes
Article Rating
Notify of

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Inline Feedbacks
View all comments