Ethics

What a Chastened Discipline Can Teach All of Social Science About Open Science Ethics
Is open peer review adding transparency, or just another layer of obstruction.

What a Chastened Discipline Can Teach All of Social Science About Open Science

March 24, 2021 1327
open peer review concept

A new article in PS: Political Science & Politics, “Improving Social Science: Lessons from the Open Science Movement,” analyzes psychological science in the aftermath of a “replication crisis” and “credibility revolution” and explicitly examines “what social scientists can learn from this story.” The authors — Per Engzell, a research fellow in sociology at Nuffield College, University of Oxford, and Julia M. Rohrer, personality psychologist and lecturer at the University of Leipzig – note that while their careers have made them “outsiders” to political science and many other disciplines, “What unites us is an interest in meta-scientific questions that has made us wonder how disciplines beyond psychology can benefit from increased transparency.”

Psychology’s own increased transparency followed a series of “high-profile replication failures” that reflected structural problems. “Low power, misuse of significance testing, researcher degrees of freedom, and post hoc hypothesizing had created a cycle in which flashy but spurious results spread with little attempt of falsification.” Problems identified in psychology have been noted in political science, too, including “low computational reproducibility and sanitized research narratives that do not capture the actual complexity of the process.”

Psychology as a discipline responded to the issues with a broad range of remedies, “not always linked to openness,” such as better measurement, greater rigor and stricter significance thresholds.

The article makes several recommendations for improving social science, based on psychology’s experience. Still, the article cautions, attempts to improve the empirical status of a discipline should be localized to that discipline. One size, the authors state, does not fit all. Nonetheless, harnessing tacit knowledge, rewarding contributions to the common good and being inclusive are generalizable as beneficial.

Indeed, the benefits of transparency are large. “Sharing of data and other materials reduces duplicate work and increases the yield from a given dataset, enables pooling of evidence, imposes greater self-scrutiny, and allows others to adapt and build on existing efforts.” This can benefit researchers early on in their careers, as the entry barrier will be lowered as they become less dependent on access to prominent mentors.

Open science’s unifying core, the authors write, is its shared understanding that increased transparency and accessibility can enhance the quality of research and keep scientists’ biases in check. The recent push towards openness is “neither a fad nor an innovation,” but a recognition of “shared interest.”

The report comes to the “uplifting” conclusion that the aims of open science are largely those of the scientific method itself _ “open science is really just science.”

To see the full article, click here. 

Kenalyn Ang is the social science communications intern with SAGE Publishing. She is also a communications student at the USC Annenberg School. Her research focuses on consumer behavior, identity-making and representation through the written word, and creative sensory marketing and branding strategies.

View all posts by Kenalyn Ang

Related Articles

Addressing the United Kingdom’s Lack of Black Scholars
Higher Education Reform
February 8, 2024

Addressing the United Kingdom’s Lack of Black Scholars

Read Now
Using Forensic Anthropology to Identify the Unknown Dead
Infrastructure
January 29, 2024

Using Forensic Anthropology to Identify the Unknown Dead

Read Now
Gabe Miller Leaving CFHSS for Universities Canada
Announcements
January 18, 2024

Gabe Miller Leaving CFHSS for Universities Canada

Read Now
Research Integrity Should Not Mean Its Weaponization
Ethics
January 11, 2024

Research Integrity Should Not Mean Its Weaponization

Read Now
What Do We Know about Plagiarism These Days?

What Do We Know about Plagiarism These Days?

In the following Q&A, Roger J. Kreuz, a psychology professor who is working on a manuscript about the history and psychology of plagiarism, explains the nature and prevalence of plagiarism and the challenges associated with detecting it in the age of AI.

Read Now
The Silver Lining in Bulk Retractions

The Silver Lining in Bulk Retractions

This is the opening from a longer post by Adya Misra, the research integrity and inclusion manager at Social Science Space’s parent, Sage. The full post, which addresses the hows and the whys of bulk retractions in Sage’s academic journals, appears at Retraction Watch.

Read Now
Our Academic-Industry ‘Research Sprints’ Can Solve Problems in 30 Days

Our Academic-Industry ‘Research Sprints’ Can Solve Problems in 30 Days

Inspired by ‘design sprints’ a Google where projects could create a prototype in five days, the authors started doing ‘research sprints’ in 2015.

Read Now
0 0 votes
Article Rating
Subscribe
Notify of
guest

This site uses Akismet to reduce spam. Learn how your comment data is processed.

0 Comments
Inline Feedbacks
View all comments