Business and Management INK

Are There Questionable Research Practices in Management Research?

March 20, 2014 917

erasure-1123441-mThe publishing industry can be competitive. But how far will a potential researcher go to achieve success? Farther than you would think, according to a forthcoming Journal of Management article entitled “The Chrysalis Effect: How Ugly Initial Results Metamorphosize into Beautiful Articles.”

The abstract:

The issue of a published literature not representative of the population of research is most often discussed in terms of entire studies being suppressed. However, alternative sources of publication bias are questionable research practices (QRPs) that entail post hoc alterations of hypotheses to support data or post hoc alterations of data to support hypotheses. Using general strain theory as an explanatory framework, we outline the means, motives, and opportunities for researchers to better their chances of publication independent of rigor and relevance. We then assess the frequency of QRPs in management research by tracking differences between dissertations and their resultingjom cover journal publications. Our primary finding is that from dissertation to journal article, the ratio of supported to unsupported hypotheses more than doubled (0.82 to 1.00 versus 1.94 to 1.00). The rise in predictive accuracy resulted from the dropping of statistically nonsignificant hypotheses, the addition of statistically significant hypotheses, the reversing of predicted direction of hypotheses, and alterations to data. We conclude with recommendations to help mitigate the problem of an unrepresentative literature that we label the “Chrysalis Effect.”

Leading author Ernest Hugh O’Boyle, Jr. and Journal of Management Associate Editor Fred Oswald discuss the article’s findings and the effects these findings have on management literature in a new podcast. You can listen to the interview for free by clicking here.

Read “The Chrysalis Effect: How Ugly Initial Results Metamorphosize into Beautiful Articles” for free from Journal of Management by clicking here. Want to know about all the latest from Journal of Management? Click here to sign up for e-alerts!

Business and Management INK puts the spotlight on research published in our more than 100 management and business journals. We feature an inside view of the research that’s being published in top-tier SAGE journals by the authors themselves.

View all posts by Business & Management INK

Related Articles

From Collision to Collaboration: Bridging University and Industry Relationships
Business and Management INK
May 17, 2024

From Collision to Collaboration: Bridging University and Industry Relationships

Read Now
Motivation of Young Project Professionals: Their Needs for Autonomy, Competence, Relatedness, and Purpose
Business and Management INK
May 14, 2024

Motivation of Young Project Professionals: Their Needs for Autonomy, Competence, Relatedness, and Purpose

Read Now
A Complexity Framework for Project Management Strategies
Business and Management INK
May 10, 2024

A Complexity Framework for Project Management Strategies

Read Now
Bringing Theories into Conversation to Strategize for a Better World
Business and Management INK
May 8, 2024

Bringing Theories into Conversation to Strategize for a Better World

Read Now
Exploring Discrimination Faced by Asian Nationals in the U.S. Labor Market

Exploring Discrimination Faced by Asian Nationals in the U.S. Labor Market

Amit Kramer, Kwon Hee Han, Yun Kyoung Kim, and Yun Kyoung Kim reflect on the hypotheses and observations that led to their article, “Inefficiencies and bias in first job placement: the case of professional Asian nationals in the United States.”

Read Now
Interorganizational Design for Collaborative Governance in Co-Owned Major Projects: An Engaged Scholarship Approach

Interorganizational Design for Collaborative Governance in Co-Owned Major Projects: An Engaged Scholarship Approach

Large projects co-owned by several organizations with separate, perhaps competing, interests and values are characterized by complexity and are not served well […]

Read Now
Uncharted Waters: Researching Bereavement in the Workplace

Uncharted Waters: Researching Bereavement in the Workplace

To me, one of the most surprising things about bereavement is its complexity and that it can last far longer than expected. This is challenging to navigate at work where, unless it was a coworker’s death, no one else’s world has changed.

Read Now
0 0 votes
Article Rating
Subscribe
Notify of
guest

This site uses Akismet to reduce spam. Learn how your comment data is processed.

0 Comments
Inline Feedbacks
View all comments