Business and Management INK

Revealed or Concealed?

April 19, 2011 681

Zeynep G. Aytug, Hannah R. Rothstein, Wencang Zhou, and Mary C. Kern, all of Baruch College, City University of New York, published “Revealed or Concealed? Transparency of Procedures, Decisions and Judgment Calls in Meta-Analyses in  Online First of Organizational Research Methods. They were kind enough to share some background information about the article.

Who is the target audience for this article?

Meta-analysts and readers of meta-analyses, not only in industrial and organizational psychology and organizational behavior (IOOB) but also in other fields, are all included in our target audience for the article.

What inspired you to be interested in this topic?

All of the authors of this paper are interested in research methodology and, specifically, meta-analysis. We had observed that many meta-analyses were missing pieces of information that are needed to assess their validity. Given the important role that meta-analysis plays in summarizing research literatures, this is a serious issue. We decided to see exactly how extensive this problem was in our field.

Were there findings that were surprising to you?

Most of our findings were not surprising to us, because we had already had some sense of the uneven quality of meta-analysis reporting in IOOB. However, we were not expecting to see that the majority of the meta-analyses in our sample did not report any publication bias or sensitivity analyses, which are absolutely necessary for assessing the robustness of the meta-analytic results.

How do you see this study influencing future research and/or practice?

We hope that our study will lead to improved reporting of meta-analyses. This will enable consumers of meta-analyses, including researchers, practitioners and policy makers to more easily evaluate the validity and generalizability of specific meta-analyses.

How does this study fit into your body of work/line of research?

We are all committed to improving the quality of meta-analyses, since we believe it is such an important methodological tool; this study represents one attempt to do so.

How did your paper change during the review process?

The reviewers and editor provided feedback that led us to improve the paper in many ways. Initially, we examined only two journals; based on the comments we received we expanded our sample to 11 journals, and almost 200 meta-analyses. We also increased the number of reporting items we examined, and introduced a set of core “essential to report” items.

What, if anything, would you do if you could go back and do this study again?

We would examine meta-analyses published in other fields within psychology.

Bookmark and Share

Business and Management INK puts the spotlight on research published in our more than 100 management and business journals. We feature an inside view of the research that’s being published in top-tier SAGE journals by the authors themselves.

View all posts by Business & Management INK

Related Articles

Interorganizational Design for Collaborative Governance in Co-Owned Major Projects: An Engaged Scholarship Approach
Business and Management INK
April 23, 2024

Interorganizational Design for Collaborative Governance in Co-Owned Major Projects: An Engaged Scholarship Approach

Read Now
Uncharted Waters: Researching Bereavement in the Workplace
Business and Management INK
April 22, 2024

Uncharted Waters: Researching Bereavement in the Workplace

Read Now
The Power of Fuzzy Expectations: Enhancing Equity in Australian Higher Education
Business and Management INK
April 22, 2024

The Power of Fuzzy Expectations: Enhancing Equity in Australian Higher Education

Read Now
How Do Firms Create Government Regulations?
Business and Management INK
April 18, 2024

How Do Firms Create Government Regulations?

Read Now
Challenging, But Worth It: Overcoming Paradoxical Tensions of Identity to Embrace Transformative Technologies in Teaching and Learning

Challenging, But Worth It: Overcoming Paradoxical Tensions of Identity to Embrace Transformative Technologies in Teaching and Learning

In this article, Isabel Fischer and Kerry Dobbins reflect on their work, “Is it worth it? How paradoxical tensions of identity shape the readiness of management educators to embrace transformative technologies in their teaching,” which was recently published in the Journal of Management Education.

Read Now
Data Analytics and Artificial Intelligence in the Complex Environment of Megaprojects: Implications for Practitioners and Project Organizing Theory

Data Analytics and Artificial Intelligence in the Complex Environment of Megaprojects: Implications for Practitioners and Project Organizing Theory

The authors review the ways in which data analytics and artificial intelligence can engender more stability and efficiency in megaprojects. They evaluate the present and likely future use of digital technology—particularly with regard to construction projects — discuss the likely benefits, and also consider some of the challenges around digitization.

Read Now
Putting People at the Heart of the Research Process

Putting People at the Heart of the Research Process

In this article, Jessica Weaver, Philippa Hunter-Jones, and Rory Donnelly reflect on “Unlocking the Full Potential of Transformative Service Research by Embedding Collaboration Throughout the Research Process,” which can be found in the Journal of Service Research.

Read Now
0 0 votes
Article Rating
Subscribe
Notify of
guest

This site uses Akismet to reduce spam. Learn how your comment data is processed.

0 Comments
Inline Feedbacks
View all comments