Business and Management INK

Does Your Data Suffer from Common Method Variance?

March 25, 2022 3085
Four vertical bars of various shades of blue
Check your attitude … (Image: areif_munandar/Pixabay)

In this post, authors Brian K. Miller and Marcia J. Simmering reflect on their recent research article, Attitude Toward the Color Blue:  An Ideal Marker Variable,” published in Organizational Research Methods.

We wanted to help researchers resolve the age-old question of determining if their data suffered from common method variance (CMV) which is the tendency for the relationship between variables collected at one time, from one source, via one method to have artificially inflated correlations. 

This paper is based off of a conference paper by Brian that was presented in 2008. In that paper, a scale designed to be unrelated to anything else in the data set was developed called Attitude Toward the Color Blue (ATCB). Unbeknownst to Brian, he had created an ideal marker variable that others started to find useful. Since then, Brian has had many requests to use the items, which was confirmation that this variable had real value to researchers. Several years ago, Marcia co-authored a paper in Organizational Research Methods that found that of all the ideal marker variables being used, that ATCB likely performed well. Brian reached out to Marcia, and together we planned a full-blown multi-sample scale development paper to refine the ATCB scale. 

Brian K. Miller, left, and Marcia J. Simmering Dickerson

The biggest challenge for Brian was cracking the secret Mplus code used to test the very complicated models as part of the CFA Marker Technique and to not lose track of the steps in the process for each sample in the paper. For Marcia the challenge was helping reviewers and peers understand that most other so-called ideal marker variables were far from ideal and that the world truly needed a real ideal marker variable. 

We painstakingly demonstrated the best practices in scale development procedures and we verified many useful features of the scale. We hope that any researcher who collects cross-sectional same-source data uses our items, downloads our thoroughly annotated Mplus code, and tests whether their data suffers from CMV. Having this ideal marker variable and the code to run the CFA Marker Technique should go a long way in helping other researchers verify that their data is free from CMV.

We think that everything a researcher would want to know about the scale is in the paper, even why we chose blue over other colors! We sincerely thank Dr. Louis Tay, the action editor, and the anonymous reviewers at ORM who helped us along the way and pushed us to explore ideas that we wouldn’t have addressed if not for their insight.

In a research world where it seems that all of the good ideas have been examined already, new scholars should bounce their ideas off of lay persons, not just other academics. Oh, and find good co-authors too!  Being able to collaborate with someone whose skillset complements yours, who you trust, and who you enjoy working with, makes it easier to publish.

The most influential paper that Brian read was: Simmering et al. (2015).  “Marker variable choice, reporting, and interpretation in the detection of common method variance:  A review and demonstration” in Organizational Research Methods.

The most influential paper that Marcia read was: Aguinis et al. (2020). “Best-practice recommendations for producers, evaluators, and users of methodological literature reviews.” Organizational Research Methods.

Dr. Brian Miller is a Professor in the Department of Management at Texas State University, San Marcos. Dr. Marcia Simmering Dickerson is the Francis Mangham Endowed Professor in the Department of Management at Louisiana Tech University.

View all posts by Brian K. Miller and Marcia Simmering

Related Articles

Keeping Qualitative Research Weird!
Business and Management INK
May 23, 2024

Keeping Qualitative Research Weird!

Read Now
Digital Scholarly Records are Facing New Risks
Research
May 21, 2024

Digital Scholarly Records are Facing New Risks

Read Now
Sometimes, We Do Need a Narcissist
Business and Management INK
May 21, 2024

Sometimes, We Do Need a Narcissist

Read Now
From Collision to Collaboration: Bridging University and Industry Relationships
Business and Management INK
May 17, 2024

From Collision to Collaboration: Bridging University and Industry Relationships

Read Now
Analyzing the Impact: Social Media and Mental Health 

Analyzing the Impact: Social Media and Mental Health 

The social and behavioral sciences supply evidence-based research that enables us to make sense of the shifting online landscape pertaining to mental health. We’ll explore three freely accessible articles (listed below) that give us a fuller picture on how TikTok, Instagram, Snapchat, and online forums affect mental health. 

Read Now
New Fellowship for Community-Led Development Research of Latin America and the Caribbean Now Open

New Fellowship for Community-Led Development Research of Latin America and the Caribbean Now Open

Thanks to a collaboration between the Inter-American Foundation (IAF) and the Social Science Research Council (SSRC), applications are now being accepted for […]

Read Now
Motivation of Young Project Professionals: Their Needs for Autonomy, Competence, Relatedness, and Purpose

Motivation of Young Project Professionals: Their Needs for Autonomy, Competence, Relatedness, and Purpose

Young professionals born between the early 1980s and mid-1990s now constitute a majority of the project management workforce. Having grown up connected, collaborative, and mobile, they have specific motivations and needs, which are explored in this study.

Read Now
0 0 votes
Article Rating
Subscribe
Notify of
guest

This site uses Akismet to reduce spam. Learn how your comment data is processed.

0 Comments
Inline Feedbacks
View all comments