Is Evidence-Based Management Actually Based on Evidence?

Topic:  Evidence Based Management

Publication: Academy of Management Perspectives

Article: What’s the
evidence on evidence-based management? (NOV 2009)

Author: T. Reay, W. Berta, and M. K. Kohn

Reviewed by: Sarah Teague

 


Rapid In the last century, many significant advances have
been made in the study and application of Industrial/Organizational (I/O)
Psychology and Organizational Behavior (OB). Unfortunately, there remains a
substantial communication gap between researchers and practitioners. But research
and practice do not have to be mutually exclusive – as evidenced by this very
website!

One
approach that has been put forth in attempts to promote such collaboration is
that of Evidence-Based Management (EBMgt). This approach emphasizes the
importance of utilizing various sources of solid evidence in the process of
organizational decision-making (e.g., back decisions and actions with solid
evidence, rather than lore, biases, false assumptions, or a “that’s the way
we’ve always done things around here” mentality). While this is still a
relatively new concept, many in the community have begun to take note.

In
a recent literature review, Reay, Berta, and Kohn (2009) sought to assess the
quantity and quality of the existing evidence supporting evidence-based
management. This evidence was divided into six different levels according to
empirical quality ranging from an author’s opinion (Level 6 – weakest) to
large-scale studies involving a high degree of empirical rigor (Level 1 –
strongest). The majority of the literature fell into a very weak Level 5
categorization, and no studies were given the strongest rating of Level 1.
Further, none of the studies in their review addressed the question of whether
or not evidence-based management will actually improve organizational
performance. More research is needed in order to discuss the validity of such
practices.

The
results of the current review indicate that while the empirical quality of the
existing literature is certainly lacking, individual study findings suggest
promise for the EBMgt approach.. The authors convey optimism for the futureof EBMgt
research but echo the calls from other researchers (including Rousseau and
colleagues) for greater emphasis on knowledge transfer (KT; disseminating the
information gleaned from research to facilitate implementation in the workplace).
Accordingly, the authors of the current review provide suggestions to promote KT,
including placing more value on literature reviews and replication studies in
the research domain, teaching management students to value – but also critically
evaluate – evidence, and encouraging researchers to think practically about
their findings and practitioners to consider how their needs and experiences
might further research, all helping to bridge the science-practice gap.

We could think of evidence-based management
as a medication that has shown great potential in initial testing but needs
further trials to validate long-term use.  

 

Reay,
T., Berta, W., & Kohn, M. K. (2009). What’s the evidence on evidence-based
management? Academy of Management Perspectives, ?, 5-18.

Evidence-Based Management: One Small Step for You, One Giant Leap for the Profession

Topic: Strategic HR
Publication: Academy of Management Journal
Article: A Sticky, Leveraging, and Scalable Strategy for High-quality Connections between Organizational Practice and Science
Author: D. M. Rousseau
Reviewed By: Sarah Teague

Have you ever participated in an EBM Collaboration? I’ll give you a hint… you’re participating right now! The term Evidence-Based Management (EBM) Collaboration refers to an effort to better inform practice with empirical findings and also to make stronger connections within our field; essentially bridging the gap between science and practice. A call from Rousseau (2007) lays out a framework for the potential tasks associated with such an effort and proposes specific benefits that our field might reap.

Suggested EBM Tasks:

1.    Review current research and present plain-language summaries in an easily  accessible online format.

2.    Analyze reviews within a given topic area to provide insight on practical inquiries (e.g., “What are the effects of bonus pay? Leadership training? Mergers? Downsizing?”).

3.    Include case studies about practitioner’s struggles/success in implementing the scientific findings to aid others experiencing resistance.

4.    Provide interactive features to foster procedural knowledge (knowledge of how to do something) (e.g., describing conditions under which findings might/might not be apply to a given situation).

Proposed Outcomes:
The author proposed that this type of collaboration will result in an impartial “seal of approval” for current research findings, bolstered by professional partnerships with organizations such as SIOP or AOM. Subsequently, this will render solid research findings and implications more relevant and accessible to practitioners, potentially inhibiting the buying and selling of unsubstantiated claims and speculative interventions.

On a side note, The IOATWORK website is a response to the repeated calls for a stronger alliance between scientists and practitioners. By reading this review, you have taken a small (but SUBSTANTIAL) step towards making our field more integrative and functional. So thank you and tell all your friends!

Rousseau, D. M. (2007). A sticky, leveraging, and scalable strategy for high-quality
connections between organizational practice and science. Academy of Management
Journal, 50(5), 1037-1042.