Common errors in meta-analysis – lessons and learning from the Cochrane review-screening programme

Session: 

Workshop session 4: Thursday, 11:00-12:30

Workshop category: 

  • Methods for conducting syntheses (including different evidence, searching and information retrieval, statistics, assessing methodological quality)
Status

ID: 

WS31
Date and Location

Date: 

Thursday 14 September 2017 - 11:00 to 12:30

Location: 

Contact persons and facilitators

Contact person:

Facilitators: 

Liz Bickerdike
Miranda Cumpston
Nuala Livingstone
Newton Opiyo
Dario Sambunjak

Acknowledgements:

Target audience

Target audience: 

Review authors and editors

Level of difficulty: 

Basic
Type of workshop

Type of workshop : 

Training
Abstract

Abstract:

Objectives: The objectives of this workshop are to highlight common statistical errors made in Cochrane systematic reviews, and to provide practical, hands-on guidance to help authors and editors address these errors.

Description: The Cochrane Editorial Unit (CEU) quality assurance team has been screening new reviews against key MECIR standards since September 2013. During the course of this work, it has become notable that many of the same errors frequently occur in the Data and Analysis section of the review. This can have a serious impact, as even the smallest statistical error can change the interpretation of the results. Examples of these common errors include data extraction errors, Unit of Analyses errors, and inappropriate methods of performing Subgroup Analyses. In addition, Cochrane’s Learning and Support Department has worked in partnership with CEU to develop a suite of online learning resources to support editors in identifying and addressing common errors.
The purpose of this workshop is to improve review authors and editor’s awareness of these errors, thus helping them to identify, rectify, and ultimately avoid making these errors. The workshop will begin with a brief PowerPoint presentation, providing an overview of common errors and introducing the accompanying online materials. Following this, the attendees will work in small groups with the facilitators to identify errors in some real-life examples, and discuss the best way to rectify the issues.