Levels of Evidence Adapted from OpenMD

Levels of evidence (or hierarchy of evidence) is a system used to rank medical studies based on the quality and reliability of their designs. The levels of evidence are commonly depicted in a pyramid model that illustrates both the quality and quantity of available evidence. The higher the position on the pyramid, the stronger the evidence. Each level builds on data and research previously developed in the lower tiers.

Levels of evidence pyramids are often divided into two or three sections. The top section consists of filtered (secondary) evidence, including systematic reviews, meta-analyses, and critical appraisals. The section below includes unfiltered (primary) evidence, including randomized controlled trials, cohort studies, case-controlled studies, case series, and case reports. Some models include an additional bottom segment for background information and expert opinion.

Definitions

Systematic Review and Meta-Analysis

A systematic review synthesizes the results from available studies of a particular health topic, answering a specific research question by collecting and evaluating all research evidence that fits the reviewer’s selection criteria. The most well-known collection of systematic reviews is the Cochrane Database of Systematic Reviews.

Systematic reviews can include meta-analyses in which statistical methods are applied to evaluate and synthesize quantitative results from multiple studies.

Randomized Controlled Trial (RCT)

A randomized controlled trial is a prospective study that measures the efficacy of an intervention or treatment. Subjects are randomly assigned to either an experimental group or a control group; the control group receives a placebo or sham intervention, while the experimental group receives the intervention being studied. Randomizing subjects is effective at removing bias, thus increasing the validity of the research. RCTs are frequently blinded so that neither the subjects (single blind), nor the clinicians (double blind), nor the researchers (triple blind) know in which group the subjects are placed.

Cohort Study

A cohort study is a type of observational study, meaning that no intervention is taken among the subjects. It is also a type of longitudinal study in which research subjects are followed over a period of time. A cohort study can be either prospective, which collects new data over time, or retrospective, which uses previously acquired data or medical records. This type of study examines a group of people who share a common trait or exposure and are assessed based on whether they develop an outcome of interest. An example of a prospective cohort study is a study that determines which subjects smoke and then many years later assesses the incidence of lung cancer in both smokers and non-smokers.

Case-Control Study

A case-control study is another type of observational study. It is also a type of retrospective study that looks back in time to assess information. A case-control study compares people who have the specified condition or outcome being studied (known as “cases”) with people who do not have the condition or outcome (known as “controls”). An example of a case-control study is a study that assesses the lifetime smoking exposure of patients with and without lung cancer.

Case Series and Reports

A case report is a detailed report of the presentation, diagnosis, treatment, treatment response, and follow-up after treatment of an individual patient. A case series is a group of case reports involving patients who share similar characteristics. A case series is observational and can be conducted either retrospectively or prospectively.

Cross-Sectional Study

Also called a prevalence study, a cross-sectional study examines subjects at a single point in time. By definition, a cross-sectional study is only observational. An example of a cross-sectional study is a survey of a population to determine the prevalence of lung cancer.

Filtered vs. Unfiltered Information

Filtered (secondary) levels of evidence include information that has been previously collected, analyzed, and aggregated by expert analysis and review. Filtered levels of evidence are placed above unfiltered levels of evidence on the pyramid. Examples of filtered levels of evidence are systematic reviews and meta-analyses.

Unfiltered (primary) evidence includes original research studies, including randomized controlled trials and case-control studies. They are often published in peer-reviewed journals. However, these studies have not been subjected to additional analysis and review beyond that of the peer reviewers for each study. In most cases, unfiltered levels of evidence are difficult to apply in clinical decision-making.

History

In 1972, Archibald Cochrane, a physician from Scotland, wrote Effectiveness and Efficiency, in which he argued that decisions about medical treatment should be based on a systematic review of the available clinical evidence. Cochrane proposed an international collaboration of researchers to systematically review the best clinical studies in each specialty.