What Is a Meta-Analysis (And How It Differs from a Literature Review)?
Here’s the short answer: a meta-analysis is a statistical technique that combines numerical results from multiple independent studies into a single pooled estimate. It’s the highest level of evidence in research methodology — sometimes called the “analysis of analyses.”
- A meta-analysis statistically combines results from multiple studies into one pooled estimate — it’s not the same as a systematic literature review, even though every meta-analysis begins with one.
- The PICO framework (Population, Intervention, Comparator, Outcome) is the essential tool for structuring your research question and defining inclusion/exclusion criteria.
- A meta-analysis requires 8 well-defined steps: define the question, search databases, screen studies, extract data, assess quality, analyze statistically, assess heterogeneity, and report using PRISMA 2020 guidelines.
- The most common student mistakes — confusing SD with SE, selecting models based on p-values, and duplicate study IDs — can be avoided with the right preparation.
- For undergraduate coursework, formal PROSPERO registration is usually not required. If you plan to publish, registration is strongly advised.
But here’s where most students get confused: a meta-analysis is not the same as a systematic literature review, even though they’re closely related.
| Aspect | Systematic Literature Review | Meta-Analysis |
|---|---|---|
| Purpose | Summarize and qualitatively synthesize existing research | Statistically combine numerical results from studies |
| Method | Structured, reproducible search and screening | Statistical synthesis of effect sizes |
| Output | Narrative summary of findings | Pooled effect size with confidence intervals |
| Data requirement | Can include qualitative and quantitative data | Requires quantitative data (means, SDs, effect sizes) |
| Can exist alone? | Yes | No — every meta-analysis requires a systematic review first |
Every meta-analysis is built on the foundation of a systematic review. If the studies in your review use different measurement scales, report incompatible outcomes, or vary too widely in methodology, you may only be able to produce a narrative synthesis — not a statistical meta-analysis.
When to Use a Meta-Analysis (And When Not to)
Not every research project benefits from a meta-analysis. You should only conduct one when these conditions are met:
- At least 3–5 independent studies have examined the same research question with comparable outcome measures
- The primary studies report quantitative data (means, standard deviations, proportions, correlations, effect sizes)
- You can reasonably justify pooling the data — meaning the studies are sufficiently similar in population, intervention/exposure, and outcome measures
- Your goal is to increase statistical power and produce a more precise estimate than any single study could provide
A meta-analysis answers the question: “Across all the studies that have looked at this, what is the overall effect?” It’s not a replacement for individual studies — it’s a synthesis that helps researchers understand what the entire body of evidence tells us.
Step 1 — Structuring Your Research Question with the PICO Framework
The first and most important step in conducting a meta-analysis is defining a focused research question. Most researchers use the PICO framework to structure it:
- P — Population: Who are the subjects? (e.g., adults with hypertension)
- I — Intervention or Exposure: What treatment or factor is being studied? (e.g., a new medication)
- C — Comparator or Control: What is the comparison group? (e.g., placebo or existing drug)
- O — Outcome: What is being measured? (e.g., blood pressure reduction)
The PICO Template (Fill-In Format)
| PICO Element | What It Means | Your Example |
|---|---|---|
| P (Population) | Specific group, condition, or setting | Adults > 18 years with Type 2 diabetes |
| I (Intervention) | Treatment, exposure, or action being tested | Structured home-based exercise programs |
| C (Comparator) | Alternative, placebo, or standard care | Standard routine care without formal exercise |
| O (Outcome) | Specific measurable result | Improvement in glycemic control (HbA1c levels) |
Your PICO question should read like this:
“In adults with Type 2 diabetes (P), does structured home-based exercise (I) compared to standard care (C) lead to greater improvement in HbA1c levels (O) over 12 months?”
Beyond PICO: The PICOTS Extension
Once you’ve structured your PICO question, consider expanding it to PICOTS — which adds Time, Type of Study, and Setting. This is particularly useful when your methodology section requires more detail:
- T — Time-frame: Outcomes are only relevant when assessed at a specific period
- T — Type of Study: RCT, cohort, case-control, etc. (risk of bias increases in that order)
- S — Setting: Primary, specialty, inpatient, outpatient, or community
Pro tip from Martinez et al. (2025): If you specify “only randomized controlled trials” in your inclusion criteria, don’t redundantly list “non-RCTs” as an exclusion. Keep your criteria tight and non-redundant.
Step 2 — Developing and Registering Your Protocol
Before you search a single database, you need a formal research protocol. This document locks in your PICO elements, inclusion/exclusion criteria, search strategy, and planned analysis — before you ever look at search results.
Should You Register on PROSPERO?
Undergraduate coursework only: If your review is a class assignment or undergraduate dissertation that you do not plan to publish, formal PROSPERO registration is usually not required. Many university supervisors don’t expect it for coursework projects.
Publication goal: If you intend to publish your findings in a peer-reviewed journal, registration is strongly advised (and often mandatory). The Cochrane Handbook recommends protocol registration for all systematic reviews.
Important eligibility rule: PROSPERO only accepts reviews that feature a health-related outcome. Scoping reviews or narrative literature reviews are not eligible and should be registered on the Open Science Framework (OSF) instead.
What Goes Into a Protocol
- Your PICO question — clearly stated with all four components
- Planned search databases — list which databases you’ll search
- Study design — include/exclusion criteria tied to PICO
- Statistical analysis plan — planned effect size metrics, statistical model
- Timeline — estimated dates for screening, extraction, and analysis
Getting an ORCID ID is essential — you’ll need it to log into PROSPERO and link your submission.
Step 3 — Conducting the Literature Search
A comprehensive search is the backbone of any systematic review and meta-analysis. You need to search multiple databases rather than relying on a single source.
Recommended Databases
- PubMed/MEDLINE — the largest biomedical database
- Embase — strong for European and pharmacological literature
- Web of Science — multidisciplinary citation database
- Cochrane Central Register — trials registered with Cochrane
- PsycINFO — psychology and social sciences
- Google Scholar — useful for catching grey literature and citation chains
Building Your Search Strategy
When building your search string, extract key nouns and synonyms from your PICO elements. Use Boolean operators strategically:
- OR groups similar terms (e.g., “hypertension OR high blood pressure”)
- AND combines different concepts (e.g., “hypertension AND lifestyle intervention”)
Identify synonyms, alternate spellings, acronyms, and related terms for each PICO element. Database-specific subject headings (like MeSH in MEDLINE or Emtree in Embase) are controlled vocabulary terms that ensure you capture every relevant article, even if the authors used different wording in their titles or abstracts.
Many researchers collaborate with a professional librarian to design and execute their search — this is strongly encouraged for meta-analyses, as an incomplete search is one of the most common sources of bias.
Step 4 — Study Selection and Screening
Once your searches are complete, you’ll need to screen all the results. This is typically done in duplicate by two independent reviewers to minimize bias:
- Remove duplicates from imported reference management software
- Screen titles and abstracts against your inclusion/exclusion criteria
- Conduct full-text screening of potentially relevant studies
- Document reasons for excluding each article
Many students use tools like Covidence, Rayyan, or EndNote to manage this process. The screening phase produces a PRISMA 2020 flow diagram that visually documents how many studies were identified at each stage — from initial search results to the final pool included in your meta-analysis. This diagram is a mandatory component of any published meta-analysis.
Step 5 — Data Extraction
Data extraction is the process of pulling quantitative information from each included study into a standardized format. This should also be done in duplicate.
For each study, extract:
- Author names, publication year, country
- Study design (RCT, cohort, etc.)
- Sample size and participant demographics
- Intervention details (dosage, duration, frequency)
- Outcome measures — this is the critical data for your meta-analysis
- Means, standard deviations, and sample sizes for each group
- Correlation coefficients
- Effect sizes (if reported)
- Confidence intervals and p-values
Critical note from Martinez et al. (2025): Never extract individual study conclusions. Instead, draw your own conclusions based on your own analysis of the raw data. This prevents you from inheriting the biases of the original authors.
Step 6 — Statistical Analysis (The Heart of Meta-Analysis)
This is where meta-analysis diverges from narrative synthesis. You’ll calculate effect sizes and pool them using one of two main statistical models:
Fixed-Effect Model
- Assumes all studies share a single true effect size
- Any observed variation between studies is due solely to sampling error
- Used when studies are highly homogeneous and your PICO question is narrow
Random-Effects Model
- Assumes true effects vary between studies
- Accounts for both within-study and between-study variance
- This is the preferred model for most student research because it’s more conservative and realistic
Which Model Should You Choose?
Do not select a model based on the p-value of a heterogeneity test. Choosing a fixed-effect or random-effects model based on statistical tests is fundamentally flawed. Model selection should be based on your theoretical assumptions about the data:
- Use fixed-effects when studies are sufficiently similar (same population, intervention, outcome) and your goal is to estimate an effect in a specific context.
- Use random-effects when your PICO question is broad enough that you expect real variation between studies, and your aim is to generalize findings beyond the included studies.
Common Effect Size Metrics
| Metric | When to Use | Example |
|---|---|---|
| Standardized Mean Difference (SMD / Cohen’s d) | Studies measure the same outcome using different scales | Depression scores measured by different depression scales |
| Mean Difference (MD) | All studies use the same scale | All studies report blood pressure in mmHg |
| Odds Ratio (OR) | Dichotomous outcomes (proportion of responders) | Proportion of patients achieving remission |
| Risk Ratio (RR) | Dichotomous outcomes | Risk of adverse event in treatment vs control |
Software Tools
- Review Manager (RevMan) — Cochrane-endorsed, free, user-friendly
- R (metafor package) — most flexible, used by professional meta-analysts
- Comprehensive Meta-Analysis (CMA) — commercial but user-friendly
- MIX 2.0 — open-source option
Step 7 — Assessing Heterogeneity
Heterogeneity refers to the variability in effect sizes across your included studies. If your studies produce wildly different results, pooling them may not be meaningful.
You assess heterogeneity through:
- Visual inspection of the forest plot — checking whether point estimates show similar direction and magnitude
- The I² statistic — which quantifies the proportion of variability due to real differences rather than chance:
- 0% to 40%: minimal heterogeneity
- 30% to 60%: moderate heterogeneity
- 50% to 90%: substantial heterogeneity
- 75% to 100%: considerable heterogeneity
When heterogeneity is high, you can explore potential sources using subgroup analyses — comparing subgroups of studies (e.g., by age group, intervention type, or study quality). However, be cautious with subgroup analyses. As Martinez et al. warn, these exploratory tests are highly susceptible to Type 1 errors (false positives), and you should only draw firm conclusions from effects that you planned a priori.
How to Read a Forest Plot (5-Step Process)
A forest plot is the iconic visual of meta-analysis. Here’s how to interpret yours:
- Identify the effect measure — check whether the axis uses mean difference, odds ratio, or risk ratio. The line of no effect is at zero (for mean differences) or one (for ratios).
- Read individual study results — each row is one study. The square marks the effect size. The horizontal line is the confidence interval. Larger squares = more weight.
- Interpret the pooled summary (the diamond) — at the bottom, the diamond’s center shows the combined effect. If it doesn’t cross the line of no effect, the result is significant (p < 0.05).
- Check for heterogeneity — look for the I² value. High I² means studies vary beyond random chance.
- Assess significance — if the diamond’s tips don’t cross the vertical line of no effect, the overall meta-analysis result is statistically significant.
Step 8 — Writing and Reporting
Your meta-analysis manuscript should follow the PRISMA 2020 guidelines — a 27-item checklist that ensures transparent and rigorous reporting. The PRISMA 2020 statement (Page et al., 2021, BMJ) is the current standard.
Manuscript Structure
Title — Clearly state that it is a systematic review and meta-analysis.
Abstract — Follow PRISMA guidelines, including structured sections.
Introduction — Review relevant literature, identify the evidence gap, and state your objectives.
Methods — Detail your search strategy, eligibility criteria, screening process, data extraction, quality assessment tools, statistical models, and heterogeneity assessment.
Results — Present:
- PRISMA flow diagram
- Characteristics table (studies and participants)
- Quality assessment results
- Forest plot(s)
- Pooled effect size with confidence intervals
- Heterogeneity statistics
- Publication bias assessment (funnel plot)
Discussion — Summarize key findings, contextualize them within broader literature, discuss the GRADE certainty of the evidence, and address limitations.
Conclusion — Keep it brief. State the main takeaway and recommend future research.
Common Meta-Analysis Mistakes Students Make
Research across dozens of meta-analyses has identified consistent patterns of errors. Avoid these:
1. Confusing Standard Deviation (SD) with Standard Error (SE)
This is the most common data entry error. Using SE instead of SD artificially deflates the variance and massively overestimates effect sizes. If a study reports SE, convert it: SD = SE × √n.
2. Selecting Statistical Model Based on Heterogeneity Tests
Choosing a fixed-effect or random-effects model based on the p-value of a heterogeneity test (like the Q-test) is fundamentally flawed. Model selection should be based on your theoretical assumptions about the data, not on statistical tests. Use random-effects when your PICO question is broad enough that you expect real variation between studies.
3. Treating Multiple Effect Sizes from One Study as Independent Data Points
If a single study reports multiple outcomes or has multiple treatment arms, treating each as an independent data point inflates your sample size and statistical power. Use methods like robust variance estimation or select a single effect size per study.
4. Not Registering a Protocol
Failing to register your research protocol in PROSPERO or an equivalent registry before starting leads to ad-hoc decisions and publication bias. Registration prevents multiple research groups from independently working on the same question and increases transparency.
5. Ignoring Publication Bias
Smaller studies with statistically significant results are more likely to be published than null results. If your funnel plot shows asymmetry, your pooled estimate may be inflated. Consider using the Trim and Fill method to adjust for publication bias.
Visual Tools Every Meta-Analysis Should Include
A meta-analysis produces several powerful visuals that students often overlook as optional extras:
- Forest plots — show each study’s effect size, its confidence interval, and the pooled estimate at the bottom. Including an annotated forest plot example will help readers understand how to interpret their own results.
- The PRISMA 2020 flow diagram — a structured visual of the study selection process. A sample diagram shows students how to document their screening decisions.
- The funnel plot — visualizes publication bias. Including a labeled example helps students understand what symmetry versus asymmetry looks like.
These visuals are not optional extras — they’re the core of meta-analysis interpretation. Without them, your results section is incomplete.
FAQ
Is a meta-analysis the same as a systematic review?
No. A systematic review is the structured search and screening process. A meta-analysis is a statistical technique applied within a systematic review to combine numerical results. Every meta-analysis requires a systematic review, but not every systematic review includes a meta-analysis.
How many studies do I need for a meta-analysis?
Most experts recommend at least 3–5 studies that report comparable quantitative data. The more studies you include, the greater your statistical power and the more reliable your pooled estimate.
What is the most common mistake students make in meta-analysis?
The most common error is confusing standard deviation (SD) with standard error (SE). Using SE in place of SD artificially deflates variance and dramatically overestimates effect sizes. Always check the formula: SD = SE × √n.
Can I do a meta-analysis without being a statistician?
You don’t need to be a statistician, but you do need to understand basic statistical concepts and use appropriate software. Tools like RevMan and CMA are designed for non-statisticians. Many students benefit from collaborating with a statistics expert or using guided tutorials.
What is the GRADE system?
GRADE stands for Grading of Recommendations Assessment, Development and Evaluation. It’s a framework for assessing the certainty of evidence in systematic reviews and meta-analyses. It rates evidence as high, moderate, low, or very low certainty based on risk of bias, inconsistency, indirectness, imprecision, and publication bias.
Your Next Steps
A meta-analysis is one of the most powerful research tools you’ll use as a student. It requires patience, rigor, and statistical skill — but the payoff is a contribution to the collective body of knowledge that can shape clinical practice and future research.
If you’re feeling overwhelmed by the process, remember that you don’t have to do it alone. Our team of qualified writers and researchers can help guide you through every step — from research question formulation to statistical analysis to manuscript preparation.
Explore our research writing services to see how we can support your meta-analysis project.
References
- Page MJ, McKenzie JE, Bossuyt PM, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71. doi:10.1136/bmj.n71.
- Calderon Martinez E, Ghattas Hasbun PE, et al. A comprehensive guide to conduct a systematic review and meta-analysis in medical research. Medicine. 2025;104(33):e41868. doi:10.1097/MD.0000000000041868.
- Dagher D, Khan M. Writing a Systematic Review and Meta-analysis: A Step-by-Step Guide. Sports Health. 2025.
- Martinez E, et al. Meta-analysis: pitfalls and hints. Heart, Lung and Vessels. 2013;5(4):219-225.
- McGagh FC. Understanding the basics of meta-analysis and how to read a forest plot. J Clin Psychiatry. 2020.
- Stere JAC, Harbord RM. Funnel plots in meta-analysis. Stata J. 2004;4:127-41.