What Is a Meta-Analysis (And How It Differs from a Literature Review)?
A meta-analysis is a statistical method that mathematically combines the numerical results from two or more independent studies to produce a single, pooled estimate of an effect. Think of it as the “analysis of analyses” — taking the findings of individual studies and using statistics to draw an overall conclusion that none of the individual studies could provide alone.
The term was coined by psychologist Gene Glass in 1976 to describe a rigorous alternative to the casual, narrative discussions of research studies that were common at the time. Since then, meta-analyses have become the gold standard of evidence in many fields.
But here’s where most students get confused: a meta-analysis is not the same as a systematic literature review, even though they’re closely related.
| Aspect | Systematic Literature Review | Meta-Analysis |
|---|---|---|
| Purpose | Summarize and qualitatively synthesize existing research | Statistically combine numerical results from studies |
| Method | Structured, reproducible search and screening | Statistical synthesis of effect sizes |
| Output | Narrative summary of findings | Pooled effect size with confidence intervals |
| Data requirement | Can include qualitative and quantitative data | Requires quantitative data (means, SDs, effect sizes) |
| Can exist alone? | Yes | No — every meta-analysis requires a systematic review first |
Every meta-analysis is built on the foundation of a systematic review, but not every systematic review includes a meta-analysis. If the studies in your review use different measurement scales, report incompatible outcomes, or vary too widely in methodology, you may only be able to produce a narrative synthesis — not a statistical meta-analysis.
- A meta-analysis is a statistical technique that combines numerical results from multiple independent studies into one pooled estimate. It’s the highest level of evidence in research methodology.
- Every meta-analysis begins with a systematic review — a structured search and screening process. But not all systematic reviews include a meta-analysis.
- Meta-analyses require at least 8 well-defined steps: define your research question, conduct a comprehensive literature search, screen studies, extract data, assess quality, analyze statistically, assess heterogeneity, and report using PRISMA 2020 guidelines.
- The most common student mistakes include confusing standard deviation with standard error, selecting the wrong statistical model, and failing to register a research protocol before starting.
The research gap your meta-analysis fills: Our site already has an article on “How to Write a Literature Review” (How to Write a Literature Review). That article covers the broader literature review process. Your meta-analysis article adds the distinct statistical methodology — effect sizes, heterogeneity, forest plots, and PRISMA reporting — that sits above the literature review in the evidence hierarchy.
When to Use a Meta-Analysis
Not every research project benefits from a meta-analysis. You should only conduct one when the following conditions are met:
- At least 3-5 independent studies have examined the same research question with comparable outcome measures
- The primary studies report quantitative data (means, standard deviations, proportions, correlations, effect sizes)
- You can reasonably justify pooling the data — meaning the studies are sufficiently similar in population, intervention/exposure, and outcome measures
- Your goal is to increase statistical power and produce a more precise estimate than any single study could provide
A meta-analysis answers the question: “Across all the studies that have looked at this, what is the overall effect?” It’s not a replacement for individual studies — it’s a synthesis that helps researchers understand what the entire body of evidence tells us.
Step 1 — Defining the Research Question
The first step in conducting a meta-analysis, as with any empirical study, is defining a focused research question. Most researchers use the PICO framework to structure their question:
- P — Population: Who are the subjects? (e.g., adults with hypertension)
- I — Intervention or Exposure: What treatment or factor is being studied? (e.g., a new medication)
- C — Comparator or Control: What is the comparison group? (e.g., placebo or existing drug)
- O — Outcome: What is being measured? (e.g., blood pressure reduction)
Your research question should be quantitatively focused and deal with impacts or relationships. For example:
“In adults with Type 2 diabetes, does intensive lifestyle intervention compared to standard care lead to greater improvement in HbA1c levels over 12 months?”
Once you have your PICO question, you need to establish inclusion and exclusion criteria that define which studies will be eligible for your analysis. These criteria should be specific enough to guide your search but broad enough to capture sufficient studies.
What to exclude: Review articles, conference abstracts, case reports, studies in languages you cannot translate, and study designs irrelevant to your question.
Pro tip from Greco et al. (2013): Your exclusion criteria should not simply be the opposite of your inclusion criteria. If you specify “only randomized controlled trials” in your inclusion criteria, don’t redundantly list “non-RCTs” as an exclusion.
Step 2 — Conducting the Literature Search
A comprehensive search is the backbone of any systematic review and meta-analysis. You need to search multiple databases rather than relying on a single source. Here are the most commonly used databases:
- PubMed/MEDLINE — the largest biomedical database
- Embase — strong for European and pharmacological literature
- Web of Science — multidisciplinary citation database
- Cochrane Central Register — trials registered with Cochrane
- PsycINFO — psychology and social sciences
When building your search strategy, use Boolean operators strategically:
- OR groups similar terms (e.g., “hypertension OR high blood pressure”)
- AND combines different concepts (e.g., “hypertension AND lifestyle intervention”)
You should identify synonyms, alternate spellings, acronyms, and related terms for each PICO element. Database-specific subject headings (like MeSH in MEDLINE or Emtree in Embase) are controlled vocabulary terms that ensure you capture every relevant article, even if the authors used different wording in their titles or abstracts.
Many researchers collaborate with a professional librarian to design and execute their search — this is strongly encouraged for meta-analyses, as an incomplete search is one of the most common sources of bias.
Step 3 — Study Selection and Screening
Once your searches are complete, you’ll need to screen all the results. This is typically done in duplicate by two independent reviewers to minimize bias:
- Remove duplicates from imported reference management software
- Screen titles and abstracts against your inclusion/exclusion criteria
- Conduct full-text screening of potentially relevant studies
- Document reasons for excluding each article
Many students use tools like Covidence, Rayyan, or EndNote to manage this process. The screening phase produces a PRISMA 2020 flow diagram that visually documents how many studies were identified at each stage — from initial search results to the final pool included in your meta-analysis. This diagram is a mandatory component of any published meta-analysis.
Step 4 — Data Extraction
Data extraction is the process of pulling quantitative information from each included study into a standardized format. This should also be done in duplicate.
For each study, extract:
- Author names, publication year, country
- Study design (RCT, cohort, etc.)
- Sample size and participant demographics
- Intervention details (dosage, duration, frequency)
- Outcome measures — this is the critical data for your meta-analysis
- Means, standard deviations, and sample sizes for each group
- Correlation coefficients
- Effect sizes (if reported)
- Confidence intervals and p-values
Critical note from Greco et al. (2013): Never extract individual study conclusions. Instead, draw your own conclusions based on your own analysis of the raw data. This prevents you from inheriting the biases of the original authors.
When extracting outcome data, record the specific details about each measure — the name, the direction of the scale (which direction represents a favorable outcome), the version used, and the total possible score. If outcomes are measured at multiple time points, decide in advance whether to extract all time points or focus on one specific time point.
Step 5 — Assessing Study Quality
The quality of your meta-analysis depends entirely on the quality of the studies it includes. You must evaluate each study’s methodological rigor using recognized quality assessment tools:
- Cochrane Risk of Bias (RoB 2) tool — gold standard for randomized controlled trials
- ROBINS-I — for non-randomized studies of interventions
- MINORS — for non-randomized studies more generally
- QUADAS-2 — for diagnostic accuracy studies
These tools evaluate specific risk areas — selection bias, performance bias, detection bias, attrition bias, and reporting bias. The quality assessment should be conducted by two independent reviewers to ensure consistency.
Your quality assessment isn’t just a formality — it directly affects how you interpret your results. If most included studies have a high risk of bias, your conclusions must reflect that limitation clearly.
Step 6 — Statistical Analysis (The Heart of Meta-Analysis)
This is where meta-analysis diverges from narrative synthesis. You’ll calculate effect sizes and pool them using one of two main statistical models:
Fixed-Effect Model
- Assumes all studies share a single true effect size
- Any observed variation between studies is due solely to sampling error
- Used when studies are highly homogeneous and your PICO question is narrow
Random-Effects Model
- Assumes true effect sizes vary between studies
- Accounts for both within-study and between-study variance
- This is the preferred model for most student research because it’s more conservative and realistic
Calculating Effect Sizes
Common effect size metrics:
- Standardized Mean Difference (SMD / Cohen’s d): Used when studies measure the same outcome using different scales
- Mean Difference (MD): Used when all studies use the same scale
- Odds Ratio (OR): Used for dichotomous outcomes (e.g., proportion of responders)
- Risk Ratio (RR): Used for dichotomous outcomes
Software Tools
- Review Manager (RevMan) — Cochrane-endorsed, free
- R (metafor package) — most flexible, used by professional meta-analysts
- Comprehensive Meta-Analysis (CMA) — commercial but user-friendly
- MIX 2.0 — open-source option
Step 7 — Assessing Heterogeneity
Heterogeneity refers to the variability in effect sizes across your included studies. If your studies produce wildly different results, pooling them may not be meaningful.
You assess heterogeneity through:
- Visual inspection of the forest plot — checking whether point estimates show similar direction and magnitude
- The I² statistic — which quantifies the proportion of variability due to real differences rather than chance:
- 0% to 40%: minimal heterogeneity
- 30% to 60%: moderate heterogeneity
- 50% to 90%: substantial heterogeneity
- 75% to 100%: considerable heterogeneity
When heterogeneity is high, you can explore potential sources using subgroup analyses — comparing subgroups of studies (e.g., by age group, intervention type, or study quality). However, be cautious with subgroup analyses. As Greco et al. warn, these exploratory tests are highly susceptible to Type 1 errors (false positives), and you should only draw firm conclusions from effects that you planned a priori.
Step 8 — Writing and Reporting
Your meta-analysis manuscript should follow the PRISMA 2020 guidelines — a 27-item checklist that ensures transparent and rigorous reporting. The PRISMA 2020 statement (Page et al., 2021, BMJ) is the current standard and has been cited extensively in the literature.
Manuscript Structure
Title — Clearly state that it is a systematic review and meta-analysis.
Abstract — Follow PRISMA guidelines, including structured sections.
Introduction — Review relevant literature, identify the evidence gap, and state your objectives.
Methods — Detail your search strategy, eligibility criteria, screening process, data extraction, quality assessment tools, statistical models, and heterogeneity assessment.
Results — Present:
- PRISMA flow diagram
- Characteristics table (studies and participants)
- Quality assessment results
- Forest plot(s)
- Pooled effect size with confidence intervals
- Heterogeneity statistics
- Publication bias assessment (funnel plot)
Discussion — Summarize key findings, contextualize them within broader literature, discuss the GRADE certainty of the evidence, and address limitations.
Conclusion — Keep it brief. State the main takeaway and recommend future research.
Pro tip from the GRADE framework: A “high certainty” rating doesn’t mean your intervention works well — it means you’re very confident in the effect estimate you report. It may still be a small or even harmful effect.
Common Meta-Analysis Mistakes Students Make
Research across dozens of meta-analyses has identified consistent patterns of errors. Avoid these:
1. Confusing Standard Deviation (SD) with Standard Error (SE)
This is the most common data entry error. Using SE instead of SD artificially deflates the variance and massively overestimates effect sizes. If a study reports SE, convert it: SD = SE × √n.
2. Selecting Statistical Model Based on Heterogeneity Tests
Choosing a fixed-effect or random-effects model based on the p-value of a heterogeneity test (like the Q-test) is fundamentally flawed. Model selection should be based on your theoretical assumptions about the data, not on statistical tests. Use random-effects when your PICO question is broad enough that you expect real variation between studies.
3. Treating Multiple Effect Sizes from One Study as Independent Data Points
If a single study reports multiple outcomes or has multiple treatment arms, treating each as an independent data point inflates your sample size and statistical power. Use methods like robust variance estimation or select a single effect size per study.
4. Misinterpreting the I² Statistic
Many students assume I² measures the absolute amount of variance. It actually measures the proportion of observed variance that reflects true differences between studies, not sampling error. Prioritize calculating prediction intervals to understand how widely effects vary.
5. Not Registering a Protocol
Failing to register your research protocol in PROSPERO (International Prospective Register of Systematic Reviews) or an equivalent registry before starting leads to ad-hoc decisions and publication bias. Registration prevents multiple research groups from independently working on the same question and increases transparency.
6. Ignoring Publication Bias
Smaller studies with statistically significant results are more likely to be published than null results. If your funnel plot shows asymmetry, your pooled estimate may be inflated. Consider using the Trim and Fill method to adjust for publication bias.
Visual Opportunities
A meta-analysis produces several powerful visuals that students often overlook as optional extras:
- Forest plots are the iconic visual of meta-analysis — they show each study’s effect size, its confidence interval, and the pooled estimate at the bottom. Including an annotated forest plot example will help readers understand how to interpret their own results.
- The PRISMA 2020 flow diagram is a structured visual of the study selection process. A sample diagram shows students how to document their screening decisions.
- The funnel plot visualizes publication bias. Including a labeled example helps students understand what symmetry versus asymmetry looks like.
These visuals should be borrowed from authoritative sources (Cochrane, PRISMA 2020 guidelines, or peer-reviewed meta-analyses) and cited with source URLs and author attribution.
Related Guides
- How to Write a Literature Review: Step-by-Step Guide for Students
- Best Research Paper Topics
- How to Write a Research Paper Step by Step
- How to Write Methodology Section Research Paper
- Data Analysis Dissertations Guide
Your Next Steps
A meta-analysis is one of the most powerful research tools you’ll use as a student. It requires patience, rigor, and statistical skill — but the payoff is a contribution to the collective body of knowledge that can shape clinical practice and future research.
If you’re feeling overwhelmed by the process, remember that you don’t have to do it alone. Our team of qualified writers and researchers can help guide you through every step — from research question formulation to statistical analysis to manuscript preparation.
Explore our research writing services to see how we can support your meta-analysis project.
References
- Page MJ, McKenzie JE, Bossuyt PM, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71. doi:10.1136/bmj.n71.
- Greco T, Zangrillo A, Biondi-Zoccai G, Landoni G. Meta-analysis: pitfalls and hints. Heart, Lung and Vessels. 2013;5(4):219-225.
- Dagher D, Khan M. Writing a Systematic Review and Meta-analysis: A Step-by-Step Guide. Sports Health. 2025.
- Hansen C, Steinmetz H, Block J. How to conduct a meta-analysis in eight steps: a practical guide. Management Review Quarterly. 2022;68:1-22.
- Glass GV. Primary, secondary and meta-analysis of research. Educ Res. 1976;5:3-8.
- Rosenthal R. The file drawer problem and tolerance for null results. Psychol Bull. 1979;86(3):638-660.
- Egger M, Smith GD, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997;315(7109):629-634.
FAQ
Is a meta-analysis the same as a systematic review?
No. A systematic review is the structured search and screening process. A meta-analysis is a statistical technique applied within a systematic review to combine numerical results. Every meta-analysis requires a systematic review, but not every systematic review includes a meta-analysis.
How many studies do I need for a meta-analysis?
Most experts recommend at least 3-5 studies that report comparable quantitative data. The more studies you include, the greater your statistical power and the more reliable your pooled estimate.
What is the most common mistake students make in meta-analysis?
The most common error is confusing standard deviation (SD) with standard error (SE). Using SE in place of SD artificially deflates variance and dramatically overestimates effect sizes. Always check the formula: SD = SE × √n.
Can I do a meta-analysis without being a statistician?
You don’t need to be a statistician, but you do need to understand basic statistical concepts and use appropriate software. Tools like RevMan and CMA are designed for non-statisticians. Many students benefit from collaborating with a statistics expert or using guided tutorials.
What is the GRADE system?
GRADE stands for Grading of Recommendations Assessment, Development and Evaluation. It’s a framework for assessing the certainty of evidence in systematic reviews and meta-analyses. It rates evidence as high, moderate, low, or very low certainty based on risk of bias, inconsistency, indirectness, imprecision, and publication bias.