MED-10 · MODULE 7 · LESSON 7.1

Evidence, Guidelines, and Critical Appraisal

Estimated study time: 3–4 hours · Level: University (Harvard/Oxford/Yale standard) · Prerequisite: Modules 1–6 of Public Health and Epidemiology

Intended Learning Outcomes

  1. Explain the core principles that define evidence, guidelines, and critical appraisal and how they fit within Public Health and Epidemiology.
  2. Analyze the mechanisms, structures, or processes central to evidence, guidelines, and critical appraisal using evidence-based reasoning.
  3. Apply diagnostic and interpretive frameworks to representative cases in evidence, guidelines, and critical appraisal.
  4. Evaluate competing explanations, data, or methods relevant to evidence, guidelines, and critical appraisal.
  5. Synthesize knowledge across modules to form an integrated clinical and scientific understanding.

1. Orientation: Reading the Evidence Base

This module trains you to read primary literature and clinical guidelines critically, weighing the quality of evidence and distinguishing established findings from provisional or contested claims within Public Health and Epidemiology.

The skill is transferable: once you can appraise a study, you can update your practice rationally as new evidence appears rather than deferring passively to authority or habit.

2. Study Designs and the Hierarchy of Evidence

We review the principal designs — systematic reviews and meta-analyses, randomised controlled trials, cohort and case-control studies, and case series — and what each can and cannot establish about cause and effect.

The hierarchy is a starting heuristic, not a rule: a well-conducted cohort study can outweigh a small, biased trial. Design quality and applicability matter as much as design type.

3. Bias, Confounding, and Critical Appraisal

Every study is a claim under conditions of uncertainty. We examine selection bias, measurement bias, confounding, and the role of chance, together with the appraisal checklists (e.g., GRADE, risk-of-bias tools) used to judge them.

Interpretation centres on effect size, confidence intervals, and clinical significance rather than p-values alone, and on whether the study population resembles the patient in front of you.

4. From Guidelines to the Bedside

Guidelines synthesise evidence into recommendations, but they carry assumptions and grades of certainty. We consider how to read a recommendation, locate its evidence, and recognise where genuine equipoise or controversy remains.

The goal is disciplined autonomy: using guidelines as informed defaults while retaining the judgement to depart from them when a specific case warrants.

Key Terminology

TermMeaning in context
Systematic reviewA structured synthesis of all eligible studies on a question, minimising selective citation.
Randomised controlled trialA design that allocates participants by chance to reduce confounding.
ConfoundingDistortion of an association by a third factor related to both exposure and outcome.
Confidence intervalA range of values compatible with the data at a stated level of certainty.
GRADEA system for rating the certainty of evidence and strength of recommendations.
Number needed to treatHow many patients must be treated for one to benefit; a measure of effect size.
Interactive Concept Map
What is the central question of Evidence, Guidelines, and Critical Appraisal?
It asks how the phenomena grouped under evidence, guidelines, and critical appraisal arise, how they can be measured, and how that knowledge changes what we do for patients or in the laboratory.
Which foundational concepts feed into it?
Core biology, chemistry, and physics supply the substrate; measurement theory and statistics supply the tools for turning observation into reliable inference.
How does it connect to neighbouring modules?
It draws on earlier foundational modules and feeds forward into the applied case work of later modules, forming one link in the integrated arc of Public Health and Epidemiology.
What distinguishes expert from novice reasoning here?
Experts reason from mechanism and calibrated probability; novices tend to pattern-match surface features. This lesson deliberately trains the former.
Where are the common errors?
Over-reliance on a single datum, ignoring pre-test probability, and confusing a normal result with a ruled-out diagnosis are the recurring traps.
What is the practical payoff?
A structured, defensible line of reasoning that holds up under scrutiny and can be communicated clearly to colleagues.
Big idea: Evidence appraisal is structured scepticism: judge design, bias, and applicability before acting on a result.
Interactive Reasoning Walkthrough
Step 1: Frame the problem
State clearly what is being asked and what a good answer would look like. Identify the decision the analysis must support.
Step 2: Gather the relevant data
Select the observations, measurements, or findings that bear on the question, noting the reliability of each.
Step 3: Apply the governing principles
Map the data onto the mechanisms of evidence, guidelines, and critical appraisal, generating candidate explanations.
Step 4: Weigh the alternatives
Compare explanations against the evidence, considering prior probability and the cost of each type of error.
Step 5: Commit and communicate
Reach a calibrated conclusion, state your confidence, and record the reasoning so it can be reviewed and revised.
Take-home: Grade the evidence, not the author: certainty comes from method quality and applicability, not reputation.

Worked Example

Scenario. A representative case in evidence, guidelines, and critical appraisal presents with an ambiguous initial picture.

Step 1 — Frame: we define the clinical or scientific question precisely.
Step 2 — Gather: we assemble the key findings and note their reliability.
Step 3 — Apply: we map findings onto the governing principles to generate hypotheses.
Step 4 — Weigh: we rank hypotheses by pre-test probability and consequence of error.
Step 5 — Commit: we state a calibrated conclusion and the safeguards that would trigger a review.

Practice & Formative Check

  1. In your own words, state the central question of evidence, guidelines, and critical appraisal and why it matters within Public Health and Epidemiology.
  2. Identify one common reasoning error in this topic and describe a concrete safeguard against it.
  3. Take a scenario from your own experience or reading and walk it through the five-step reasoning pipeline.
Self-check: Can I explain the topic to a peer without notes?
If not, revisit Section 1 and the concept map before proceeding.
Self-check: Do I know the characteristic errors?
You should be able to name at least two and their safeguards.
Self-check: Can I connect this to other modules?
Trace one link backward to a prerequisite and one forward to a later module.

Reading List & References

Core textbooks

  • Gordis (Celentano & Szklo) — Gordis Epidemiology, latest edition.
  • Rothman, Greenland & Lash — Modern Epidemiology, latest edition.
  • Detels et al. — Oxford Textbook of Global Public Health, latest edition.

Applied & reference

  • Relevant current clinical practice guidelines from the appropriate professional society (most recent edition).
  • A major review article from a leading journal surveying the topic within the last five years.
  • A standard reference handbook or manual used in clinical or laboratory practice.

Open & primary sources

  • MedlinePlus and StatPearls (NCBI Bookshelf) — open-access clinical summaries for orientation.
  • PubMed Central open-access primary literature relevant to the topic.
  • WHO / CDC public technical documents where the topic has a public-health dimension.

Slide deck

A ten-slide HTML presentation summarising this lesson. It prints, translates and reads on any device.

A ten-slide presentation of this lesson. Every slide is plain HTML, so it prints, translates and reads on any device.

Slide 1 of 10

Evidence in Public Health and Epidemiology

Where the evidence comes from, what it can establish and how it fails.

Module 3 of MED-10.

MED-10 · Lesson 3.2KBA13 Academy

Slide 2 of 10

Classes of evidence

  • randomised controlled trials
  • cohort and case-control studies
  • systematic reviews and meta-analyses
  • clinical practice guidelines

Each is produced by an institution with its own purposes.

MED-10 · Lesson 3.2KBA13 Academy

Slide 3 of 10

Further classes

  • registry and audit data
  • laboratory and imaging findings

Not interchangeable. Different classes have different blind spots.

MED-10 · Lesson 3.2KBA13 Academy

Slide 4 of 10

Triangulation

Take a claim established in one evidence class and test it against another with different blind spots.

Where they diverge, the divergence is the finding.

MED-10 · Lesson 3.2KBA13 Academy

Slide 5 of 10

Four separate appraisal questions

  • Provenance: who made it, when, why?
  • Reliability: the source’s record over time
  • Credibility: this specific report
  • Relevance: the question you are actually asking

MED-10 · Lesson 3.2KBA13 Academy

Slide 6 of 10

Circular sourcing

Five reports; four of them citing the fifth.

Follow every citation chain to where it terminates.

MED-10 · Lesson 3.2KBA13 Academy

Slide 7 of 10

Measurement drift

The indicator was redefined; the world may not have changed at all.

Check the instrument before believing the series.

MED-10 · Lesson 3.2KBA13 Academy

Slide 8 of 10

Survivorship and timing

  • Records describe cases that passed an earlier filter
  • Retrospective accounts are contaminated by the outcome
  • Absence of a case is not absence of the phenomenon

MED-10 · Lesson 3.2KBA13 Academy

Slide 9 of 10

Recording standard

  • Full citation and date accessed
  • Specific page or section
  • The claim it supports
  • Your appraisal and your residual doubt

MED-10 · Lesson 3.2KBA13 Academy

Slide 10 of 10

Cite what you used

If you read it in a review, cite the review and say so.

Concealed second-hand citation transfers unearned authority and propagates error.

MED-10 · Lesson 3.2KBA13 Academy

12345678910

Click a number to jump to a slide, or scroll the deck sideways.