Open resources
Resources
The appraisal checklists, reporting guidelines, search tools and software we use. Everything here is free, and most of it is the standard reference rather than our own recommendation.
01
Critical appraisal & methodology
CASP checklists
ExternalThe Critical Appraisal Skills Programme checklists — the appraisal tools we use in session for diagnostic, cohort, RCT and qualitative designs.
VisitCochrane Handbook
ExternalThe reference standard for systematic review methodology, including risk-of-bias assessment and GRADE. Free to read online.
VisitEQUATOR Network
ExternalEvery major reporting guideline in one index — CONSORT, STROBE, PRISMA, ARRIVE, TRIPOD, STARD and others, with extensions.
VisitJBI Manual
ExternalChapter-by-chapter guidance for the main evidence synthesis designs, with worked examples.
VisitGRADE Working Group
ExternalHow certainty of evidence is rated, and how that rating should change what you do.
VisitICMJE Recommendations
ExternalAuthorship, duplicate publication, conflicts of interest and other publication ethics. Required reading before any submission.
Visit
02
Literature search
PubMed
The default biomedical literature search. Learn the field-tag syntax and MeSH filters before anything else.
VisitPubMed Central
Free full text for a large share of the biomedical literature, including much that is not otherwise open access.
VisitClinicalTrials.gov
Registered trial protocols. Checking whether a trial was pre-registered, and whether the outcome matches the registration, is a basic appraisal step.
VisitCochrane Library
Systematic reviews, with the underlying study data and risk-of-bias assessments.
VisitUnpaywall
Finds an open-access copy of an article when the publisher's version is paywalled. Works as a browser extension.
VisitSemantic Scholar
Useful for citation-graph exploration — which papers cite a work, and what has cited it since.
Visit
03
Software & tools
Zotero
Reference manager with browser connector and Word plugin. Free, and it stores the PDF with its metadata so your library stays usable offline.
VisitRayyan
Collaborative screening for systematic reviews, with a blinded mode for two independent screeners.
VisitR (RStudio)
The default for statistical analysis in the biomedical sciences. Start with the tidyverse.
VisitPython
Necessary for image analysis, natural-language processing and most machine-learning work.
VisitSPSS / JASP / Jamovi
Point-and-click statistics. Reasonable for a first analysis; know what your test assumes before running it.
VisitOSF
Free project hosting with version control and pre-registration for preregistration.
Visit
04
Five things we keep saying
- 01
Distinguish the null hypothesis from the point of equivalence. Absence of evidence is not evidence of absence.
- 02
Confidence intervals are more informative than p-values, and the width of the interval is a finding in itself.
- 03
Every test assumes something. Write the assumption down before you look at the p-value.
- 04
Multiple comparisons inflate false positives. If you ran twenty comparisons, your nominal 5% threshold is roughly 64%.
- 05
A statistically significant result from a large enough study is nearly guaranteed and may be clinically irrelevant.
05
Our own material
Everything the club has published is a worked example of a structured critical review. Reading them in order is the most useful preparation for a first session, and several members have said it is the only reading that made the method click.
Session format
- When
- Monthly, during the Wednesday clinical meeting
- Where
- College of Medicine seminar room
- Who
- All years, all disciplines. No prior experience assumed.
- Bring
- The paper, and one sentence on what you think it shows
