Ordestra Explainer
How to Assess Evidence Quality
Not all evidence is equal. A well-designed RCT with a representative sample tells you something different than an underpowered observational study with selection bias. Evidence quality assessment is the structured process of evaluating how much confidence a study's findings deserve.
The 6 Dimensions
Statistical Rigour
Are the statistical methods appropriate for the study design? Are p-values, confidence intervals, and effect sizes reported? Is the analysis pre-specified or exploratory?
Sample Representativeness
How well does the study sample reflect the target population? Are there selection biases? Is the sample size adequate for the claims being made?
Design Quality
Was the study randomised? Were participants and assessors blinded? Were there appropriate controls? Was allocation concealment adequate?
Transparency
Was the study pre-registered? Is the data publicly available? Are conflicts of interest disclosed? Is the funding source reported?
Evidence Context
Does this study replicate previous findings or contradict them? How consistent is it with the broader literature? What is the direction of the evidence base?
Applicability
How well do the findings generalise to other populations, settings, or conditions? Are there external validity constraints that limit practical application?
Overall Confidence Scores
How Ordestra Applies This
Ordestra runs Confidence Pulse on every paper — an automated 6-dimension assessment that scores statistical rigour, sample representativeness, design quality, transparency, evidence context, and applicability. The score appears before you listen, so you know the evidence quality before investing your time.
Confidence Pulse does not replace expert judgement. It surfaces the dimensions that matter so you can focus your review on the areas that need it most.
3 free credits. No card required.
Generate your first evidence-constrained summary in under two minutes.