Find the studies that matter first, and know when you have found enough.
ReviewFast helps with title and abstract screening in systematic reviews. A decision model, a model that answers a yes-or-no question about each record with a probability instead of generating text, ranks your search results against your eligibility criteria. You screen from the top, and a statistical stopping criterion tells you when at least 95% of the relevant records have been found, with 95% confidence.
How it works
Rank
Jev, a decision model, gives every record a probability of meeting your criteria. Records go ten per request with the evaluation's prompt and request format; ReviewFast shuffles their order, which the evaluation did not test. Scoring costs about US$0.02 per 1,000 records.
Screen
You decide include, maybe or exclude, one record at a time, from the most to the least likely. The probability stays hidden by default so that it does not anchor your judgement.
Stop with confidence
After each decision, the stopping criterion of Callaghan and Müller-Hansen tests whether recall could still be below 95%. When it can be rejected at the 5% level, you can stop and report the rule. A random-sample check of the records you skipped is built in.
What the evaluation showed
The workflow comes from an evaluation of a decision model for screening (manuscript in preparation). Ranking with Jev followed by the statistical stopping criterion was a post hoc analysis in that study.
Savings concentrate in larger reviews; in small reviews the criterion needs almost every record before it can stop. The full workflow was evaluated with one decision model, Jev. A fixed probability threshold was not reliable as a stand-alone stopping rule, so ReviewFast does not offer one.
Good to know
Before you start
- You need a Vercel AI Gateway API key with paid credits. Jev is not available on the free tier.
- Use the eligibility criteria from your protocol, written before screening.
- Export complete, unsorted search results (RIS, CSV, PubMed format or PubMed XML).
- Records without an abstract, or apparently not in English, go to a manual queue that you screen in full.
Your data
- Everything runs in your browser. jolab.ai serves the page and receives none of your records, decisions or keys.
- Criteria, titles and abstracts go from your browser to TypeSafe AI through the Vercel AI Gateway (United States). The provider does not offer zero data retention, so send only published or cleared records.
- Your key stays in memory for the session. Projects are saved in this browser; export them to keep a copy.