Publications & Evidence

The research behind the EvidenceAi™ Suite

Conference posters and abstracts, pilot evaluation results, the assessment instrument we built to measure AI against human first drafts, and the Evidence Mastery book series.

Pilot evaluation: EvidenceAi™ Suite vs human first drafts

Results reported at ISPOR Europe 2026 from 20 structured evaluations by 7 respondents from 7 organisations, covering 8 modules. Each respondent completed the EvidenceAi Assessment Survey (EAS) immediately after generating a document.

Comparative domains (0–10; 5.0 = equivalent to a human first draft)Mean and 95% CI
Ease of use
8.95 (8.45–9.45)
Time to render
9.85 (9.69–10.00)
Editorial quality
8.25 (7.40–9.10)
Scientific quality
7.85 (6.85–8.85)
Error patterns
6.95 (5.86–8.04)
Absolute domains (0–10; higher is better)
Usefulness
9.05 (8.49–9.61)
Workflow integration
9.10 (8.52–9.68)
Overall satisfaction
9.20 (8.45–9.95)
Resource savings (average per document)
46.6 daysCalendar time saved per document · 95% CI 28.2–65.0
11.5 daysHuman effort saved per document · 95% CI 3.7–19.3

Teal bar = 95% confidence interval; grey line = human-equivalent reference (5.0) on comparative domains. Scores below 5.0 indicate inferiority to a human first draft; above 5.0, superiority. Absolute domains are not compared with a human reference.

Limitations, stated plainly
  • Early-adopter sample: 7 respondents, 20 evaluations; per-module samples are small (1–6). Data collection is ongoing.
  • Reference accuracy is the main area for improvement: the lowest-scoring domain (error patterns) was driven by inaccurate or mismatched citations, which is why every reference is verified in expert review.
  • Every output is a first draft. Human expert review, validation and approval remain essential.

ISPOR Europe 2026

Accepted for presentation at ISPOR Europe 2026, Vienna, 8–11 November 2026
Poster RWD21 · 2026-RS-5436-ISPOR

A Generative AI Suite for Real-World Evidence Study Documentation: Multi-Module Validation Across Pharmacoepidemiological Deliverables

Toussi M, Blanchette CM, Capkun G, Gavini F, Rosenlund M, Ali A, Cooper A, Kurzinger ML, Brion L
ISPOR Europe 2026, Vienna. Poster RWD21, Monday 9 November 2026, 10:30–13:30. Value in Health 2026;29(12S).

A prospective mixed-methods evaluation comparing first drafts generated by the EvidenceAi™ Suite with human-generated first drafts, using a ten-domain assessment survey embedded at the point of generation. All eight modules evaluated scored at or above the human-equivalent threshold across the comparative domains.

Poster MSR114 · 2026-RS-7524-ISPOR

AI-Assisted RWE Study Design and Reporting: Quantifying Time Savings and Scientific Equivalence

Development and Validation of the EvidenceAi™ Assessment Survey (EAS): A 10-Domain Framework for Evaluating Generative AI Tools in Pharmacoepidemiology
Toussi M, Blanchette CM, Capkun G, Gavini F, Rosenlund M, Ali A, Cooper A, Kurzinger ML, Brion L
ISPOR Europe 2026, Vienna. Poster MSR114, Monday 9 November 2026, 16:00–19:00.

Development of the EvidenceAi™ Assessment Survey (EAS), a human-anchored 10-domain instrument for evaluating generative AI tools in pharmacoepidemiology, and its pilot application: calendar-time and human-effort savings per document alongside scientific and editorial quality.

Tools and reference works

Assessment instrument

EvidenceAi™ Assessment Survey (EAS)

A 10-domain, human-anchored instrument for evaluating generative AI tools in pharmacoepidemiology: five comparative domains (0–10, with 5.0 = human equivalent), three absolute domains, two resource measures (calendar time and human effort saved) and a free-text impression. It is available for non-commercial research use.

Book series

Real World Evidence: Principles and Practice

Toussi M
Evidence Mastery series, Volume 1. Available on Amazon.

Volume 1 of a five-volume series: principles, data sources, tools and templates, methods, and diseases and drugs. Volumes 2–5 are scheduled from December 2026 to May 2028.

Founder

Selected publications of Massoud Toussi

More than 50 peer-reviewed publications in pharmacoepidemiology, real-world evidence and health data.