Clinical trials

This randomized controlled trial aims to evaluate the impact of providing LLM access to physicians on antibiotic prescribing appropriateness, using a composite outcome instrument, the Antibiotic Prescribing Appropriateness Score (APAS), that simultaneously evaluates antibiotic selection, dosing, duration, clinical reasoning, and management planning. Participants will be randomly assigned to one of two groups: the intervention group will have access to an LLM alongside conventional resources, while the control group will use conventional resources only (e.g. UpToDate, PubMed and Google Search with AI features disabled). Both groups will respond to a set of clinical vignettes covering common infectious disease scenarios requiring antibiotic prescribing decisions, with responses evaluated using an expert-validated grading rubric and independently scored by blinded raters.

This study is a randomized controlled trial (RCT) investigating whether access to a new LLM interface can improve medical triage and diagnostic accuracy for laypeople compared to access to a standard LLM interface. It addresses previous findings where laypeople using standard LLMs performed worse than those using conventional methods (e.g., web search) due to incomplete symptom sharing and poor interpretation of AI advice. To address this, the research tests a structured LLM system that proactively asks clinical history questions before providing a standardized, easy-to-read diagnostic output.