About this trial
This randomized controlled trial aims to evaluate the impact of providing LLM access to physicians on antibiotic prescribing appropriateness, using a composite outcome instrument, the Antibiotic Prescribing Appropriateness Score (APAS), that simultaneously evaluates antibiotic selection, dosing, duration, clinical reasoning, and management planning. Participants will be randomly assigned to one of two groups: the intervention group will have access to an LLM alongside conventional resources, while the control group will use conventional resources only (e.g. UpToDate, PubMed and Google Search with AI features disabled). Both groups will respond to a set of clinical vignettes covering common infectious disease scenarios requiring antibiotic prescribing decisions, with responses evaluated using an expert-validated grading rubric and independently scored by blinded raters.
Eligibility criteria
This trial accepts healthy volunteersQualifiers
Completed Bachelor of Medicine, Bachelor of Surgery (MBBS) or equivalent degree. The equivalent degree of MBBS in the US and Canada is Doctor of Medicine (MD).
Full or Provisionally Registered Medical Practitioners with the Pakistan Medical and Dental Council (PMDC).
Disqualifiers
Any other Registered Medical Practitioner (Full or Provisional) with PMDC not holding an MBBS or equivalent degree (e.g., practitioners with a Bachelor of Dental Surgery (BDS)).
Trial design
Parallel
Treatments tested in this trial
ChatGPT
Other interventionParticipants in the intervention arm will have access to ChatGPT in addition to conventional diagnostic and reference resources.
Treatment groups
Trial outcomes
Primary outcomes
Antibiotic Prescribing Appropriateness Score (APAS)
The primary outcome will be the composite score (expressed as a percentage) based on an expert-validated rubric that evaluates physician responses across four domains for each clinical vignette: Antibiotic Selection \& Spectrum (0-6 points), Dosing, Route \& Duration (0-3 points), Clinical Reasoning (0-2 points), and Management Plan (0-2 points). The total score for each vignette is the sum of scores across the four domains (maximum 13 points). APAS is expressed as a percentage, calculated as the total score divided by 13, multiplied by 100. The primary endpoint is vignette-level APAS. Responses will be independently evaluated by three licenses physicians blinded to participant identity and treatment assignment. The arithmetic mean of the three raters' total scores will constitute the vignette-level APAS used in the primary analysis.
Secondary outcomes
Antibiotic Selection, Spectrum & Dosing Subscore
The antibiotic selection, spectrum, and dosing elements of APAS (0-6 points per vignette, expressed as a percentage), scored using the same rubric as the primary outcome.
Time per Vignette
We will compare how much time (in seconds) participants spend per case between the two study arms.
Sponsors and contacts
Click on the lead sponsor to view all of their trials.
Lahore University of Management Sciences
Lead sponsor
King Abdullah University of Science and Technology
Collaborator
This trial is not recruiting at the moment. You can still explore other options: