Effectiveness of AI-Assisted Antibiotic Prescribing

ConditionHealthy Adult
Trial statusNot yet recruiting
Trial phaseNot applicable
Trial typeInterventional
Biological sexAll
AgeNot listed
SponsorLahore University of Management Sciences

About this trial

This randomized controlled trial aims to evaluate the impact of providing LLM access to physicians on antibiotic prescribing appropriateness, using a composite outcome instrument, the Antibiotic Prescribing Appropriateness Score (APAS), that simultaneously evaluates antibiotic selection, dosing, duration, clinical reasoning, and management planning. Participants will be randomly assigned to one of two groups: the intervention group will have access to an LLM alongside conventional resources, while the control group will use conventional resources only (e.g. UpToDate, PubMed and Google Search with AI features disabled). Both groups will respond to a set of clinical vignettes covering common infectious disease scenarios requiring antibiotic prescribing decisions, with responses evaluated using an expert-validated grading rubric and independently scored by blinded raters.

Eligibility criteria

This trial accepts healthy volunteers

Qualifiers

Completed Bachelor of Medicine, Bachelor of Surgery (MBBS) or equivalent degree. The equivalent degree of MBBS in the US and Canada is Doctor of Medicine (MD).

Full or Provisionally Registered Medical Practitioners with the Pakistan Medical and Dental Council (PMDC).

Disqualifiers

Any other Registered Medical Practitioner (Full or Provisional) with PMDC not holding an MBBS or equivalent degree (e.g., practitioners with a Bachelor of Dental Surgery (BDS)).

Trial design

Design model

Parallel

Treatments tested in this trial

  • ChatGPT

    Other intervention

    Participants in the intervention arm will have access to ChatGPT in addition to conventional diagnostic and reference resources.

Treatment groups

50 Participants
are divided into 2 treatment groups
Group A: Intervention ArmActive comparator 1 intervention
Group B: Control ArmNo intervention 0 interventions

Trial outcomes

Primary outcomes

1

Antibiotic Prescribing Appropriateness Score (APAS)

The primary outcome will be the composite score (expressed as a percentage) based on an expert-validated rubric that evaluates physician responses across four domains for each clinical vignette: Antibiotic Selection \& Spectrum (0-6 points), Dosing, Route \& Duration (0-3 points), Clinical Reasoning (0-2 points), and Management Plan (0-2 points). The total score for each vignette is the sum of scores across the four domains (maximum 13 points). APAS is expressed as a percentage, calculated as the total score divided by 13, multiplied by 100. The primary endpoint is vignette-level APAS. Responses will be independently evaluated by three licenses physicians blinded to participant identity and treatment assignment. The arithmetic mean of the three raters' total scores will constitute the vignette-level APAS used in the primary analysis.

Time frame
Assessed at a single time point for each case, during the scheduled diagnostic reasoning evaluation session, which takes place between 0-6 days after participant enrollment.

Secondary outcomes

1

Antibiotic Selection, Spectrum & Dosing Subscore

The antibiotic selection, spectrum, and dosing elements of APAS (0-6 points per vignette, expressed as a percentage), scored using the same rubric as the primary outcome.

Time frame
Assessed at a single time point for each case, during the scheduled diagnostic reasoning evaluation session, which takes place between 0-6 days after participant enrollment.
2

Time per Vignette

We will compare how much time (in seconds) participants spend per case between the two study arms.

Time frame
Assessed at a single time point for each case, during the scheduled diagnostic reasoning evaluation session, which takes place between 0-6 days after participant enrollment.

Other outcomes

Sponsors and contacts

Click on the lead sponsor to view all of their trials.

Lahore University of Management Sciences

Lead sponsor

King Abdullah University of Science and Technology

Collaborator

This trial is not recruiting at the moment. You can still explore other options: