Health TrialsbyHealthPanel

Effect of Predictive Model on ED Physician Assessments of Patient Disposition

ConditionPatient Outcome Assessment
Trial statusNot yet recruiting
Trial phaseNot applicable
Trial typeInterventional
Biological sexAll
Age18-65
SponsorBoston Children's Hospital

About this trial

The goal of this study is to measure the impact of fairness-aware algorithms on physician predictions of ED patient admission. Using an experimentally validated machine learning model tuned for equitable outcomes, the investigators quantify the impact of model recommendations on ED physician assessments of admission risk in a silent, prospective study. The investigators survey ED physicians who are not currently caring for patients using live site data. To quantify the impact of the model on ED physician assessments of admission risk, the investigators collect physician assessments before and after consulting the (original or updated) model prediction.

The investigators measure ED physician adherence to model suggestions, along with the predictive accuracy and equity of downstream patient outcomes. The outcome of this study is an empirical measure of the extent to which fair ML models may influence admission decisions to mitigate health care disparities.

Eligibility criteria

This trial accepts healthy volunteers

Qualifiers

Board certified emergency department attending physicians currently employed by Boston Children's Hospital

Disqualifiers

Physicians are excluded from completely surveys for patients who they are currently caring for

Trial design

Design model

Sequential

Treatments tested in this trial

  • Baseline model

    Diagnostic test

    Model prediction of patient disposition including feature importance scores driving prediction.

  • Fairness-aware model

    Diagnostic test

    Model prediction of patient disposition including feature importance scores driving prediction. This model has been tuned to minimize subgroup calibration errors.

Treatment groups

10 Participants
are divided into 3 treatment groups
Group A: Physician assessment before interventionNo intervention 0 interventions
Group B: Physician assessment after baseline model interventionActive comparator 1 intervention
Group C: Physician assessment after fairness-aware model interventionActive comparator 1 intervention

Trial outcomes

Primary outcomes

1

Physician-assessed ED disposition (likelihood of admission)

The primary outcome is physician-assessed ED disposition (categorized as admission or discharge), before and after viewing a model prediction, compared to final disposition of patient

Time frame
Within 24 hours of survey
2

Patient final disposition (admitted/discharged)

The final disposition of the patient, whether admitted to an inpatient service or discharged

Time frame
Within 24 hours of survey

Secondary outcomes

1

Model-assessed ED disposition

The model prediction's assessment of ED disposition compared to final disposition of patient

Time frame
Within 24 hours of survey

Other outcomes

Locations

This trial has no locations.

Sponsors and contacts

Click on the lead sponsor to view all of their trials.

Boston Children's Hospital

Lead sponsor

Source ClinicalTrials.gov

This trial is not recruiting at the moment. You can still explore other options: