Health TrialsbyHealthPanel

Evaluating Decision-making Using ChatGPT-4 Among Trainees in Surgery

ConditionsArtificial Intelligence (AI)TrainingSurgery
Trial statusNot yet recruiting
Trial phaseNot listed
Trial typeObservational
Biological sexAll
AgeNot listed
SponsorOspedali Riuniti Trieste

About this trial

This study aims to assess whether ChatGPT-4 can support surgical trainees in clinical decision-making. By comparing the performance of ChatGPT-4 with junior residents, senior residents, and attending surgeons on standardized clinical scenarios, the study seeks to understand the potential role of large language models in surgical education. The ultimate goal is to evaluate whether ChatGPT-4 can be safely integrated as a supplementary educational tool to aid junior residents in developing critical thinking and surgical judgment.

Eligibility criteria

This trial does not accept healthy volunteers

Qualifiers

Actively enrolled or employed in the general surgery residency or department at the participating institution

Willingness to participate and complete all clinical case scenarios

Consent to participate in the study

Disqualifiers

Incomplete responses

Use of external assistance (e.g., internet search, AI tools) when answering scenarios, as self-reported in instructions

Trial population

The study population will consist of general surgery trainees and faculty members from a single academic surgical department. Participants will be stratified into three groups based on their level of training and experience: Junior Residents: Postgraduate Year (PGY) 1-2; Senior Residents: PGY 3 and above; Attending Surgeons: Board-certified general surgeons with independent clinical practice

Trial design

Design model

Cohort

Time perspective

Prospective

Treatments tested in this trial

  • Clinical Cases

    Other intervention

    Seven clinical cases that have to be analysed

Treatment groups

35 Participants
are divided into 3 treatment groups
Group A: Residents1 intervention
Group B: Consultants1 intervention
Group C: ChatGPT 41 intervention

Trial outcomes

Primary outcomes

1

Proportion of correct responses

Binary outcome (correct vs. incorrect decision)

Time frame
Baseline

Secondary outcomes

1

Comparison of accuracy across experience levels

Proportion of correct responses by group: Junior residents, Senior residents, Attending surgeons, ChatGPT-4

Time frame
Baseline
2

Confidence level

Participants and ChatGPT are asked to rate how confident they feel in their answer (1-5 Likert scale, where 1 means no confident and 5 very confident)

Time frame
Baseline
3

Percentage of use of AI for clinical cases evaluation

Participants are asked if they use or not ChatGPT in their clinical activity

Time frame
Baseline

Other outcomes

Sponsors and contacts

Click on the lead sponsor to view all of their trials.

Ospedali Riuniti Trieste

Lead sponsor

Source ClinicalTrials.gov

This trial is not recruiting at the moment. You can still explore other options: