About this trial
The goal of this clinical trial is to learn how artificial intelligence (AI) may help doctors make diagnoses in kidney medicine. The researchers want to know whether an AI tool called a large language model (LLM) can help doctors choose the correct diagnosis more often and feel more confident in their answers.
Before starting the study, the research team tested several AI models and chose one of the best performers, a GPT-5-class model set to use high reasoning effort.
The main questions this study aims to answer are:
1. Do doctors make more correct diagnoses when they can see AI suggestions? 2. Does seeing AI suggestions change how confident doctors feel about their diagnosis?
Researchers will compare doctors who receive AI suggestions with doctors who do not receive AI suggestions to see how the AI affects accuracy, confidence, and decision-making.
Participants will complete up to 10 online clinical cases. For each case, they will:
1. Read a short medical scenario 2. Suggest up to three possible diagnoses
(If in the AI group) Review the AI's suggestions and decide whether to change their answer
The study will also look at how long participants take to answer each case and how the AI's performance compares to the human answers.
Eligibility criteria
This trial accepts healthy volunteersQualifiers
None
Disqualifiers
None
Trial design
Parallel
Treatments tested in this trial
AI suggestion
Other interventionThis intervention consists of displaying an AI-generated diagnostic suggestion during the clinical case-solving task. After reading each vignette, participants see the top diagnostic proposal produced by a large language model (GPT-5, high-reasoning configuration), selected after internal benchmarking. The AI suggestion appears once per vignette and cannot be requested again or modified. Participants may revise their diagnostic answer after viewing the suggestion, but they cannot return to the vignette later. No additional guidance, coaching, or interactive features are provided.
Treatment groups
Trial outcomes
Primary outcomes
Final diagnostic accuracy (top-3) with vs without AI support
For each participant, proportion of vignettes where the correct main diagnosis is included in the participant's final top-3 diagnoses. Compare final top-3 accuracy between the AI arm (after AI suggestions) and the control arm (no AI). Percentage of correctly diagnosed cases (top-3).
Secondary outcomes
Final diagnostic accuracy (top-1) with vs without AI support
For each participant, proportion of vignettes where the correct main diagnosis is included in the participant's final top-1 diagnoses. Compare final top-1 accuracy between the AI arm (after AI suggestions) and the control arm (no AI). Percentage of correctly diagnosed cases (top-1).
Change in top-3 diagnostic accuracy before vs after AI suggestions (AI arm only)
In the AI-supported arm, participants first provide an initial answer (up to three diagnoses) without AI suggestions, then see AI-generated suggestions and may revise their answer once; they cannot return to that vignette later. For each participant, the investigators compute the difference in top-3 accuracy between initial and final answers across all completed vignettes. Percentage-point change in Top-3 diagnostic accuracy
Change in top-1 diagnostic accuracy before vs after AI suggestions (AI arm only)
In the AI-supported arm, participants first provide an initial answer (up to three diagnoses) without AI suggestions, then see AI-generated suggestions and may revise their answer once; they cannot return to that vignette later. For each participant, the investigators compute the difference in top-1 accuracy between initial and final answers across all completed vignettes. Percentage-point change in Top-1 diagnostic accuracy
Diagnostic confidence (0-10) before AI suggestions: Control vs AI arm
Participants in both arms rate their confidence (0-10 scale) in their Top-3 diagnostic proposal before any AI suggestions. In the AI arm, this is the "pre-AI" rating. In the Control arm, this is the single confidence rating (since no AI is shown). The investigators compare the pre-AI confidence between arms, aggregated across all completed vignettes per participant.
Sponsors and contacts
Click on the lead sponsor to view all of their trials.
University Hospital, Lille
Lead sponsor
Institut Pasteur de Lille
Collaborator
Lille University
Collaborator