This is a cross-sectional study that primarily employs quantitative analysis, supplemented by qualitative assessment. The research is conducted in two stages: Phase I consists of a model performance comparison experiment, and Phase II involves an item quality evaluation experiment. The entire study adheres to the principles of single-blinding, randomization, and standardization to ensure scientific rigor and reproducibility.
The single-blind design is implemented during the "standardized testing" phase, where the system intersperses AI-generated items with those authored by human experts. Participants remain blinded to the source of each item (AI-generated vs. human-authored) throughout the testing and scoring processes, thereby ensuring the objectivity of the evaluation results.
1.Professional Status: Medical students currently enrolled in a Standardized Residency Training (SRT) program.
1.Conflict of Interest: Individuals involved in the AI model training, prompt engineering, or the creation of the human-authored question bank for this study.
Medical students currently enrolled in a Standardized Residency Training (SRT) program.
Other
Cross-sectional
Not listed
Comparative Analysis of Item Accuracy
The investigators will evaluate the average accuracy rates coefficients of AI-generated items compared to human-generated items
Click on the lead sponsor to view all of their trials.
