About this trial
The COMFORT study will evaluate an artificial intelligence-based platform developed to support the clinical assessment of kidney and prostate cancer. The platform utilises imaging data to provide AI-generated outputs intended to assist clinicians in the assessment of suspected lesions.
The primary objective of the study is to assess the role of the COMFORT platform in the clinical decision making process of clinicians managing kidney or prostate cancer cases.
Secondary objectives include evaluation of the performance of AI models on anatomical segmentations, tumor characterisation (localisation, volumetric measurements, lesion classification, and scoring (e.g., Bosniak, PI-RADS, RENAL). Also the acceptability, usability, utility and trustworthiness of the AI models will be evaluated.
In addition, potential causes of privacy leakage associated with the COMFORT AI models will be evaluated as part of the platform's privacy assessment.
Eligibility criteria
This trial accepts healthy volunteersQualifiers
Healthcare professional resident or specialised in Urology
Healthcare professional resident or specialised in Radiology
Proficient in English
Disqualifiers
None
Trial population
Healthcare professionals participating in the study who use the COMFORT platform during the study period. Participants will use the platform as specified in the study protocol and data related to platform assessment and study outcomes will be collected
Trial design
Cohort
Prospective
Treatments tested in this trial
Medical Reading
Other interventionParticipants will perform medical reading of abdominal CT for renal cancer and prostate mpMRI for prostate cancer, without access to AI output using the COMFORT platform.
AI assisted Medical reading
Other interventionParticipants will perform medical reading of abdominal CT for renal cancer and prostate mpMRI for prostate cancer, with access to AI output using the COMFORT platform.
Treatment groups
Trial outcomes
Primary outcomes
Accuracy of the multimodal AI algorithms
Accuracy of the multimodal AI algorithms will be assessed by comparing model predictions with the clinician-reported reference standard for each suspected lesion. Accuracy will be calculated for each applicable cancer type, with bootstrap confidence intervals.
Precision of the multimodal AI algorithms
Precision of the multimodal AI algorithms will be assessed by comparing model predictions with the clinician-reported reference standard for each suspected lesion. Precision will be calculated for each applicable cancer type, with bootstrap confidence intervals.
F1-score of the multimodal AI algorithms
F1-score will be calculated to assess the classification performance of the multimodal AI algorithms against the clinician-reported reference standard for each suspected lesion. F1-score will be calculated for each applicable cancer type, with bootstrap confidence intervals.
Sensitivity of the multimodal AI algorithms
Sensitivity (recall) will be calculated to assess the ability of the multimodal AI algorithms to correctly identify positive cases relative to the clinician-reported reference standard. Sensitivity will be calculated for each applicable cancer type, with bootstrap confidence intervals.
Secondary outcomes
Acceptability of the COMFORT platform
Clinician acceptability of the COMFORT platform will be assessed using the Technology Acceptance Model (TAM), applicable study questionnaires, and structured interviews. Questionnaire scores will be summarized using the median and interquartile range (IQR) for each study site and across the study. Comparisons between study sites will be performed using non-parametric hypothesis testing.
Usability of the COMFORT platform
Clinician-reported usability of the COMFORT platform will be assessed using the System Usability Scale (SUS). The SUS provides a total score ranging from 0 to 100, with higher scores indicating greater perceived usability. Scores will be summarized using the median and interquartile range (IQR) for each study site and across the study. Comparisons between study sites will be performed using non-parametric hypothesis testing.
Perceived trustworthiness of COMFORT AI outputs
Clinicians' perceived trustworthiness of AI-generated outputs will be assessed using the Trustworthiness of AI Output questionnaire and structured interviews. Questionnaire scores will be summarized using the median and interquartile range (IQR) for each study site and across the study.
Perceived information integration
Clinicians' perceptions of the integration of information provided by the COMFORT platform will be assessed using the Perceived Information Integration questionnaire and structured interviews. Questionnaire scores will be summarized using the median and interquartile range (IQR) for each study site and across the study.
Sponsors and contacts
Click on the lead sponsor to view all of their trials.
Aristotle University Of Thessaloniki
Lead sponsor
Charite University, Berlin, Germany
Collaborator
Technical University of Munich
Collaborator
University of Patras
Collaborator
Radboud University Medical Center
Collaborator
Fraunhofer Institute for Digital Medicine MEVIS
Collaborator
University of Salerno
Collaborator
Hospital Universitario 12 de Octubre
Collaborator
Federico II University
Collaborator
This trial is not recruiting at the moment. You can still explore other options: