RCT of NLP-Based Feedback for Improving SDM in Men With Localized Prostate Cancer
Trial statusRecruiting
Trial phaseNot applicable
Trial typeInterventional
Biological sexMale
Age18+
SponsorCedars-Sinai Medical Center
About this trial
The purpose of the research is to assess the impact of a natural language processing + artificial intelligence (NLP+AI)-based risk communication feedback system to improve quality of risk communication of key tradeoffs during prostate cancer consultations among physicians and to improve patient decision making. In this cluster randomized trial, an evaluable 259 patients with newly diagnosed clinically localized prostate cancer will be cluster randomized within an evaluable 24 physicians to:
1. a control arm, in which patients will receive standard of care treatment consultations along with AUA-endorsed educational materials on treatment risks and benefits (for patients) and on SDM (for physicians) or 2. an experimental arm, in which patients and participating physicians will receive NLP+AI-based feedback on what was said about key tradeoffs within approximately 72 hours of the consultation to assist with decision making. Physicians will additionally be provided with grading of their risk communication for each visit based on an a priori defined framework for quality of risk communication and recommendations for improvement.
In both study arms, there will be an audio-recorded follow-up phone or video call between the physician and patient to allow for further discussion of risk and clarifying any areas of ambiguity, which will be qualitatively analyzed to see if areas of poor communication were rectified. After the follow-up phone call, patients and participating physicians will be asked to complete a very brief survey about their experience.
The study plans to test whether receiving NLP+AI-based feedback improves decisional conflict, shared decision making, and appropriateness of treatment choice over the standard of care in patients undergoing treatment consultations for prostate cancer. Study staff will also test whether providing feedback and grading of risk communication to physicians affects quality of physician risk communication, since providing feedback will promote more accountability for the quality of information provided to patients. The study will also analyze data from the control arm of the randomized controlled trial to understand variation in risk communication of key tradeoffs in relevant subgroups of tumor risk (low-, intermediate-, and high-risk), provider specialty (Urology, Radiation Oncology, Medical Oncology), and patient sociodemographics.
Eligibility criteria
This trial does not accept healthy volunteersQualifiers
Patients undergoing initial treatment consultation for clinically localized prostate cancer;
Patients with upgraded prostate cancer on active surveillance considering conversion to definitive local therapy;
Ability to read and write in English.
Disqualifiers
Under 18 years of age;
Subjects with difficulty communicating or dementia;
Non-English speakers, given that our NLP-based tools cannot be used with languages other than English;
Patients with locally advanced or metastatic prostate cancer;
Trial design
Design model
Parallel
Treatments tested in this trial
NLP+AI Report
Other interventionA NLP model will extract key content from consultations and AI (Chat GPT) will summarize that information. Reports including the top sentences by NLP probability for key content areas will be generated and will be provided to patients and providers within approximately 72 hours after each case. In both arms, a follow up phone call will allow for clarification any concepts that was inadequately communicated during the consultation. This call will be audio recorded and qualitatively assessed to determine whether deficiencies in risk communication observed in the consultation were rectified.
Treatment groups
283 Participants
are divided into 2 treatment groupsGroup A: NLP-Based Feedback ArmExperimental treatment 1 intervention
Group B: Standard of Care ArmNo intervention 0 interventions
Trial outcomes
Primary outcomes
1
Decisional conflict
Decisional conflict is a patient-level outcome between intervention and control and will be measured using the validated Decisional Conflict Scale (DCS) questionnaire, where participants will list if they strongly agree, agree, neither, disagree, or strongly disagree with the provided statements
Time frame
2-4 weeks (from diagnosis and enrollment through the completion of post feedback survey)2
Shared decision-making
Shared decision making will be patient-reported and measured using the validated SDMP-4 questionnaire.
Time frame
2-4 weeks (from diagnosis and enrollment through the completion of post feedback survey3
Appropriateness of treatment choice
Appropriateness of treatment choice will be determined a priori based on previously published measures determined by treatment guidelines.
Time frame
2-4 weeks (from diagnosis and enrollment through the completion of post feedback survey)4
Quality of risk communication
Physician level outcome-that will measure the difference in composite quality of physician risk communication between the experimental and control arms. Quality of physician risk communication will be measured using a previously published hierarchical scale that is specific to communication of cancer prognosis, life expectancy, and treatment-related side effects.
Time frame
6-9 months (post study analysis)Secondary outcomes
1
Improvement of risk communication
Physician level outcome- improvement of risk communication in areas of deficiency in follow up calls between doctors and patients in the experimental arm. All of this information will be assessed retrospectively by qualitative analysis of treatment consultation transcripts.
Time frame
6-9 months (post study analysis)2
Risk Perception and Patient Satisfaction
Patients will fill out a REDCap questionnaire assessing risk perception and patient satisfaction with the intervention.
Time frame
6-9 months (post study analysis)Sponsors and contacts
Click on the lead sponsor to view all of their trials.
Cedars-Sinai Medical Center
Lead sponsor
National Cancer Institute (NCI)
Collaborator
Source ClinicalTrials.gov