Evaluating AI for the Translation of KM Resources

Trial statusNot yet recruiting
Trial phaseNot applicable
Trial typeInterventional
Biological sexAll
Age18+
SponsorUniversity of Alberta

About this trial

Knowledge mobilization resources for parents provide information to help make health decisions for their children. These resources can include videos, infographics, and plain language summaries. They are often created in English. This can make them hard to understand for people whose first language is not English. Translating these resources into other languages may be helpful. However, professional translation can take time and be expensive.

The study will compare a resource that is in English with the same resource translated into another language. The investigators will use both high and low resource languages commonly spoken in Alberta: Mandarin, Punjabi, Tagalog, Urdu. Parents who speak these languages will be asked to answer questions about how easy it is to understand and use the information. The investigators will also see if artificial intelligence can be used to translate the resource. To do this, parents will be asked to look at a resource that was translated by a professional and the same resource that was translated using artificial intelligence. Then, parents will answer questions about how clear the translations are. Parents will be asked to participate in the study using the internet. They will answer questions using an online questionnaire. Parents will also be asked if they are interested in taking part in an online interview. This will help us understand their thoughts about the resources in more detail. The plan is to involve 576 parents with 144 parents per language group.

This project will help to better understand whether parents prefer a resource in their own language compared to an English version. It will also help to understand whether artificial intelligence can be used to translate resources so that they are easier for parents to access. This work is very important so that all parents and their children have access to high quality health information. This can help all families make the best decisions for their children's health.

Eligibility criteria

This trial accepts healthy volunteers

Qualifiers

Adult (18 years or older)

Currently a parent or familial caregiver of a child (<18 years)

Lives in Canada

First language (native language, language learned from birth) is Mandarin, Punjabi, Tagalog, or Urdu

Disqualifiers

Under <18 years

Does not currently identify as a parent or familial caregiver of a child (<18 years)

Does not live in Canada

Does not identify their first language as Mandarin, Punjabi, Tagalog, or Urdu

Trial design

Design model

Crossover

Treatments tested in this trial

  • KM Resource - English

    Other intervention

    The interactive infographic was originally created in English by our team with funding from the Women and Children's Health Research Institute and the Stollery Children's Hospital Foundation. The infographic provides information about what to expect when taking an ill or injured child to the emergency department. The topic was identified as a priority by local interest holders at the Stollery Children's Hospital. The infographic contains 750 words and takes on average 3 minutes to read.

  • KM Resource - Professionally Translated

    Other intervention

    The interactive infographic was originally created in English by our team with funding from the Women and Children's Health Research Institute and the Stollery Children's Hospital Foundation. The infographic provides information about what to expect when taking an ill or injured child to the emergency department. The topic was identified as a priority by local interest holders at the Stollery Children's Hospital. The infographic contains 750 words and takes on average 3 minutes to read. The resource will be professionally translated into Mandarin, Punjabi, Tagalog and Urdu. The communities of interest represent common non-English languages spoken at home in Alberta.

  • KM Resouce - AI

    Other intervention

    The interactive infographic was originally created in English by our team with funding from the Women and Children's Health Research Institute and the Stollery Children's Hospital Foundation. The infographic provides information about what to expect when taking an ill or injured child to the emergency department. The topic was identified as a priority by local interest holders at the Stollery Children's Hospital. The infographic contains 750 words and takes on average 3 minutes to read. The investigators will use ChatGPT to translate the resource (the latest version available at time of translation), as it is widely used and easily accessible, increasing the generalizability of our results. The communities of interest represent common non-English languages spoken at home in Alberta.

Treatment groups

576 Participants
are divided into 4 treatment groups
Group A: RQ1 Group A - English (non-translated)Experimental treatment 1 intervention
Group B: RQ1 Group B - Professional TranslationExperimental treatment 1 intervention
Group C: RQ2 Group A - Professional TranslationExperimental treatment 1 intervention
Group D: RQ2 Group B - AI TranslationExperimental treatment 1 intervention

Trial outcomes

Primary outcomes

1

Understanding

RQ1, RQ2; Measured by participant responses to a set of 7 multiple-choice questions specifically designed to evaluate key content knowledge about the infographic content. The number of correct answers will serve as an objective indicator of understanding, assessing the ability of each translation method to preserve critical concepts.

Time frame
Baseline

Secondary outcomes

1

Acceptability/Usability

RQ1, RQ2; Measured by participant responses to a set of 6 questions using a 7-point Likert scale (7 'strongly agree', 4 'neutral' and 1 'strongly disagree') assessing whether everyone can use it, in addition to whether it is easy to use and interact with.

Time frame
Baseline
2

Satisfaction Level

RQ1; Measured by participant responses to a set of 3 questions using a 7-point Likert scale (7 'strongly agree', 4 'neutral' and 1 'strongly disagree') assessing whether it meets the needs and expectation of the user.

Time frame
Baseline
3

Preference

RQ1; Measured by participant responses to a set of 3 questions using a combination of multiple choice, yes/no, and open comment boxes assessing which version do they prefer to receive.

Time frame
Baseline
4

Readability

RQ2; Measured by participant responses to a set of 5 questions using a combination of yes/no, open comment boxes assessing how easily a resource can be understood by the end user.

Time frame
Baseline

Other outcomes

Sponsors and contacts

Click on the lead sponsor to view all of their trials.

University of Alberta

Lead sponsor

Translating Emergency Knowledge for Kids (TREKK)

Collaborator

Our Kids Health

Collaborator

This trial is not recruiting at the moment. You can still explore other options: