Observational Study Open Access
Copyright ©The Author(s) 2023. Published by Baishideng Publishing Group Inc. All rights reserved.
World J Methodol. Sep 20, 2023; 13(4): 259-271
Published online Sep 20, 2023. doi: 10.5662/wjm.v13.i4.259
External validation of the Moroccan Arabic version of the European Organization for Research and Treatment of Cancer colorectal (CR29) module: Monocentric study
Houda Bachri, Hajar Essangri, Nezha El Bahaoui, Amine Benkabbou, Raouf Mohsine, Anass Mohammed Majbar, Amine Souadka, Surgical Oncology Department, National Institute of Oncology, Mohammed Vth University in Rabat, Rabat 10100, Morocco
Hajar Essangri, Gynecology oncology Department, Royal London Hospital, Barts NHS Health, London SE18 6EY, United Kingdom
ORCID number: Hajar Essangri (0000-0001-8218-3602); Amine Benkabbou (0000-0003-2769-1115); Raouf Mohsine (0000-0001-8590-9333); Anass Mohammed Majbar (0000-0003-4329-2026); Amine Souadka (0000-0002-1091-9446).
Author contributions: Souadka A and Bachri H have contributed to the conception and design of the study, acquisition of the data, the analysis and the interpretation of data; Souadka A, Bachri H and Essangri H wrote the first draft; El Bahaoui N, Majbar AM and Benkabbou A critically reviewed the draft for important intellectual content; Mohsine R was involved in revising critically the corrected manuscript and all authors read and gave the final approval of the version to be published.
Institutional review board statement: The Approval of the study protocol was obtained from the institutional ethics review board (number: 79/17) and all patients enrolled in the study provided a written, informed consent allowing the use of their data for clinical studies at the time of their initial visit.
Conflict-of-interest statement: The authors declare no conflict of interest.
Data sharing statement: Derived data supporting the findings of this study are available from the corresponding author a.souadka@um5r.ac.ma upon reasonable request.
Open-Access: This article is an open-access article that was selected by an in-house editor and fully peer-reviewed by external reviewers. It is distributed in accordance with the Creative Commons Attribution NonCommercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: https://creativecommons.org/Licenses/by-nc/4.0/
Corresponding author: Amine Souadka, MD, PhD, Professor, Surgical Oncology Department, National Institute of Oncology, Mohammed Vth University in Rabat, Hay riad Souissi, Rabat 10100, Morocco. a.souadka@um5r.ac.ma
Received: April 22, 2023
Peer-review started: April 22, 2023
First decision: June 14, 2023
Revised: July 26, 2023
Accepted: September 1, 2023
Article in press: September 1, 2023
Published online: September 20, 2023

Abstract
BACKGROUND

Quality of life (QoL) outcomes are a focal endpoint of cancer treatment strategies.

AIM

To externally validate the Moroccan Arabic version of the European Organization for Research and Treatment of Cancer (EORTC) QoL Questionnaire (QLQ) for colorectal cancer (CRC) patients (CR29).

METHODS

Both Moroccan Arabic modules of QLQ-CR29 and QLQ-C30 were administered to Moroccan CRC. Psychometric properties were retested by measuring Cronbach’s alpha coefficient for reliability and Intraclass correlation coefficient (ICC) to examine test-retest reproducibility. The multitrait-scaling analysis was performed to demonstrate the validity of the instrument and known-groups comparison was used to test the score’s ability to discriminate between different groups of patients.

RESULTS

In total, 221 patients were included in our study and 34 patients completed the questionnaire twice. The Urinary Frequency scale and Stool Frequency scale had good internal consistency with alpha Cronbach coefficients of 0.79 and 0.83 respectively, while the same coefficients were moderately lower for the Blood and Mucus in Stool scale (0.61) and the Body Image scale (0.67). The ICCs ranged from 0.88 to 1 indicating good to excellent reproducibility. In multitrait scaling analyses, the criterion for item convergent and divergent validity was satisfactory. The known-group comparison showed statistically significant differences between patients according to age, gender, stoma status, tumor location, and radiotherapy.

CONCLUSION

The Moroccan Arabic version of the EORTC QLQ-CR29 is a valid and reliable tool that can be used safely for research and clinical purposes in Moroccan CRC patients.

Key Words: Rectal neoplasm, Colorectal cancer, Health-related quality of life, Patient reported outcome measures, European Organization for Research and Treatment of Cancer Quality of Life Questionnaire-CR29, European Organization for Research and Treatment of Cancer Quality of Life Questionnaire-C30

Core Tip: Patient related outcomes such as quality of life (QoL) are a focal endpoint of cancer treatments strategies. Many QoL Questionnaire (QLQ) are not trully validated. We aim to externally validate the Moroccan Arabic version of the European Organization for Research and Treatment of Cancer QLQ CR29 on larger and more heterogenous population in order to affirm its validity and reliability in arabic colorectal cancer patients.



INTRODUCTION

Colorectal cancer (CRC) is a global challenge[1]. However, even with an increasing incidence, the implementation of screening programmes and the large array of advanced treatment modalities has significantly reduced mortality[2,3]. Nonetheless, CRC survivors suffer impaired physical and bowel functions, as well as psychological symptoms such as anxiety, sleep disruption, and depression[4]. All together, these symptoms negatively reflect on the quality of life (QoL)[5] and makes looking beyond oncological outcomes of great importance.

Health-related QoL (HRQL) is an abstract and multidimensional concept[6] which can be assessed by the European Organization for Research and Treatment of Cancer (EORTC) questionnaires. Core measurement tools examine issues common to different cancer sites and can be used as a stand-alone questionnaire or in combination with disease specific modules[7]. The EORTC QoL Questionnaire (QLQ) CR29 questionnaire specific to CRC and its psychometric properties have been tested in several languages and contexts[8-16].

Recently, The QLQ-CR29 has just been only translated for Moroccan Arabic dialect[17]. However this adaptation was performed on a very limited sample size of 120 patients under the usual requests of the EORTC organization. The aim of this study is to externally validate this version and assess its psychometric properties on larger Moroccan CRC patients.

MATERIALS AND METHODS
Description of the instruments

We followed the STROBE directive guidelines write the manuscripts[18]. The participants completed a general information section including sociodemographic and clinical data, alongside both the Moroccan Arabic module of EORTC QLQ-CR29[18], and the validated Moroccan Arabic version of the QLQ-C30 (version 3.0)[19].

The EORTC QLQ-C30

The EORTC QLQ-C30 includes five functional subscales (i.e., physical functioning, role functioning, emotional functioning, cognitive functioning, and social functioning), three symptom subscales (i.e., fatigue, nausea and vomiting, and pain), a global QoL subscale, and six single symptom items (i.e., dyspnea, insomnia, appetite loss, constipation, diarrhea, and financial difficulties). The scoring of items is on a 1 to 7 and 1 to 4 Likert scales for the global health status/QoL and the other scales. High scores represent better functioning and worse symptoms[20,21].

The EORTC QLQ-CR29

The morocan arabic module of EORTC QLQ-CR29[17], is a colon and rectum site-specific QoL module with 29 items consisting of 4 multi-item scales (body image, urinary frequency, blood and mucus in stool, and stool frequency) and 17 functional/symptomatic single-items (sexual interest, urinary incontinence, dysuria, abdominal pain, buttock pain, bloating, dry mouth, hair loss, taste, flatulence, fecal incontinence, sore skin, embarrassment, stoma care problem, impotence or dyspareunia). Among these items, only body image, anxiety, weight, and sexual interest are functional scales.

The eighteenth item (Q18) is an indicator of colostomy/ileostomy construction, while the following items are separately arranged for patients with a stoma (Q19-Q25) and without (Q19-Q25) according to symptoms of stool frequency, flatulence, fecal incontinence, sore skin and embarrassment while item 25 is specific for stoma care. Sexual interest, impotence and dyspareunia items are categorized according to gender with the corresponding questions being Q26-Q27 and Q28-Q29 for male and female respondents respectively. All questionnaire items ask about the past week except the ones on sexuality, which request the patients to evaluate the past four weeks. As regards the scoring, the multi-item scales and single items are scored using a 1 to 4 point Likert scale (“not at all”, “a little”, “quite a bit”, “very much”) with the highest score representing the best functional status or the worst symptom[22].

Study population and data collection

Patients were prospectively recruited from the national oncology institute during the period between November 2019 and January 2020[23,24]. Patients aged over 18 years old, with pathologically confirmed colon and/or rectum cancer and who underwent surgery at least 6 mo prior to the enrollment in the study were included. Patients were excluded if they were unable to understand the questionnaire, had cognitive and/or medical complications that hindered the interview completion and those who submitted an incomplete questionnaire. Participants were either approached during follow up visits or contacted via telephone. Patient’s characteristics were reported according to age, gender, stoma status, cancer location (colon vs rectum), neoadjuvant radiochemotherapy and adjuvant chemotherapy.

As the sample size determination for psychometric validation studies lacks clear recommendations[25], we determined the required sample by allocating a number of observations 5 to 10 times greater than the variables[26]. Accordingly, the sample needed size ranged between 150 and 300 participants in order to externally validate this version.

Statistical analysis

The scores for the QLQ-CR29 and the QLQ-C30 questionnaires were linearly converted into 0 to 100 point scores according to the standard EORTC guidelines[20]. Descriptive statistics were generated through mean, median, standard deviation, and floor and ceiling effects, while age was categorized in 3 groups: < 40 years ; 41- 65 years and > 65 years.

In order to proceed to the external validation of the Moroccan Arabic module of de QLQ-CR29 we followed the identical steps of a first validation in a totally different population. There are two different levels of reliability, namely internal consistency and reproducibility. Internal consistency reliability was determined using Cronbach’s alpha coefficient with a score greater than 0.7 considered acceptable, above 0.8 was good and higher than 0.9 was considered excellent.

A random subgroup of patients was selected to retake the QLQ CR-29 questionnaire after 7 to 14 d from the first interview in order to examine the test-retest reliability. The results of the two measurements were assessed using the Intraclass correlation coefficient (ICC) and an ICC score of 0.7 or higher was considered acceptable.

We tested the construct validity of the EORTC QLQ-CR29 using multitrait scaling analysis[27]. Convergent validity was examined by correlating each item with its own scale with an item-scale correlation of ≥ 0.40 equivalent to high correlation. Divergent validity on the other hand was tested by demonstrating that the item correlated higher with its own scale than with the others.

Concurrent validity was examined by comparing the scores of the QLQ-CR29 and the QLQ-C30 using Pearson’s correlation.

Clinical validity was assessed using known group comparison through the Mann Whitney U test to examine the QLQ-CR29’ ability to differentiate clinically distinct patients. Subgroups were categorized according to: Age (< 65 years vs ≥ 65 years ), gender (male vs female), stoma status (permanent vs no stoma), tumor site (colon vs rectal ) and neoadjuvant radiotherapy (no vs yes). All statistical analyses were performed using SPSS 26.0 (SPSS Inc., Chicago,IL, United States). Statistically significant results were defined with a P < 0.05.

RESULTS
Patients characteristics

The sociodemographic and clinical characteristics of the patients enrolled in the study are detailed in Table 1. In total, 221 of 250 (88,4%) patients completed the questionnaire among which 123 were males and 98 were females. The mean age of our patients was 55.6 ±12.7years. Seventy-eight (35.9%) participants had colonic cancer and 138 (64.1%) had rectal cancer of wich 89 ( 64%) received neoadjuvant chemoradiotherapy, while 50 patients had a stoma (22,6%). Missing items were only associated with sexual problems with a miss rate of 9% for males and 23% for females.

Table 1 Patients clinical and demographic characteristics.
Variables
Description
Age, mean ± SD55.65 ± 12.87
Sex
    Female98 (44.5%)
    Male123 (55.5%)
Tumor location
    Colon78 (35%)
    Rectum139 (62%)
Neoadjuvant chemoradiotherapy
    No107 (54,6%)
    Yes89 (45,5%)
Definitive stoma
    No50 (22.6%)
    Yes171 (77.4%)
Adjuvant chemotherapya
    Yes91 (70%)
    No39 (30%)

Table 2 summarizes the distribution of the EORTC QLQ CR-29 and QLQ-C30 scores. The mean score for the different dimensions of the QLQ CR-29 ranged from 16.44 to 75.56 with the items “Hair loss” and “Weight” scoring the lowest and highest respectively. The percentage of respondents at floor was high (> 50%) in 12 areas while the percentage of respondents at ceiling was high (> 50%) in 1 item. The range of scores was broad in 21 dimensions except for the bag change it ranged from 0 to 83.

Table 2 Quality of life scores according to European Organization for Research and Treatment of Cancer Quality of Life Questionnaire-C30 and Quality of Life Questionnaire-CR29 structure and reliability.
Scaling/single-item name
n
Item No.
Mean
SD
Floor
Ceiling
Range
ICC
EORTC QLQ-CR29
All patients 221
Urinary frequency31.3239.8933.4626.210.90-1000.961
Blood & mucus in stool38.3924.7329.0243.44.10-1000.969
(F) Body image45-4777.8224.831.8380-1000.950
Defecation/stoma problems49–54-----
Urinary incontinence3320.9632.2264.77.20-1000.982
Dysuria3420.6631.3063.36.80-1000.950
Abdominal pain3530.6134.12488.60-1000.922
Buttock pain3627.1434.6255.790-1000.921
Bloated feeling3728.8033.7750.28.60-1000.945
Dry mouth4024.5834.1460.28.60-1000.979
Hair loss4116.4429.5771.55.90-1000.968
Trouble with taste4220.5132.8967.08.10-1000.975
(F) Anxiety4364.6737.6016.743.40-1000.951
(F) Weight4475.5632.668.156.60-1000.960
Patients with stoma50
Flatulence49s41.4933.0028.610.20-1000.908
Leakage50 s42.1736.4932.716.30-1000.889
Sore skin around stoma51s42.8538.4934.520.40-1000.965
Bags change52.53 s18.3622.624920-830.969
Embarrassed54s45.5643.0941.829.10-1000.956
Stoma care pb55s40.0841.4746.821.50-1000.912
Stoma pb49-54s37.4120.184.14.10-1000.999
Patients without stoma172
Flatulence4930.6237.0152.912.80-1000.980
Faecal incontinence5026.1637.3861.614.00-1000.970
Sore skin around anus5120.3431.7264.57.60-1000.979
Stool frequency52.5329.6532.3338.47.60-1000.977
Embarrassment5431.2038.5154.715.10-1000.975
Defecation pb49-5428.7925.8416.10.70-1000.969
Male 123
Sexual functioning5642.8537.813320.50-1000.928
Impotence5738.1838.7940.9200-1000.966
Female 98
Sexual functioning 5867.0636.7611.948.80-1000.933
Dyspareunia5926.5835.7558.310.70-1000.985
C30221
Physical function1 - 573.6423.850.923.90-100-
Role function6.762.9237.0013.339.00-100-
Emotional function21-2467.2430.774.130.70-100-
Cognitive function20. 2583.9423.450.558.30-100-
Social function26 . 2779.5828.933.757.30-100-
Fatigue10.12.1830.9829.1727.12.80-100-
Nausea and vomiting14.157.7917.1678.00.50-83-
Pain9.1924.3129.7246.83.70-100-
Dyspnoea821.1030.5962.44.60-100-
Insomnia1127.6735.2556.49.20-100-
Appetite loss1320.4830.9963.36.40-100-
Constipation1627.5233.9753.81.40-100-
Diarrhea1727.6734.6753.210.60-100-
Financial difficulties2851.2240.6130.730.70-100-
Reliability

The internal consistency of the EORTC QLQ-CR29 reached the 0.7 criterion showing good consistency for the urinary frequency scale (0.79) and stool frequency scale (0.83), while for the blood and mucus (0.615) and the body image (0.672) scales the alpha Cronbach coefficient was slightly below the criterion (0.7). The Cronbach’s alpha coefficient was higher for patients without stoma compared to those with stoma, except for the body image scale (0.64 with vs 0.69 without) which indicates higher reliability for patients without a stoma. More details are shown in Table 3.

Table 3 Convergent and discriminant validity of the European Organization for Research and Treatment of Cancer Quality of Life Questionnaire-CR29.
QLQ-CR29 scalesTotal sample (n = 221)
Patients without stoma (n = 50)
Patients with stoma (n = 171)
Convergent
Discriminant
α
Convergent
Discriminant
α
Convergent
Discriminant
α
Urinary frequency0.905-0.907-0.00-0.250.7950.83-0.84-0.00-0.210.660.91-0.92-0.12-0.250.82
Blood or mucus in stool0.74-0.89-0.27-0.350.6150.62-0.96-0.44-0.350.5810.79-0.87-0.20-0.300.65
Body image-0.66-0.75-0.00-0.360.672-0.51-0.89-0.20-0.390.690-0.63-0.72-0.07-0.190.64
Stool frequency0.83-0.96-0.30-0.390.83510.83-0.96-0.31-0.390.804-0.85-0.91-0.14-0.340.87

Thirty four patients took the Arabic version of the QLQ-CR29 and for each item, the ICCs ranged from 0.889 to 0.999 indicating good to excellent reproducibility.

Construct validity

All items exceeded the 0.40 criterion for item-scale convergent validity. Similarly, items correlated better with their own scales than with others which shows good divergent validity. Details of the multitrait scaling analysis are shown in Table 3.

Concurrent validity

Correlations between the scales of the QLQ-CR29 and QLQ-C30 were low (r < 0.40). However, some areas with more related content showed higher correlations (r > 0.40), namely body image and social functioning. The abdominal pain scale also had a good correlation with the QLQ-C30 pain scale and stoma care problems were correlated to the global QoL scale. In addition, most functional scales of the QLQ-CR29 were positively correlated with functional scales of the QLQ-C30 and negatively correlated with symptom scales of the QLQ-C30, while most symptom scales of the QLQ-CR29 were positively correlated with symptom scales of the QLQ-C30 and negatively correlated with functional scales of the QLQ-C30 as detailed in Table 4.

Table 4 Correlation between the Quality of Life Questionnaire-CR29 and the Quality of Life Questionnaire-C30.

EORTC QLQ C30
CR-29Functional scalesSymptom scales
Scales/Single itemsQoLPFRFEFCFSFFANVPADYSLAPCODIFI
Functional scales
Body image0.29420.27920.37020.21420.24420.4032-0.2982-0.2562-0.1611-0.2502-0.1511-0.2782-0.2212-0.003-0.079
Anxiety0.29720.31420.26420.31520.27320.2852-0.2942-0.1601-0.2102-0.1691-0.1381-0.117-0.029-0.008-0.1671
Sexual function: Male-0.121-0.133-0.058-0.011-0.034-0.1110.009-0.0100.0840.0890.1240.1090.0490.0490.018
Sexual function: Female-0.2992-0.192-0.115-0.079-0.25610.0400.082-0.0330.2211-0.0010.23010.0400.0170.1120.033
Symptom scales
Urinary frequency-0.1371-0.2472-0.2012-0.2372-0.0890.0290.24420.0700.21820.23020.17620.16510.0420.22120.122
Blood and mucus in stool-0.2412-0.2832-0.2692-0.1902-0.110-0.1230.35920.21520.34920.19020.27720.26820.15210.30220.2562
Urinary incontinence-0.009-0.128-0.060-0.2372-0.1521-0.0500.1020.0140.1080.15010.19520.0300.13510.0320.044
Dysuria-0.017-0.103-0.1611-0.069-0.065-0.0470.15310.0120.17210.0580.13310.0860.0910.1000.025
Abdominal pain-0.1381-0.1611-0.099-0.125-0.099-0.0550.23220.14310.44320.14010.25420.1220.16810.107-0.039
Buttock pain-0.2122-0.2652-0.2702-0.103-0.098-0.0740.36320.14910.46920.19420.25320.19020.0250.14910.2802
Bloated feeling-0.2062-0.2132-0.1381-0.2132-0.1451-0.0840.29220.17110.37720.25620.38020.0580.25320.0400.073
Dry mouth-0.3092-0.3412-0.2572-0.2662-0.2832-0.1250.34020.39020.20520.20220.14110.32920.21120.14510.113
Hair loss-0.036-0.1952-0.1331-0.3372-0.2422-0.1310.18320.21720.0840.0800.14110.18220.20020.13510.033
Trouble with taste-0.099-0.2472-0.2362-0.1341-0.1731-0.1250.24320.34320.0360.20220.0100.27120.17310.1010.072
Weight0.17620.28020.29120.15710.1210.1792-0.2382-0.128-0.081-0.060-0.1431-0.1651-0.1691-0.083-0.017
Flatulences0.124-0.0230.139-0.126-0.180-0.2600.0770.056-0.0620.2620.0420.0650.1310.1470.117
Leakage0.0830.1420.046-0.271-0.128-0.1460.0330.059-0.0230.114-0.0040.0930.0290.1270.240
Sore skin around stoma-0.041-0.1900.025-0.6002-0.4022-0.33010.29510.2610.29710.2470.38020.0730.1720.0020.133
Bags changes-0.085-0.1690.002-0.4042-0.025-0.2730.228-0.0180.1550.2180.34410.192-0.0030.019-0.098
Embarrassment-0.4072-0.3122-0.3942-0.2721-0.150-0.1640.47620.1550.41920.32520.35320.156-0.0790.0300.3612
Stoma care problems-0.5022-0.3912-0.4582-0.2771-0.182-0.22810.52920.23910.58720.32820.46820.23910.093-0.0640.3432
Stoma problems-0.077-0.142-0.009-0.5802-0.277-0.36410.33610.1080.1810.2640.30110.1380.1040.1790.139
Flatulences-0.1601-0.1511-0.034-0.149-0.137-0.1120.1440.0320.17710.26920.1731-0.0030.0080.25220.2002
Faecal incontinence-0.036-0.081-0.040-0.142-0.122-0.1170.15310.0840.19010.1410.111-0.017-0.1400.40320.2032
Sore skin around anus-0.081-0.012-0.045-0.057-0.047-0.1020.0490.1130.0860.1210.0270.027-0.0060.1490.1951
Stool frequency0.002-0.019-0.024-0.0710.0020.0240.083-0.0440.25920.0920.1230.004-0.0350.45220.1891
Embarrassment-0.101-0.133-0.135-0.2072-0.1671-0.20820.17810.1410.1490.27620.15210.0620.1460.22420.2032
Defecation-0.111-0.116-0.038-0.2021-0.159-0.17310.19010.1570.28020.31620.18110.0400.1060.37920.2902
Impotence0.019-0.065-0.149-0.104-0.170-0.21810.0750.2431-0.1040.31320.0650.30820.1750.0080.064
Dyspareunia-0.083-0.096-0.118-0.174-0.2431-0.34520.1080.0250.26010.1630.1620.1560.0450.1570.2361
Clinical validity

The EORTC QLQ-CR29 allowed the distinction between patients based on differences between known groups (Tables 5 and 6).

Table 5 Known-group comparisons.

Stoma status
Colon vs Rectum
Neoadjuvant radiochemotherapy
CR-29 scales/single itemsYes (n = 50)No (n = 171)P valueColon (n = 78)Rectum (n = 139)P valueYes (n = 89)No (n = 107)P value
Urinary frequency35.6 (41.1)41.1 (34.6)0.41235.4 (31.2)42.2 (34.8)0.21545.5 (33.9)35.0 (32.2)0.031
Blood and mucus in stool27.6 (28.8)23.8 (29.1)0.24720.2 (26.8)27.4 (30.2)0.08629.9 (30.3)19.3 (27.1)0.004
Body image66.6 (27.5)81.1 (23.0)0.00077.4 (24.8)77.7 (25.0)0.93877.6 (24.1)78.9 (24.5)0.625
Urinary incontinence24.0 (35.0)20.0 (31.4)0.45118.3 (28.7)21.5 (33.0)0.78820.2 (32.0)21.4 (32.1)0.592
Dysuria21.3 (29.1)20.4 (31.9)0.46918.8 (30.6)22.3 (31.9)0.12023.2 (32.3)18.3 (29.7)0.299
Abdominal pain28.0 (32.5)31.3 (34.6)0.59028.6 (34.2)32.1 (34.3)0.44034.4 (34.6)26.7 (33.4)0.095
Buttock pain28.6 (33.6)26.7 (34.9)0.56317.0 (30.2632.3 (36.1)0.00138.5 (36.2)14.3 (27.5)0.000
Bloated feeling30.6 (33.5)28.2 (33.9)0.54527.7 (32.4)29.0 (34.2)0.89235.2 (35.6)23.6 (31.7)0.017
Dry mouth30.0 (36.4)23.0 (33.4)0.18320.5 (29.0)26.6 (36.5)0.47730.7 (38.3)19.0 (28.9)0.055
Hair loss17.3 (28.7)16.1 (29.1)0.60810.6 (24.9)19.4 (31.5)0.02718.7 (30.1)14.6 (28.6)0.222
Trouble with taste27.3 (36.0)18.5 (31.7)0.06913.2 (27.5)24.4 (35.1)0.01620.5 (31.1)17.7 (31.8)0.375
Anxiety52.6 (40.4)67.8 (36.1)0.01663.2 (37.8)65.4 (37.0)0.65865.9 (36.5)63.5 (38.4)0.725
Weight69.3 (38.6)77.3 (30.6)0.30579.4 (30.4)73.8 (33.2)0.19475.6 (30.4)76.3 (33.9)0.492
Flatulence45.8 (31.9)39.3 (32.7)0.60135.0 (34.1)45.6 (33.7)0.361
Leakage45.8 (31.9)40.4 (38.8)0.55842.1 (39.8)45.6 (31.8)0.705
Sore skin around stoma39.5 (32.7)44.4 (41.3)0.74850.8 (43.5)43.8 (33.4)0.598
Bags changes21.8 (27.0)16.6 (20.4)0.58417.5 (19.6)26.3 (27.3)0.351
Embarrassment64.5 (28.46)40.7 (44.9)0.05656.3 (46.3)36.9 (39.8)0.055
Stoma care problems37.5 (38.2)40.7 (42.5)0.80454.0 (42.1)23.4 (36.7)0.003
Stoma problems39.9 (17.1)36.1 (21.6)0.49937.1 (23.4)41.8 (16.4)0.387
Flatulences21.5 (33.6)34.5 (37.3)0.01743.8 (39.1)19.6 (31.8)0.000
Faecal incontinence16.12 (30.6)31.4 (39.5)0.00935.7 (41.0)17.0 (31.5)0.001
Sore skin around anus11.8 (24.2)25.1 (34.6)0.01229.5 (36.1)13.6 (26.0)0.002
Stool frequency19.3 (26.8)35.8 (34.2)0.00237.6 (36.1)21.5 (26.8)0.008
Embarrassment23.1 (35.4)34.9 (39.1)0.05340.4 (39.2)23.4 (35.7)0.004
Defecation pb18.8 (21.5)36.5 (36.5)0.00037.8 (27.4)19.5 (21.0)0.000
(F) Sexual function: Male54.1 (39.1)39.7 (37.1)0.16232.4 (32.4)48.1 (39.4)0.04746.3 (39.4)36.0 (32.8)0.211
Impotence47.2 (39.2)35.6 (38.5)0.02131.5 (34.6)41.6 (40.6)0.24843.9 (39.2)33.3 (36.8)0.167
Sexual function: Female56.8 (38.6)69.6 (36.1)0.06465.4 (33.3)66.6 (39.6)0.77069.4 (35.9)70.0 (35.2)0.928
Dyspareunia33.3 (39.1)24.8 (34.9)0.15620.23 (33.1)29.4 (37.1)0.24026.8 (32.6)23.3 (35.5)0.459
Table 6 Known-group comparisons, P < 0.0001.

Gender
Age
CR-29 scales/single ItemsMale (n = 123)Female (n = 98)P value≤ 40 (n = 26)41-65 (n = 144)≥ 66 (n = 45)P value
Urinary frequency39.7 (33.1)40.1 (34.1)0.86228.2 (30.4)42.4 (33.3)38.1 (34.1)0.115
Blood and mucus in stool24.6 (27.8)24.8 (30.5)0.79425.6 (29.5)26.7 (29.4)19.2 (27.5)0.183
Body image77.4 (25.0)78.3 (24.7)0.77774.3 (23.2)76.6 (26.1)80.7 (21.8)0.481
Urinary incontinence19.5 (31.9)22.7 (32.6)0.38519.2 (28.5)19.6 (32.3)26.6 (33.0)0.273
Dysuria23.3 (32.2)17.3 (29.9)0.10123.0 (36.2)20.8 (31.5)20.7 (29.5)0.978
Abdominal pain27.6 (33.5)34.3 (34.6)0.17232.0 (34.6)31.9 (35.2)26.6 (29.8)0.772
Buttock pain28.1 (34.9)25.8 (34.3)0.47832.0 (34.6)27.7 (36.1)22.2 (30.1)0.500
Bloated feeling27.3 (32.8)30.6 (35.0)0.49526.9 (32.6)31.9 (35.0)22.9 (30.8)0.293
Dry mouth17.3 (28.7)33.6 (38.1)0.00123.0 (33.6)24.7 (33.8)25.1 (36.3)0.967
Hair loss8.6 (21.7)26.2 (34.9)0.00012.8 (28.4)19.6 (32.3)10.3 (19.8)0.228
Trouble with taste16.8 (31.4)25.1 (34.2)0.04030.7 (38.7)20.6 (33.4)14.8 (27.1)0.282
Anxiety69.6 (34.9)57.8 (39.9)0.03265.3 (38.2)60.1 (38.2)73.3 (34.5)0.116
Weight75.3 (33.3)75.8 (32.0)0.92075.6 (30.6)74.5 (33.6)77.0 (31.6)0.933
Flatulence43.6 (32.2)38.3 (34.6)0.56638.8 (32.7)44.7 (33.2)33.3 (36.5)0.667
Leakage47.1 (36.2)35.0 (36.6)0.24161.1 (44.3)41.9 (34.6)27.7 (38.9)0.299
Sore skin around stoma44.8 (39.1)40.0 (38.3)0.65066.6 (42.1)42.8 (37.5)33.3 (36.5)0.287
Bags changes20.1 (22.4)15.8 (23.2)0.42722.2 (25.0)20.9 (23.6)5.5 (8.6)0.328
Embarrassment46.3 (42.4)44.4 (44.6)0.68051.8 (50.3)51.3 (41.8)31.4 (40.3)0.230
Stoma care problems42.7 (43.1)36.3 (39.4)0.48166.6 (50.0)40.9 (40.2)29.6 (37.7)0.093
Stoma problems39.8 (20.0)33.8 (20.3)0.33648.1 (31.7)38.8 (16.9)23.1 (20.9)0.183
Flatulences29.0 (38.5)32.4 (35.2)0.45236.6 (41.7)33.6 (37.8)20.5 (31.1)0.142
Faecal incontinence23.4 (35.8)29.4 (39.1)0.39140.0 (44.0)28.7 (38.3)14.5 (28.4)0.050
Sore skin around anus17.3 (29.6)23.9 (33.9)0.30026.6 (36.8)21.7 (32.8)12.8 (24.9)0.266
Stool frequency27.8 (30.2)31.8 (34.7)0.83635.8 (34.7)33.0 (33.7)18.3 (25.0)0.029
Embarrassment27.3 (36.5)35.8 (40.4)0.17941.6 (38.8)36.0 (40.8)14.5 (26.2)0.005
Defecation pb26.9 (25.3)30.9 (26.4)0.49937.5 (33.0)30.3 (25.5)17.5 (19.0)0.032
Sexual function: Male33.3 (36.9)42.7 (37.8)45.8 (36.5)0.575
Impotence48.7 (44.3)35.2 (38.5)42.0 (35.1)0.465
Sexual function: Female57.5 (36.7)63.5 (37.7)82.3 (31.4)0.109
Dyspareunia33.3 (36.5)27.6 (36.8)9.8 (22.8)0.098

Differences in the scores of patients with stoma were noted as they presented significantly more anxiety and body image issues. Males with stoma reported higher symptom scores for the “impotence” scale.

The participants with rectal cancer had worse QoL than those with colon cancer and male patients with rectal cancer had significantly higher symptom scores for flatulence, fecal incontinence, sore skin around the anus, stool frequency, defecation problems, and sexual dysfunction.

In addition, patients who received neoadjuvant radiotherapy had significantly higher symptom scores and more problems related to blood and mucus, buttock pain, bloating, stoma care problems, flatulence, fecal incontinence, sore skin, stool frequency, embarrassment and defecation problems.

Furthermore, the QLQ-CR29 showed differences between age groups with younger patients found to suffer more from defecation problems, stool frequency and embarrassment.

DISCUSSION

HRQL in CRC is an important component in both day to day practice and clinical research, therefore the proper assessment of patients’ HRQOL is crucial[28]. This study showed that the Arabic version of the EORTC QLQ-CR29 questionnaire has good internal consistency, test-retest reliability and validity and is therefore valid and reliable to assess the QoL of Moroccan CRC patients.

The internal consistency of the Arabic EORTC QLQ CR-29 demonstrated satisfactory results for the urinary frequency scale and stool frequency scale, with higher reliability scores for patients without a stoma which is similar to the Chinese validation[14]. As regards the blood and mucus and the body image scales, the alpha Cronbach coefficients were acceptable which was the case in other similar studies[12,29]. On the other hand, as suggested by Arraras et al[12], some differences may be due to the fact that the EORTC original validation was conducted on an international sample with high variance, while the Spanish validation concerned a more homogenous sample which may impact the alpha Cronbach coefficient.

The ICCs of our study were all greater than 0.8, thus indicating good to excellent reproducibility for both single item and multi-item scales. The Reliability coefficients were higher in our study than those reported by the Dutch validation[10] and mostly similar to those in the original psychometric validation study[8]. As such, the Moroccan Arabic translation of the QLQ CR-29 is a stable instrument.

The multitrait analysis confirmed the structure of all scales, which proves that the Moroccan Arabic translation of the QLQ-CR29 has a valid construct.

In the assessment of concurrent validity, correlations between the scales of the QLQ-C30 and the QLQ CR-29 were mostly low (< 0.4) indicating that the two questionnaires measure different concepts. Few areas with related content had higher correlation scores which was expected given the similar concepts of these particular scales. Nonetheless, the results show that the two questionnaires are independent.

In terms of clinical validity, we found less significant differences related to stoma status than the original study[8]. Moreover, patients with colon cancer had a better function and fewer symptoms, including sexual interest in males and stool frequency as opposed to rectal cancer. Interestingly, patients with rectal cancer and a stoma experienced more embarrassment with borderline significance (P = 0.053). When comparing age groups, younger patients reported worse symptoms than older patients[30]. Similar results were reported by the Dutch and Spanish Validation studies[10,12]. In addition, the particularities of the Moroccan population may be contributing to elderly patients' display of better resilience, QoL satisfaction, relatively better acceptance and the aforementioned results. Consequently, the QLQ-CR29 was found to discriminate between age groups.

A higher missing data rate was registered for sexual dimensions compared to others as patients were more reticent about answering sex-related questions which makes their interpretation more difficult. Similar observations were made in the Chinese and Iranian studies, which hindered discussions regarding sexual activity and even ostomy[14,16]. Nonetheless, providing explanations to patients when answering the questionnaire was noted to help. In our context, this issue may be explained by the cultural and religious particularities of the Moroccan population where sexual practices are taboo[31]. More studies addressing this problem should be conducted to determine the reliability and validity of the CR-29 in evaluating the sexual aspects of QoL for patients according to cultural contexts.

This study has some limitations, one of which is the limited sample size of patients. However, the minimum sample size was set at one hundred and fifty patients according to EORTC organization and other EORTC QLQ-CR29 validations were performed on a smaller population such as El Alami’s research[18]. Self-administration was not possible due to the high level of illiteracy in our context; consequently, patients received the help of one of the investigators who was in charge of reading the questions and different options for the answer. Furthermore, although the use of confirmatory factor analysis may be an option, multitrait scaling analysis is the most frequently used method for the EORTC tools’ transcultural validations[21]. Notwithstanding the foregoing, this study clearly validate the Moroccan Arabic validation of the EORTC QLQ-CR29 questionnaire which will allow the correct evaluation of HRQOL of CRC patients.

CONCLUSION

To summarize, the psychometric properties of the Moroccan Arabic version of the EORTC QLQ CR-29 show that it’s a reliable and valid instrument to measure the QoL of CRC patients and could be used to complement the EORTC QLQ-C30 in assessing HRQOL. Conducting more transcultural validations and standardizing patient-reported outcome questionnaires, especially in the field of oncology, will allow us to broadly assess cancer therapy outcomes and weigh the benefits against the QoL impact.

ARTICLE HIGHLIGHTS
Research background

Health-related quality of life is an abstract and multidimensional concept which can be assessed by the European Organization for Research and Treatment of Cancer (EORTC) questionnaires. Core measurement tools examine issues common to different cancer sites and can be used as a stand-alone questionnaire or in combination with disease specific modules.

Research motivation

The EORTC Quality of Life Questionnaire (QLQ) CR29 questionnaire specific to colorectal cancer (CRC) and its psychometric properties have been tested in several languages and contexts. Recently, The QLQ-CR29 has just been only translated for Moroccan Arabic dialect. However this adaptation was performed on a very limited sample size of 120 patients under the usual requests of the EORTC organization.

Research objectives

The aim of this study is to externally validate this version and assess its psychometric properties on larger Moroccan CRC patients.

Research methods

In order to externally validate the QLQ CR-29, Both Moroccan Arabic modules of QLQ CR-29 and QLQ C-30 were administered to Moroccan colorectal cancer (CRC). Psychometric properties were retested by measuring Cronbach’s alpha coefficient for reliability and Intraclass correlation coefficient (ICC) to examine test-retest reproducibility. The multitrait-scaling analysis was performed to demonstrate the validity of the instrument and known-groups comparison was used to test the score’s ability to discriminate between different groups of patients. All statistical analyses were performed using SPSS 26.0 (SPSS Inc., Chicago,IL, USA). Statistically significant results were defined with a P < 0.05.

Research results

In total, 221 patients were included in the study and 34 patients completed the questionnaire twice. The urinary Frequency scale and Stool Frequency scale had good internal consistency with alpha Cronbach coefficients of 0.79 and 0.83 respectively, while the same coefficients were moderately lower for the Blood and Mucus in Stool scale (0.61) and the Body Image scale (0.67). The ICCs ranged from 0.88 to 1 indicating good to excellent reproducibility. In multitrait scaling analyses, the criterion for item convergent and divergent validity was satisfactory. The known-group comparison showed statistically significant differences between patients according to age, gender, stoma status, tumor location, and radiotherapy.

Research conclusions

The Moroccan Arabic version of the EORTC QLQ-CR29 is a valid and reliable tool that can be used safely for research and clinical purposes in Moroccan CRC patients.

Research perspectives

This tool can safely be used in research and clinical purpose and can be also used in the validation of other patient-reported outcome measure tools.

Footnotes

Provenance and peer review: Invited article; Externally peer reviewed.

Peer-review model: Single blind

Specialty type: Medical laboratory technology

Country/Territory of origin: Morocco

Peer-review report’s scientific quality classification

Grade A (Excellent): A

Grade B (Very good): 0

Grade C (Good): C, C

Grade D (Fair): 0

Grade E (Poor): 0

P-Reviewer: Batyrbekov K, Kazakhstan; Hu B, China; Yeo SG, South Korea S-Editor: Lin C L-Editor: A P-Editor: Yu HG

References
1.  Guren MG. The global challenge of colorectal cancer. Lancet Gastroenterol Hepatol. 2019;4:894-895.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 28]  [Cited by in F6Publishing: 22]  [Article Influence: 4.4]  [Reference Citation Analysis (0)]
2.  Rawla P, Sunkara T, Barsouk A. Epidemiology of colorectal cancer: incidence, mortality, survival, and risk factors. Prz Gastroenterol. 2019;14:89-103.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 444]  [Cited by in F6Publishing: 806]  [Article Influence: 161.2]  [Reference Citation Analysis (0)]
3.  Bevan R, Rutter MD. Colorectal Cancer Screening-Who, How, and When? Clin Endosc. 2018;51:37-49.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 62]  [Cited by in F6Publishing: 60]  [Article Influence: 10.0]  [Reference Citation Analysis (0)]
4.  Ratjen I, Schafmayer C, Enderle J, di Giuseppe R, Waniek S, Koch M, Burmeister G, Nöthlings U, Hampe J, Schlesinger S, Lieb W. Health-related quality of life in long-term survivors of colorectal cancer and its association with all-cause mortality: a German cohort study. BMC Cancer. 2018;18:1156.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 45]  [Cited by in F6Publishing: 57]  [Article Influence: 9.5]  [Reference Citation Analysis (0)]
5.  Sharour LA, Omari OA, Salameh AB, Yehia D. Health-related quality of life among patients with colorectal cancer. J Res Nurs. 2020;25:114-125.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 3]  [Cited by in F6Publishing: 10]  [Article Influence: 2.0]  [Reference Citation Analysis (0)]
6.  Evans DR. Enhancing quality of life in the population at large. Soc Indic Res. 1994;33:47-88.  [PubMed]  [DOI]  [Cited in This Article: ]
7.  van de Poll-Franse L, Oerlemans S, Bredart A, Kyriakou C, Sztankay M, Pallua S, Daniëls L, Creutzberg CL, Cocks K, Malak S, Caocci G, Molica S, Chie W, Efficace F; EORTC Quality of Life Group. International development of four EORTC disease-specific quality of life questionnaires for patients with Hodgkin lymphoma, high- and low-grade non-Hodgkin lymphoma and chronic lymphocytic leukaemia. Qual Life Res. 2018;27:333-345.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 22]  [Cited by in F6Publishing: 29]  [Article Influence: 4.1]  [Reference Citation Analysis (0)]
8.  Whistance RN, Conroy T, Chie W, Costantini A, Sezer O, Koller M, Johnson CD, Pilkington SA, Arraras J, Ben-Josef E, Pullyblank AM, Fayers P, Blazeby JM; European Organisation for the Research and Treatment of Cancer Quality of Life Group. Clinical and psychometric validation of the EORTC QLQ-CR29 questionnaire module to assess health-related quality of life in patients with colorectal cancer. Eur J Cancer. 2009;45:3017-3026.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 217]  [Cited by in F6Publishing: 258]  [Article Influence: 17.2]  [Reference Citation Analysis (0)]
9.  Ihn MH, Lee SM, Son IT, Park JT, Oh HK, Kim DW, Kang SB. Cultural adaptation and validation of the Korean version of the EORTC QLQ-CR29 in patients with colorectal cancer. Support Care Cancer. 2015;23:3493-3501.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 9]  [Cited by in F6Publishing: 10]  [Article Influence: 1.1]  [Reference Citation Analysis (0)]
10.  Stiggelbout AM, Kunneman M, Baas-Thijssen MC, Neijenhuis PA, Loor AK, Jägers S, Vree R, Marijnen CA, Pieterse AH. The EORTC QLQ-CR29 quality of life questionnaire for colorectal cancer: validation of the Dutch version. Qual Life Res. 2016;25:1853-1858.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 29]  [Cited by in F6Publishing: 36]  [Article Influence: 4.0]  [Reference Citation Analysis (0)]
11.  Sanna B, Bereza K, Paradowska D, Kucharska E, Tomaszewska IM, Dudkiewicz Z, Golec J, Bottomley A, Tomaszewski KA. A large scale prospective clinical and psychometric validation of the EORTC colorectal (QLQ-CR29) module in Polish patients with colorectal cancer. Eur J Cancer Care (Engl). 2017;26.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 1]  [Cited by in F6Publishing: 1]  [Article Influence: 0.1]  [Reference Citation Analysis (0)]
12.  Arraras JI, Suárez J, Arias de la Vega F, Vera R, Asín G, Arrazubi V, Rico M, Teijeira L, Azparren J. The EORTC Quality of Life questionnaire for patients with colorectal cancer: EORTC QLQ-CR29 validation study for Spanish patients. Clin Transl Oncol. 2011;13:50-56.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 27]  [Cited by in F6Publishing: 31]  [Article Influence: 2.4]  [Reference Citation Analysis (0)]
13.  Shen MH, Chen LP, Ho TF, Shih YY, Huang CS, Chie WC, Huang CC. Validation of the Taiwan Chinese version of the EORTC QLQ-CR29 to assess quality of life in colorectal cancer patients. BMC Cancer. 2018;18:353.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 4]  [Cited by in F6Publishing: 9]  [Article Influence: 1.5]  [Reference Citation Analysis (0)]
14.  Lin JB, Zhang L, Wu DW, Xi ZH, Wang XJ, Lin YS, Fujiwara W, Tian JR, Wang M, Peng P, Guo A, Yang Z, Luo L, Jiang LY, Li QQ, Zhang XY, Zhang YF, Xu HW, Yang B, Li XL, Lei YX. Validation of the chinese version of the EORTC QLQ-CR29 in patients with colorectal cancer. World J Gastroenterol. 2017;23:1891-1898.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in CrossRef: 10]  [Cited by in F6Publishing: 9]  [Article Influence: 1.3]  [Reference Citation Analysis (0)]
15.  Magaji BA, Moy FM, Roslani AC, Law CW, Raduan F, Sagap I. Psychometric Validation of the Bahasa Malaysia Version of the EORTC QLQ-CR29. Asian Pac J Cancer Prev. 2015;16:8101-8105.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 3]  [Cited by in F6Publishing: 4]  [Article Influence: 0.5]  [Reference Citation Analysis (0)]
16.  Montazeri A, Emami A-H, Sadighi S, Mohagheghi M-A, Sedighi Z.   Psychometric properties of the Iranian version of colorectal cancer specific quality of life questionnaire (EORTC QLQ-CR29). Basic Clin Cancer Res9 32-41.  [PubMed]  [DOI]  [Cited in This Article: ]
17.  Cuschieri S. The STROBE guidelines. Saudi J Anaesth. 2019;13:S31-S34..  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 387]  [Cited by in F6Publishing: 1059]  [Article Influence: 211.8]  [Reference Citation Analysis (0)]
18.  Yacir EA, Hadj OM, Hafid H, Said B. Cultural Adaptation and Validation of the Moroccan Version of the EORTC QLQ-CR29 in Patients with Colorectal Cancer. Asian Pac J Cancer Prev. 2022;23:1379-1385.  [PubMed]  [DOI]  [Cited in This Article: ]  [Reference Citation Analysis (1)]
19.  Nejjari C, El Fakir S, Bendahhou K, El Rhazi K, Abda N, Zidouh A, Benider A, Errihani H, Bekkali R. Translation and validation of European organization for research and treatment of cancer quality of life Questionnaire -C30 into Moroccan version for cancer patients in Morocco. BMC Res Notes. 2014;7:228.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 31]  [Cited by in F6Publishing: 38]  [Article Influence: 3.8]  [Reference Citation Analysis (0)]
20.  Fayers PM, Aaronson NK, Bjordal K, Groenvold M, Curran D, Bottomley A.   On behalf of the European Organisation for Research and Treatment of Cancer quality of life study group. In: The EORTC QLQ-C30 Scoring Manual. 3rd ed. Brussels: EORTC, 2001..  [PubMed]  [DOI]  [Cited in This Article: ]
21.  El Alami Y, Essangri H, Majbar MA, Boutayeb S, Benamr S, El Malki HO, Souadka A. Psychometric validation of the Moroccan version of the EORTC QLQ-C30 in colorectal Cancer patients: cross-sectional study and systematic literature review. BMC Cancer. 2021;21:99.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 3]  [Cited by in F6Publishing: 3]  [Article Influence: 1.0]  [Reference Citation Analysis (0)]
22.  Gujral S, Conroy T, Fleissner C, Sezer O, King PM, Avery KN, Sylvester P, Koller M, Sprangers MA, Blazeby JM; European Organisation for Research and Treatment of Cancer Quality of Life Group. Assessing quality of life in patients with colorectal cancer: an update of the EORTC quality of life questionnaire. Eur J Cancer. 2007;43:1564-1573.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 110]  [Cited by in F6Publishing: 122]  [Article Influence: 7.2]  [Reference Citation Analysis (0)]
23.  Souadka A, Benkabbou A, Al Ahmadi B, Boutayeb S, Majbar MA. Preparing African anticancer centres in the COVID-19 outbreak. Lancet Oncol. 2020;21:e237.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 19]  [Cited by in F6Publishing: 19]  [Article Influence: 4.8]  [Reference Citation Analysis (0)]
24.  Souadka A, Essangri H, Benkabbou A, Amrani L, Majbar MA. COVID-19 and Healthcare worker's families: behind the scenes of frontline response. EClinicalMedicine. 2020;23:100373.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 33]  [Cited by in F6Publishing: 33]  [Article Influence: 8.3]  [Reference Citation Analysis (0)]
25.  Anthoine E, Moret L, Regnault A, Sébille V, Hardouin JB. Sample size used to validate a scale: a review of publications on newly-developed patient reported outcomes measures. Health Qual Life Outcomes. 2014;12:176.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 372]  [Cited by in F6Publishing: 507]  [Article Influence: 50.7]  [Reference Citation Analysis (0)]
26.  Ojagbemi A, Owolabi M, Akinyemi J, Ovbiagele B. Proposing a new stroke-specific screening tool for depression: Examination of construct validity and reliability. eNeurologicalSci. 2017;9:14-18.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 2]  [Cited by in F6Publishing: 3]  [Article Influence: 0.4]  [Reference Citation Analysis (0)]
27.  Science open  MAP-R for Windows Multitrait/Multi-Item Analysis Program—Revised Users’ Guide Health Assessment Laboratory. 1997. [cited 16 April 2023] Available from: https://www.scienceopen.com/document?vid=880f822d-7b32-4737-8a71-399d33d5356a..  [PubMed]  [DOI]  [Cited in This Article: ]
28.  Färkkilä N, Sintonen H, Saarto T, Järvinen H, Hänninen J, Taari K, Roine RP. Health-related quality of life in colorectal cancer. Colorectal Dis. 2013;15:e215-e222.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 54]  [Cited by in F6Publishing: 60]  [Article Influence: 5.5]  [Reference Citation Analysis (0)]
29.  Magaji BA, Moy FM, Roslani AC, Sagap I, Zakaria J, Blazeby JM, Law CW. Health-related quality of life among colorectal cancer patients in Malaysia: a study protocol. BMC Cancer. 2012;12:384.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 5]  [Cited by in F6Publishing: 7]  [Article Influence: 0.6]  [Reference Citation Analysis (0)]
30.  Souadka A, Majbar MA, El Harroudi T, Benkabbou A, Souadka A. Perineal pseudocontinent colostomy is safe and efficient technique for perineal reconstruction after abdominoperineal resection for rectal adenocarcinoma. BMC Surg. 2015;15:40.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 14]  [Cited by in F6Publishing: 14]  [Article Influence: 1.6]  [Reference Citation Analysis (0)]
31.  El Fakir S, Abda N, Bendahhou K, Zidouh A, Bennani M, Errihani H, Benider A, Bekkali R, Nejjari C. The European Organization for Research and Treatment of Cancer quality of life questionnaire-BR23 Breast Cancer-Specific Quality of Life Questionnaire: psychometric properties in a Moroccan sample of breast cancer patients. BMC Res Notes. 2014;7:53.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 15]  [Cited by in F6Publishing: 20]  [Article Influence: 2.0]  [Reference Citation Analysis (0)]