Brief Article Open Access
Copyright ©2010 Baishideng Publishing Group Co., Limited. All rights reserved.
World J Gastroenterol. Sep 21, 2010; 16(35): 4416-4421
Published online Sep 21, 2010. doi: 10.3748/wjg.v16.i35.4416
Measuring episodic abdominal pain and disability in suspected sphincter of Oddi dysfunction
Valerie Durkalski, Division of Biostatistics and Epidemiology, Medical University of South Carolina, Charleston, SC 29425, United States
Walter Stewart, Center for Health Research, Geisinger Health System, Danville, PA 17822-4400, United States
Paulette MacDougall, Joseph Romagnuolo, Peter Cotton, Digestive Diseases Center, Medical University of South Carolina, Charleston, SC 29425, United States
Patrick Mauldin, Department of Pharmacy, Medical University of South Carolina, Charleston, SC 29425, United States
Olga Brawman-Minzter, Department of Psychiatry, Medical University of South Carolina, Charleston, SC 29425, United States
Author contributions: Durkalski V, Stewart W and Cotton P played a lead role in developing the instrument, designing the pilot trials and writing the manuscript; Durkalski V analyzed the data; Mauldin P, Romagnuolo J and Brawman-Mintzer O helped design the research and draft the manuscript; MacDougall P orchestrated and performed the research.
Supported by The development of the RAPID instrument was supported in part by the National Institute of Diabetes and Digestive and Kidney Diseases, No. R03 DK069328-01
Correspondence to: Valerie Durkalski, PhD, Associate Professor, Division of Biostatistics and Epidemiology, Medical University of South Carolina, Charleston, 135 Cannon Street, Ste 303, Charleston, SC 29425, United States. durkalsv@musc.edu
Telephone: +1-843-8761911 Fax: +1-843-8761923
Received: February 27, 2010
Revised: April 1, 2010
Accepted: April 8, 2010
Published online: September 21, 2010

Abstract

AIM: To evaluate the reliability of an instrument that measures disability arising from episodic abdominal pain in patients with suspected sphincter of Oddi dysfunction (SOD).

METHODS: Although several treatments have been utilized to reduce pain and associated disability, measurement tools have not been developed to reliably track outcomes. Two pilot studies were conducted to assess test-retest reliability of a newly developed instrument, the recurrent abdominal pain intensity and disability (RAPID) instrument. The RAPID score is a 90-d summation of days where productivity for various daily activities is reduced as a result of abdominal pain episodes, and is modeled after the migraine disability assessment instrument used to measure headache-related disability. RAPID was administered by telephone on 2 consecutive occasions in 2 consenting populations with suspected SOD: a pre-sphincterotomy population (Pilot I, n = 55) and a post-sphincterotomy population (Pilot II, n = 70).

RESULTS: The average RAPID scores for Pilots I and II were: 82 d (median: 81.5 d, SD: 64 d) and 48 d (median: 0 d, SD: 91 d), respectively. The concordance between the 2 assessments for both populations was very good: 0.81 for the pre-sphincterotomy population and 0.95 for the post-sphincterotomy population.

CONCLUSION: The described pilot studies suggest that RAPID is a reliable instrument for measuring disability resulting from abdominal pain in suspected SOD patients.

Key Words: Sphincter of Oddi, Abdominal pain, Disability measurement, Reproducibility of results, Pain measurement, Episodic pain



INTRODUCTION

The sphincter of Oddi controls the flow of bile and pancreatic secretions into the duodenum through the ampulla of Vater. Dysfunction of the sphincter can result in pain due to back pressure in the pancreas or biliary tree (especially after the gallbladder reservoir has been surgically removed)[1,2]. Classically these pains are felt in intermittent episodes, with symptom-free intervals, as emphasized by the Rome III consensus[3]. Some of these patients have objective findings on laboratory studies or imaging (e.g. abnormal liver enzymes, or a dilated bile duct), and are categorized by the Milwaukee classification as sphincter of Oddi dysfunction (SOD) Types I and II[4]. Many of these are found at endoscopic retrograde cholangiopancreatography (ERCP) to have bile duct stones or fibrotic sphincter stenosis, and are effectively treated by standard endoscopic biliary sphincterotomy.

Patients who have similar symptoms, but who have no demonstrable abnormalities on standard imaging and laboratory tests, are categorized as SOD type III. Presumably these patients suffer from intermittent SOD and related episodes of pain. These patients are very difficult to effectively evaluate and manage[5], given the absence of objective markers of the condition, and because ERCP treatments are not without risk[6].

The intermittent episodes of abdominal pain associated with SOD III can be severe, but the condition is not life-threatening. Pain episodes often interfere with the ability to function in primary roles (e.g. work, homemaker, etc.) and have a significant impact on quality of life. Impairment of function in primary roles has been previously shown to be a dominant motivation for seeking care and an outcome of primary concern to both patients and providers[7]. Several treatments are used to reduce pain and associated disability. However, measurement tools have not been developed to reliably and validly measure pain severity, frequency of pain episodes, and the impact of pain on function in primary roles.

To advance research in this area, we aimed to define an appropriate clinical measurement of efficacy for SOD treatment, where efficacy is defined as reduced pain-associated disability, also referred to as pain burden. The following describes the development and testing of an instrument to measure the pain burden in this patient population.

An extensive search of the literature did not yield an appropriate and validated instrument to measure pain and related burden for patients with SOD. Published clinical studies of treatment for SOD have used various instruments. Two sham-controlled trials used a global assessment scale[8,9], as have several open-label studies of sphincterotomy[10-13], and a trial of Botox injection[14]. Graded outcome scales (e.g. 5 grades of outcome, from very much improved, to very much worse or simply improved, same or worse) have been reported, but details on the questions and method of administration (e.g. clinic, by telephone, self-administered) were not published. One crossover trial of nifedipine treatment used daily diaries[15], but the study lasted only 16 wk, so the feasibility of daily diary use to assess episodes of pain over a longer follow-up period was not assessed. An extensive report of surgical sphincteroplasty (for a variety of indications) stated outcomes as good or excellent, without specifying criteria for outcomes[16]. Finally, a large follow-up study of 313 patients treated endoscopically used the need for re-intervention (at that center) as the primary measure of failure[17]. Such an outcome depends on other factors (e.g. access, patient preferences) that are not directly related to the patient’s pain experience and that would make it unsuitable for a multicenter trial, particularly if there is not a clearly defined and standardized method of measuring a threshold for re-intervention. This outcome could be made more robust if combined with an outcome measure of a patient’s pain experience and related burden.

A review of previous work and literature in other areas outside of gastroenterology revealed several well validated instruments for the assessment of pain and related disability[18-22]. Comprehensive reviews, such as the recommendations of the IMMPACT group (Initiatives on Methods, Measurement and Pain Assessment in Clinical Trials)[23], correspondence with numerous published authorities, a thorough search for validated scales that had been developed specifically for the assessment of other intermittent pains and disabilities, such as back pain and arthritis[24,25] and review of measures of quality of life (e.g. SF-36) were also conducted. The use of the SF-36 instrument to measure pain burden was deemed to be too general and not sufficiently disease-specific. Hebert et al[26] validated and published a Digestive Disease Quality of Life measure (DDQ15) but this instrument covers patients with many digestive diseases, and has not yet been used in practice. A “pain-volume” scale i.e. days of pain episodes in a month multiplied by the average severity of the reported episodes, was also considered, but again the concept does not include assessment of disability due to pain. Daily/weekly pain and disability diaries utilized in other studies were considered, but concerns about compliance over a long follow-up period in the context of pain episodes that are intermittent in nature, and the potential for inconsistent reporting of their number, frequency and severity precluded the use of patient diaries.

An important criterion for the development of a pain burden assessment instrument (unlike a daily diary) is its ability to measure retrospectively baseline pain-related disability over a period of weeks or months prior to any intervention. This is paramount as patients are often referred to tertiary centers from considerable distances, expecting an immediate intervention.

The closest analogy to pain and disability experienced by SOD III patients is in patients with migraine headache. Like SOD pain episodes, onset of migraine headaches is unpredictable, intermittent, and temporarily disabling. Frequency of migraine attacks vary substantially within individuals over time and among individuals. Moreover, migraine can be progressive and evolve to a chronic persistent pain state. The validated migraine disability assessment (MIDAS) questionnaire measures headache-related disability as lost time from paid work or school, household work or non-work activities as a result of headache over the previous 3-mo period. The justification for a 3-mo recall period came from prior studies that illustrated a good correlation between responses from a 90-d recall period and daily patient diaries in this patient population[27,28]. MIDAS, widely used in specialty care and available in 5 other languages, defines 4 levels (Grades) of disability ranging from “little or no disability” to “severely limiting disability”[7,29]. Based on the MIDAS terms and concepts, the Recurrent Abdominal Pain Intensity and Disability (RAPID) instrument was developed in collaboration with Dr. Stewart. This instrument is comprised of 5 questions, completed by the patient, which records time lost from paid work or school, household work or non-work activities as a result of abdominal pain episodes over the previous 3 mo (Table 1). Two additional questions ask about the average frequency and severity of abdominal pain episodes using a 3-mo recall period. The RAPID score is a 90-d summation of missed days, and days where productivity for paid work or school, household activities and non-work activities are reduced by half as a result of abdominal pain episodes. By analogy with the MIDAS instrument, RAPID grade 1 is a score of 0-5 and indicates little or no disability. Grade 2 is a score of 6-10 and indicates mildly limiting disability. Grades 3 and 4 are 11-20 (moderately limiting disability) and 21 or greater (severely limiting disability), respectively.

Table 1 Recurrent abdominal pain intensity and disability Instrument.
1 On how many days in the last 3 mo did you miss work or school because of your episodes of abdominal pain? ____ days
2 On how many days in the last 3 mo did you miss work or school because of your episodes of abdominal pain (Do not include days you counted in question 1 where you missed work or school.)? ____ days
3 On how many days in the last 3 mo did you not do household work because of your episodes of abdominal pain? ____ days
4 On how many days in the last 3 mo was your productivity in household work reduced by half or more because of your episodes of abdominal pain (Do not include days you counted in question 1 where you did not do household work.)? ____ days
5 On how many days in the last 3 mo did you miss family, social or leisure activities because of your episodes of abdominal pain? ____ days
6 On how many days in the last 3 mo did you have episodes of abdominal pain (If the abdominal pain lasted more than 1 d, count each day.)? ____ days
7 On a scale of 0-10, on average, how painful were these episodes of abdominal pain? ____
MATERIALS AND METHODS
Feasibility and reliability studies

Prior to using the newly developed RAPID instrument in a large, multicenter, randomized trial, we assessed its feasibility of administration and used Lin’s concordance correlation coefficient to measure test-retest reliability[30,31]. Two IRB-approved pilot studies were initiated at the Medical University of South Carolina (MUSC). One study (denoted Pilot I) enrolled a total of 55 SOD III patients from 6 centers in the United States. Potential participants were recruited through existing hospital referral networks. After providing consent, participants were asked to complete the RAPID questionnaire by telephone prior to receiving any treatment by the respective institution. RAPID was administered by telephone on 2 separate occasions at 2-3 wk intervals (Visits 1 and 2) to assess test-retest reliability and to examine the range of RAPID scores in the sample population. The 2-3 wk interval was chosen based on previous work on migraine headaches in which this period was deemed long enough so that respondents did not recall their answers to the previous interview and short enough to ensure that the recall time period was acceptable[32].

The second pilot study (Pilot II) collected the telephone-administered RAPID from 70 consenting adult patients who had undergone a sphincterotomy with a final diagnosis of “papillary stenosis/spasm” at MUSC between January and December 2003. To measure test-retest reliability, RAPID was administered twice by telephone at 2-3 wk intervals, between 6 and 18 mo post-sphincterotomy.

RESULTS

Of the 55 enrollees in Pilot I, 55% were female, 85% were Caucasian and the average age was 44 years (SD: 16 years). One enrolled patient did not complete the baseline questionnaire and was excluded from the analysis. At Visit 1, the average RAPID score for the 54 participants was 82 (median: 81.5, SD: 64, range: 0-255); average number of pain-days per 3-mo interval (Question 6 on RAPID) was 70 pain-days (SD: 29, range: 3-90); and 65% reported a pain severity level greater than 5 on a 10-point scale (Question 7 on RAPID; median rating: 7). Table 2 illustrates the number of participants in each RAPID grade at Visit 1 and the descriptive statistics of their RAPID score by grade. Thirty-one patients (57%) were contacted by telephone for the second interview (Visit 2). Table 3 illustrates the RAPID scores for the participants who completed both Visits 1 and 2. The test-retest reliability for the RAPID instrument, as measured by Lin’s concordance, was 0.81 (n = 31).

Table 2 Pilot I recurrent abdominal pain intensity and disability score by migraine disability assessment grade at Visit 1 (n = 54).
RAPIDnmeanSDMedianMinMax
MIDAS grade
161.171.830.000.004.00
229.001.419.008.0010.00
3315.002.6514.0013.0018.00
443101.7057.35103.0021.00255.00
Table 3 Pilot I recurrent abdominal pain intensity and disability score by Visit (for participants completing both visits).
RAPIDnmeanSDMedianMinMax
Visit
13180.6571.8253.000.00255.00
23175.7179.2553.000.00300.00

Of the 70 enrolled participants in the Pilot II study, the average RAPID score at the first visit was 48 (median: 0, SD: 90.76, range: 0-450). The pain episodes (questions 6-7 on RAPID) recorded at the first visit occurred at an average frequency of 31 pain days per 3-mo interval (SD: 39, range: 0-90), with 43% of participants reporting a pain severity level greater than 5 on a 10-point scale. Table 4 illustrates the number of participants in each grade post-treatment and the descriptive statistics of their RAPID score by grade. The RAPID was collected at both interview visits on 56 (80%) participants. RAPID scores at each visit are shown in Table 5. The test-retest reliability as measured by Lin’s concordance was 0.95 (n = 56).

Table 4 Pilot II recurrent abdominal pain intensity and disability score by migraine disability assessment grade at Visit 1 (n = 70).
RAPIDnmeanSDMedianMinMax
MIDAS grade
1400.331.020.000.004.00
247.001.157.006.008.00
3215.000.0015.0015.0015.00
424137.33109.74115.5026.00450.00
Table 5 Pilot II recurrent abdominal pain intensity and disability score by Visit (for participants completing both visits).
RAPIDnmeanSDMedianMinMax
Visit
15654.4698.890.000.00450.00
25653.6389.683.500.00450.00
DISCUSSION

The RAPID instrument was developed to provide a meaningful measurement of pain severity and related burden experienced by patients with suspected SOD III. This patient population is very similar to patients that suffer from severe headaches with respect to the unpredictable, intermittent, and temporarily disabling episodes of pain. For that reason, the development of RAPID relied on the published experience with the MIDAS instrument which illustrated the reliability, validity, and clinical utility of measuring pain-related disability in the previous 3 mo in patients experiencing severe headaches. The present 2 pilot studies demonstrated the reliability of the RAPID disability measure as measured by Lin’s concordance. The high levels of concordance between the RAPID scores indicate that the instrument is consistent within individuals when capturing disability due to abdominal pain in the past 3 mo. The higher test-retest concordance value in Pilot II may result from participants being assessed post-sphincterotomy with several RAPID scores of 0 (no disability due to abdominal pain in the last 3 mo). The discrepancy in the completion rates between the 2 studies (55% Pilot I, 80% Pilot II) most likely arises from limited resources at the various participating sites in Pilot I to repeatedly contact patients after the initial telephone attempt. Despite this limitation, the instrument is easy to administer and the concordance measurements support its reliability for consistently measuring pain disability in a suspected SOD III patient population. Patients with SOD III experience severe episodic pain that is highly disabling. In our studies, 80% of the Pilot I population and 34% of the Pilot II population were classified as having severely limiting disability (Grade 4). The difference in median baseline RAPID scores between the 2 populations (82 and 0 d) provides insight into the validity of the instrument (i.e. ability to measure treatment response) but formal instrument validation studies need to be conducted. Further studies should be conducted to assess how RAPID correlates with other relevant measurements of the impact of episodic abdominal pain in this patient population including quality of life (e.g. SF-36), and depression and anxiety.

SOD is not the only condition associated with intermittent abdominal pain. Further studies are needed to show whether the RAPID instrument is an appropriate measurement tool for pain/burden and the response to treatment in other abdominal conditions, such as irritable bowel syndrome.

COMMENTS
Background

Patients diagnosed with suspected sphincter of Oddi dysfunction (SOD) suffer from intermittent sphincter dysfunction and related episodes of pain. Measurement tools have not been developed to reliably measure pain severity, frequency of pain episodes, and the impact of pain on function in primary roles for these patients.

Research frontiers

Although several treatments have been utilized to reduce pain and associated disability, measurement tools have not been developed to reliably track patient-related outcomes. In this study, the authors evaluated the feasibility of administration and estimate the test-retest reliability of a newly developed instrument, the recurrent abdominal pain intensity and disability, for the measurement of disability due to episodic abdominal pain in patients with suspected SOD.

Innovations and breakthroughs

A measurement tool that reliably measures disability due to pain has the potential to improve understanding of the impact of treatments. This manuscript reports the development and reliability testing of an instrument that measures pain severity and related burden experienced by patients with suspected SOD.

Applications

If shown to be reliable, then future studies can assess the clinical usefulness of this instrument in suspected SOD patients and potentially other similar abdominal conditions such as irritable bowel syndrome.

Peer review

Professor Durkalski et al have performed an interesting pilot study in order to evaluate abdominal pain and disability in patients with suspected sphincter of Oddi dysfunction.

Footnotes

Peer reviewer: Juhani Sand, MD, PhD, Director, Division of Surgery, Gastroenterology and Oncology, Tampere University Hospital, PO Box 2000, 33521 Tampere, Finland

S- Editor Wang YR L- Editor Cant MR E- Editor Ma WH

References
1.  Petersen BT. An evidence-based review of sphincter of Oddi dysfunction: part I, presentations with “objective” biliary findings (types I and II). Gastrointest Endosc. 2004;59:525-534.  [PubMed]  [DOI]  [Cited in This Article: ]
2.  Petersen BT. Sphincter of Oddi dysfunction, part 2: Evidence-based review of the presentations, with “objective” pancreatic findings (types I and II) and of presumptive type III. Gastrointest Endosc. 2004;59:670-687.  [PubMed]  [DOI]  [Cited in This Article: ]
3.  Behar J, Corazziari E, Guelrud M, Hogan W, Sherman S, Toouli J. Functional gallbladder and sphincter of oddi disorders. Gastroenterology. 2006;130:1498-1509.  [PubMed]  [DOI]  [Cited in This Article: ]
4.  Varadarajulu S, Hawes R. Key issues in sphincter of Oddi dysfunction. Gastrointest Endosc Clin N Am. 2003;13:671-694.  [PubMed]  [DOI]  [Cited in This Article: ]
5.  Cohen S, Bacon BR, Berlin JA, Fleischer D, Hecht GA, Loehrer PJ Sr, McNair AE Jr, Mulholland M, Norton NJ, Rabeneck L. National Institutes of Health State-of-the-Science Conference Statement: ERCP for diagnosis and therapy, January 14-16, 2002. Gastrointest Endosc. 2002;56:803-809.  [PubMed]  [DOI]  [Cited in This Article: ]
6.  Freeman ML, Guda NM. Prevention of post-ERCP pancreatitis: a comprehensive review. Gastrointest Endosc. 2004;59:845-864.  [PubMed]  [DOI]  [Cited in This Article: ]
7.  Stewart WF, Lipton RB, Dowson AJ, Sawyer J. Development and testing of the Migraine Disability Assessment (MIDAS) Questionnaire to assess headache-related disability. Neurology. 2001;56:S20-S28.  [PubMed]  [DOI]  [Cited in This Article: ]
8.  Geenen JE, Hogan WJ, Dodds WJ, Toouli J, Venu RP. The efficacy of endoscopic sphincterotomy after cholecystectomy in patients with sphincter-of-Oddi dysfunction. N Engl J Med. 1989;320:82-87.  [PubMed]  [DOI]  [Cited in This Article: ]
9.  Toouli J, Roberts-Thomson IC, Kellow J, Dowsett J, Saccone GT, Evans P, Jeans P, Cox M, Anderson P, Worthley C. Manometry based randomised trial of endoscopic sphincterotomy for sphincter of Oddi dysfunction. Gut. 2000;46:98-102.  [PubMed]  [DOI]  [Cited in This Article: ]
10.  Botoman VA, Kozarek RA, Novell LA, Patterson DJ, Ball TJ, Wechter DG, Neal LA. Long-term outcome after endoscopic sphincterotomy in patients with biliary colic and suspected sphincter of Oddi dysfunction. Gastrointest Endosc. 1994;40:165-170.  [PubMed]  [DOI]  [Cited in This Article: ]
11.  Neoptolemos JP, Bailey IS, Carr-Locke DL. Sphincter of Oddi dysfunction: results of treatment by endoscopic sphincterotomy. Br J Surg. 1988;75:454-459.  [PubMed]  [DOI]  [Cited in This Article: ]
12.  Topazian M, Hong-Curtis J, Li J, Wells C. Improved predictors of outcome in postcholecystectomy pain. J Clin Gastroenterol. 2004;38:692-696.  [PubMed]  [DOI]  [Cited in This Article: ]
13.  Cicala M, Habib FI, Vavassori P, Pallotta N, Schillaci O, Costamagna G, Guarino MP, Scopinaro F, Fiocca F, Torsoli A. Outcome of endoscopic sphincterotomy in post cholecystectomy patients with sphincter of Oddi dysfunction as predicted by manometry and quantitative choledochoscintigraphy. Gut. 2002;50:665-668.  [PubMed]  [DOI]  [Cited in This Article: ]
14.  Wehrmann T, Seifert H, Seipp M, Lembcke B, Caspary WF. Endoscopic injection of botulinum toxin for biliary sphincter of Oddi dysfunction. Endoscopy. 1998;30:702-707.  [PubMed]  [DOI]  [Cited in This Article: ]
15.  Sand J, Nordback I, Koskinen M, Matikainen M, Lindholm TS. Nifedipine for suspected type II sphincter of Oddi dyskinesia. Am J Gastroenterol. 1993;88:530-535.  [PubMed]  [DOI]  [Cited in This Article: ]
16.  Madura JA, Madura JA 2nd, Sherman S, Lehman GA. Surgical sphincteroplasty in 446 patients. Arch Surg. 2005;140:504-511; discussion 511-513.  [PubMed]  [DOI]  [Cited in This Article: ]
17.  Park SH, Watkins JL, Fogel EL, Sherman S, Lazzell L, Bucksot L, Lehman GA. Long-term outcome of endoscopic dual pancreatobiliary sphincterotomy in patients with manometry-documented sphincter of Oddi dysfunction and normal pancreatogram. Gastrointest Endosc. 2003;57:483-491.  [PubMed]  [DOI]  [Cited in This Article: ]
18.  McDowell I, Newell C.  Pain Measurements. Chapter in: Measuring Health. A guide to rating scales and questionnaires. 2nd ed. New York: Oxford University Press 1996; 335-379.  [PubMed]  [DOI]  [Cited in This Article: ]
19.  Katz J, Melzack R. Measurement of pain. Surg Clin North Am. 1999;79:231-252.  [PubMed]  [DOI]  [Cited in This Article: ]
20.  Landrum K, Welch L. TIME: Toolkit of instruments to measure end-of-life care. Pain and physical symptoms.  Available from: http://www.chcr.brown.edu/pcoc/Physical.htm.  [PubMed]  [DOI]  [Cited in This Article: ]
21.  Farrar JT. What is clinically meaningful: outcome measures in pain clinical trials. Clin J Pain. 2000;16:S106-S112.  [PubMed]  [DOI]  [Cited in This Article: ]
22.  Von Korff M, Ormel J, Keefe FJ, Dworkin SF. Grading the severity of chronic pain. Pain. 1992;50:133-149.  [PubMed]  [DOI]  [Cited in This Article: ]
23.  Dworkin RH, Turk DC, Farrar JT, Haythornthwaite JA, Jensen MP, Katz NP, Kerns RD, Stucki G, Allen RR, Bellamy N. Core outcome measures for chronic pain clinical trials: IMMPACT recommendations. Pain. 2005;113:9-19.  [PubMed]  [DOI]  [Cited in This Article: ]
24.  Beurskens AJ, de Vet HC, Köke AJ. Responsiveness of functional status in low back pain: a comparison of different instruments. Pain. 1996;65:71-76.  [PubMed]  [DOI]  [Cited in This Article: ]
25.  Goldsmith CH, Boers M, Bombardier C, Tugwell P. Criteria for clinically important changes in outcomes: development, scoring and evaluation of rheumatoid arthritis patient and trial profiles. OMERACT Committee. J Rheumatol. 1993;20:561-565.  [PubMed]  [DOI]  [Cited in This Article: ]
26.  Hebert RL, Palesch YY, Mauldin PD, Tarnasky PR, Aabakken L, Hennessey W, Cotton PB. DDQ-15 Health-Related Quality of Life Instrument for Patients with Digestive Disorders. Health Serv Outcomes Res Methodol. 2001;2:137-156.  [PubMed]  [DOI]  [Cited in This Article: ]
27.  Stewart WF, Lipton RB, Simon D, Von Korff M, Liberman J. Reliability of an illness severity measure for headache in a population sample of migraine sufferers. Cephalalgia. 1998;18:44-51.  [PubMed]  [DOI]  [Cited in This Article: ]
28.  Stewart WF, Lipton RB, Kolodner KB, Sawyer J, Lee C, Liberman JN. Validity of the Migraine Disability Assessment (MIDAS) score in comparison to a diary-based measure in a population sample of migraine sufferers. Pain. 2000;88:41-52.  [PubMed]  [DOI]  [Cited in This Article: ]
29.  Lipton RB, Stewart WF, Sawyer J, Edmeads JG. Clinical utility of an instrument assessing migraine disability: the Migraine Disability Assessment (MIDAS) questionnaire. Headache. 2001;41:854-861.  [PubMed]  [DOI]  [Cited in This Article: ]
30.  Lin LI. A concordance correlation coefficient to evaluate reproducibility. Biometrics. 1989;45:255-268.  [PubMed]  [DOI]  [Cited in This Article: ]
31.  Lin IKL. A note on the concordance correlation coefficient. Biometrics. 2000;56:324-325.  [PubMed]  [DOI]  [Cited in This Article: ]
32.  Stewart WF, Lipton RB, Kolodner K, Liberman J, Sawyer J. Reliability of the migraine disability assessment score in a population-based sample of headache sufferers. Cephalalgia. 1999;19:107-114; discussion 74.  [PubMed]  [DOI]  [Cited in This Article: ]