Search Article Keyword:  

PubMed Submission Abstract PDF Feed Back Count: 1403 Download Count: 464 

ISSN 1007-9327 CN 14-1219/R  World J Gastroenterol  2008 July 14; 14(26): 4127-4130

OBSERVER

Use of the Crohn’s disease activity index in clinical trials of biological agents

Hugh James Freeman


Hugh James Freeman, Department of Medicine (Gastroen-terology), University of British Columbia, Vancouver, British Columbia V6T 1W5, Canada

Author contributions: Freeman HJ contributed all to this paper.

Correspondence to: Dr. Hugh Freeman, MD, Professor, Department of Medicine (Gastroenterology), University of British Columbia Hospital, 2211 Wesbrook Mall, Vancouver, British Columbia V6T 1W5, Canada. hugfree@shaw.ca

Telephone: +1-604-8227216  Fax: +1-604-8227236

Received: May 22, 2008        Revised: June 23, 2008

Accepted: June 30, 2008

Published online: July 14, 2008

  

Abstract

The Crohn’s disease activity index (CDAI) has been commonly used to assess the effects of treatment with different agents in Crohn’s disease (CD). However, these studies may be compromised, if the results compared to a placebo or standard therapy group (in the absence of a placebo) substantially differ from the expected response. In addition, significant concerns have been raised regarding the reliability and validity of the CDAI. Reproducibility of the CDAI may be limited as significant inter-observer error has been recorded, even if measurements are done by experienced clinicians with expertise in the diagnosis and treatment of CD. Finally, many CDAI endpoints are open to subjective interpretation and have the potential for manipulation. This is worrisome as there is the potential for significant financial gain, if the results of a clinical trial appear to provide a positive result. Physicians caring for patients should be concerned about the positive results in clinical trials that are sponsored by industry, even if the trials involve respected centers and the results appear in highly ranked medical journals.

 

© 2008 The WJG Press. All rights reserved.

 

Key words: Crohn’s disease; Crohn’s disease activity index; Clinical trials; Infliximab; Adalimumab; Corticosteroids; Azathioprine

 

Peer reviewer: Mario Guslandi, Professor, Department of Gastroenterology, S: Raffaele University Hospital, S: Raffaele University Hospitalvia Olgettina 60, Milano 20132, Italy

 

Freeman HJ. Use of the Crohn’s disease activity index in clinical trials of biological agents. World J Gastroenterol 2008; 14(26): 4127-4130  Available from: URL: http://www.wjgnet.com/1007-9327/14/4127.asp  DOI:http://dx.doi.org/10.3748/wjg.14.4127

  

INTRODUCTION

The Crohn’s disease activity index (CDAI) is a numerical calculation derived from the sum of products from a list of 8 items (Table 1), and multiplied by weighting factors for each item to define the severity of “disease activity” in patients with Crohn’s disease (CD)[1]. Essentially, the CDAI represents a numerical estimation of a physician’s interpretation of patient symptoms. Initially, the CDAI was correlated with a physician’s overall global assessment for a group of 112 patients with CD after a total of 186 patient visits done in 13 different hospitals in the United States[1]. This instrument was first applied in the National Cooperative Crohn’s Disease Study (NCCDS), published in 1979, and used to quantitatively compare the results in a placebo group to groups treated with the following drugs: sulphasalazine, prednisone and azathioprine.

    Index values of 150 and below were associated with quiescent or non-active disease (i.e. “remission”). Values over 150 were indicative of active disease, and over 450, extremely severe disease. Of particular note, in patients randomized to placebo in the NCCDS, 32% achieved a spontaneous remission at the end of 17 wk, and 53% of these were still in remission at the end of 24 mo[2]. The results of drug treatment using the CDAI in active disease showed that the response to prednisone or sulfasalazine was significantly better than placebo, while the response to azathioprine was better than placebo, but did not reach statistical significance[3]. Patients with colonic involvement were especially responsive to sulfasalazine, and those with small bowel involvement were especially responsive to prednisone[3]. Since these studies were reported, other publications[4-7] have appeared employing the CDAI as well as other indices[8-12] to assess disease activity in the evaluation of therapeutic effectiveness of different pharmacological and biological agents[13].

 

PLACEBO RESPONSE

Knowledge of the expected response to a placebo may be useful, but may not always be available. The NCCDS compared each of the treatment groups to a placebo group. Therapy with a new agent may now require comparison to the standard treatment, instead of a placebo. In part, at least, this relates to the ethical need to ensure that all participants in a clinical trial have access to proven therapy. Placebo alone may be difficult to justify, especially if patients are significantly symptomatic. And, if a new treatment shows a statistically positive result, it could reflect a limited effect of standard treatment (or the placebo). As in day-to-day clinical practice, the standard treatment may not always perform as well (or as badly) in each clinical trial. To best appreciate the results of a clinical trial involving a new agent, the expected response to placebo and treatment groups, as in the NCCDS, may be both important and informative.

 

OBSERVER DIFFERENCES

Although the CDAI appeared to correlate with the global clinical assessment in a limited number of CD patients, it was appreciated that the same observer or different observers might derive different results at different times. Thus, efforts were made by the CDAI investigators and later groups to evaluate the reliability and validity of the CDAI. In the initial report of its development[14], the consistency of the CDAI was examined in 2 successive visits for 32 patients. A positive association with the physician global assessment (with some overlap) was noted with a total of 50 index points being the apparent difference between slight clinical improvement (or worsening) and no actual change in symptoms for 2 successive visits. Subsequent studies also suggested that the reliability of the CDAI is within a defined moderate to good range, but not in a defined very good to excellent range[15,16]. Later efforts to re-calculate the CDAI by these investigators showed no significant difference from the original estimation, so no further changes in the CDAI were recommended[16].

    The CDAI appeared to be relatively reliable if used by these observers well experienced in its application. However, significant inter-observer differences were later noted in a series of separate studies, published as a single paper[17]. In one study, the CDAI was calculated from 10 “paper cases” evaluated by 5 consultants in surgery or gastroenterology, and 2 research assistants. Major discrepancies in calculated CDAI values were noted for each of the 7 different cases ranging from 166 to 430 points! In a second study, 15 members of the IOIBD prospectively evaluated a single case. The range of estimated values was 320 to 391, or 71 points. Improvement in observer differences, however, could be achieved with terminology discussion prior to calculation. A final study assessed the ability of 6 experienced gastroenterologists to independently elicit patient data, rather than being provided by the information from the “paper case” format. Wide variations in the estimated CDAI were seen ranging (in 1 case) up to 500 points! “Good agreement” was believed to have been achieved even in the best 2 patients, the difference was over 50 points. In spite of these critical concerns, the CDAI is used today in most clinical trials to evaluate different agent effects on symptom activity in CD.

 

OTHER CDAI ISSUES

There are other recognized difficulties with the CDAI per se. First, as noted elsewhere[18], a significant component of the total CDAI score is derived from highly subjective items, such as “general well being” and “intensity of abdominal pain”. Many symptoms overlap with those that might be ascribed to some other functional causes. To overcome this issue, it has been logically recommended that these patients should be randomly distributed to each of the treatment groups[18]. But, in practice, this may be difficult to accomplish and may not be done. Second, the CDAI is computed using a diary card that must be developed by the patient for 7 d prior to submission. In practice, this may be difficult for some patients to prospectively do well without close monitoring which may not be feasible. Some clinical study coordinators apparently assist patients in retrospective completion of 7-d diaries on the study visit[18] and this could clearly impact results. As noted[18], there are no data on the prevalence of this practice in clinical trial centers and it is not generally mentioned in the Methods section of the published reports. Third, some symptoms may be difficult to interpret or quantitate easily. For example, “liquid” stools may be difficult to precisely define[17]. Finally, even though enterocutaneous fistulae may be very troublesome for the patient, their impact on the CDAI may be limited. “General well being” may be severely impacted by perianal disease, but the patient may be fully functional. As a result, other indices have been developed to directly evaluate this component[19]. Even here, however, the endpoint measured may be criticized. For example, an open fistula may be differentiated from a closed fistula based on expression of purulent material from the tract following application of “gentle pressure”. Data on intra-observer and inter-observer agreement for such endpoints in clinical trials are not available. Moreover, full disappearance of fistula tracts is rarely documented.

 

IMPACT OF INDUSTRY

Another significant issue is the impact of the pharma-ceutical industry in the conduct of clinical trials. This issue has been addressed in detail elsewhere[20]. In 1979, the NCCDS was reported to be largely supported through peer-review national research grant agencies for all patient study costs while the pharmaceutical industry was simply acknowledged for their donation of the study medications. Of course, it is not known if there were other financial benefits provided by industry then since requirements for reporting of industry support were minimal. Now, virtually all clinical trials are conducted almost entirely through industry support, either from private or shareholder-owned public companies. Many clinical trials are largely authored by a select group of “experts”, often, but not always, affiliated with university centers. Some authors are fully employed by the sponsoring industry and have the responsibility of collecting and monitoring all data collected, evaluating results and even drafting the manuscript. Some, but not all, journals require that all investigators declare income received from industry in the form of honoraria and other forms of financial support, although the precise amounts are never disclosed. Others may actually be owners or shareholders of the company concerned. This declaration is meant to alert the reader that the investigator may have a conflict of interest, not increase investigator credibility. If the journal did not require the declaration, it would not be provided. The problem, however, is even deeper. While hospitals involved in provision of research facilities may not be directly involved in conduct of the clinical trial, a “fee” is usually attached to the clinical trial costs for use of facilities, and so, indirectly, the institution (and its reputation possibly earned over many decades) is also being “purchased” by industry. Many teaching institutions, limited in resources, often consider industry funding as a positive asset for faculty members in the promotion process. In everyday clinical practice, it may be difficult to wade through all of these issues. The CDAI provides a simple numerical means to statistically evaluate treatment response, but this measurement has the potential to be manipulated as a positive spin will surely impact the share price in a positive direction.

 

TOP-DOWN AND BOTTOM-UP CDAI TRIALS

A recent clinical trial compared infliximab to “con-ventional therapy” for CD[21]. An industry marketing label for these respective approaches has already appeared in the literature: “top-down” and “bottom-up”. In this study, both investigators and patients were aware of the drugs being used for treatment. The study reported a positive result in favor of infliximab and azathioprine. The potential conflict of interest for a positive study result was clearly evident for all concerned in this open label study. Patients can actively influence the results of open label clinical trials, especially if an ordinarily expensive treatment is offered at no cost. Many of the authors noted financial support from a number of companies, including those with a vested commercial interest in the direct global marketing of infliximab. Even the editorialist[22] listed support from the same companies, certainly not an independent view of the data.

    This open label study illustrated more about the modern conduct of clinical trials, their potential for conflict of interest and the credibility of the investigators associated with the results of this trial. Clinicians will need to be more suspicious of the results of clinical trials for CD, especially if based partly, or solely, on the CDAI, an index whose reliability and validity may be quite limited. Moreover, as the CDAI was used originally to assess the effectiveness of therapeutic agents having been used by physicians for decades, the present use of the CDAI seems to have evolved from its original intent. Now, potent biologicals (rather than pharmaceuticals) are being explored in clinical trials to determine if CDAI numbers, reflecting clinical symptoms, can be altered sufficiently to produce a statistically relevant result. Interestingly, even in an early report with infliximab in CD, a statistically positive result was observed with a specific dose of the agent, but in the same study, a dose-response could not be defined with higher doses[13]. This lack of dose-response with this biological agent was not explained. However, in retrospect, the study design clearly provided an advantage to infliximab treatment. There were three different infliximab groups that could be compared to only one placebo group. A statistically significant result for any one of these infliximab groups compared to the placebo would have been considered positive in favor of the new agent. Also, it was reported that 33% of the infliximab-treated patients had a CDAI-defined remission compared to only 4% for placebo. While statistically different, the remission rate for the infliximab-treated group was remarkably similar to the earlier reported placebo rate in the NCCDS. It is not known if these results reflected, to some degree, the inherent limitations of the CDAI to estimate patient symptoms, even in a blinded clinical trial, and permit comparisons with earlier studies.

    Where will this approach related to the “che-motherapy of the CDAI” take us? No one really knows. However, the impact of an investigator bearing therapeutic “gifts” for the patient in a clinical trial, while, at the same time, personally receiving “gifts” from industry should raise concerns among physicians that are responsible for patient care.

 

NEED FOR LONG-TERM STUDIES ON NATURAL HISTORY OF CD

A final paragraph might be added to raise a separate issue. It is probably not sufficient to simply raise criticism and concern regarding the CDAI. Others have explored the use of other indices, some perhaps simpler to apply in a clinical setting.  For example, the Harvey-Bradshaw Index[23] evaluates symptoms and signs during the preceding 24 h, rather than the previous 7 d, reduces the original 8 items in the CDAI to 5 (i.e. excluding antidiarrheal use, hematocrit and body weight), and eliminates the weighting factor. Its use appears to correlate well with the CDAI[23,24]. Another, the Cape Town Index (or South African Index) was developed as another alternative to avoid the “single parameter” bias inherent in the Harvey-Bradshaw Index[25]. Another index, the Van Hees Index[26] was developed in an attempt to avoid subjective clinical criteria by employing a physician global assessment variable. Most important, each of these different indices really attempts to measure only a very limited temporal window in the clinical course of CD. A longer term view of CD is required[27,28] so that objective measurement of the effects of different therapeutic efforts can be seen to positively or negatively alter the natural history of this chronic inflammatory process.

 

REFERENCES

1      Winship DH, Summers RW, Singleton JW, Best WR, Becktel JM, Lenk LF, Kern F Jr. National Cooperative Crohn's Disease

        Study: study design and conduct of the study. Gastroenterology 1979; 77: 829-842 PubMed   

2      Mekhjian HS, Switz DM, Melnyk CS, Rankin GB, Brooks RK. Clinical features and natural history of Crohn's disease.

        Gastroenterology 1979; 77: 898-906 PubMed   

3      Summers RW, Switz DM, Sessions JT Jr, Becktel JM, Best WR, Kern F Jr, Singleton JW. National Cooperative Crohn's

        Disease Study: results of drug treatment. Gastroenterology 1979; 77: 847-869 PubMed   

4      Malchow H, Ewe K, Brandes JW, Goebell H, Ehms H, Sommer H, Jesdinsky H. European Cooperative Crohn's Disease

        Study (ECCDS): results of drug treatment. Gastroenterology 1984; 86: 249-266 PubMed   

5      Rutgeerts P, Lofberg R, Malchow H, Lamers C, Olaison G, Jewell D, Danielsson A, Goebell H, Thomsen OO, Lorenz-Meyer

        H. A comparison of budesonide with prednisolone for active Crohn's disease. N Engl J Med 1994; 331: 842-845

        PubMed    DOI

6      Greenberg GR, Feagan BG, Martin F, Sutherland LR, Thomson AB, Williams CN, Nilsson LG, Persson T. Oral budesonide

        for active Crohn's disease. Canadian Inflammatory Bowel Disease Study Group. N Engl J Med 1994; 331: 836-841

        PubMed    DOI

7      Singleton JW, Hanauer SB, Gitnick GL, Peppercorn MA, Robinson MG, Wruble LD, Krawitt EL. Mesalamine capsules for the

        treatment of active Crohn's disease: results of a 16-week trial. Pentasa Crohn's Disease Study Group. Gastroenterology

        1993; 104: 1293-1301 PubMed   

8      Candy S, Wright J, Gerber M, Adams G, Gerig M, Goodman R. A controlled double blind study of azathioprine in the

        management of Crohn's disease. Gut 1995; 37: 674-678 PubMed    DOI

9      Ewe K, Press AG, Singe CC, Stufler M, Ueberschaer B, Hommel G, Meyer zum Buschenfelde KH. Azathioprine combined

        with prednisolone or monotherapy with prednisolone in active Crohn's disease. Gastroenterology 1993; 105: 367-372

        PubMed   

10    Feagan BG, Rochon J, Fedorak RN, Irvine EJ, Wild G, Sutherland L, Steinhart AH, Greenberg GR, Gillies R, Hopkins M.

        Methotrexate for the treatment of Crohn's disease. The North American Crohn's Study Group Investigators. N Engl J Med

        1995; 332: 292-297 PubMed    DOI

11    Stange EF, Modigliani R, Pena AS, Wood AJ, Feutren G, Smith PR. European trial of cyclosporine in chronic active Crohn's

        disease: a 12-month study. The European Study Group. Gastroenterology 1995; 109: 774-782 PubMed    DOI

12    Rutgeerts P, Hiele M, Geboes K, Peeters M, Penninckx F, Aerts R, Kerremans R. Controlled trial of metronidazole

        treatment for prevention of Crohn's recurrence after ileal resection. Gastroenterology 1995; 108: 1617-1621

        PubMed    DOI

13   Targan SR, Hanauer SB, van Deventer SJ, Mayer L, Present DH, Braakman T, DeWoody KL, Schaible

        TF, Rutgeerts PJ. A short-term study of chimeric monoclonal antibody cA2 to tumor necrosis factor

        alpha for Crohn's disease. Crohn's Disease cA2 Study Group. N Engl J Med 1997; 337: 1029-1035

      PubMed    DOI

14    Best WR, Becktel JM, Singleton JW, Kern F Jr. Development of a Crohn's disease activity index. National Cooperative

        Crohn's Disease Study. Gastroenterology 1976; 70: 439-444 PubMed   

15    Sandler RS, Jordan MC, Kupper LL. Development of a Crohn's index for survey research. J Clin Epidemiol 1988; 41:

        451-458 PubMed    DOI

16    Best WR, Becktel JM, Singleton JW. Rederived values of the eight coefficients of the Crohn's Disease Activity Index

        (CDAI) . Gastroenterology 1979; 77: 843-846 PubMed   

17    de Dombal FT, Softley A. IOIBD report no 1: Observer variation in calculating indices of severity and activity in Crohn's

        disease. International Organisation for the Study of Inflammatory Bowel Disease. Gut 1987; 28: 474-481 PubMed    DOI

18    Sandborn WJ, Feagan BG, Hanauer SB, Lochs H, Lofberg R, Modigliani R, Present DH, Rutgeerts P, Scholmerich J, Stange

        EF, Sutherland LR. A review of activity indices and efficacy endpoints for clinical trials of medical therapy in adults with

        Crohn's disease. Gastroenterology 2002; 122: 512-530 PubMed    DOI

19    Irvine EJ. Usual therapy improves perianal Crohn's disease as measured by a new disease activity index. McMaster IBD

        Study Group. J Clin Gastroenterol 1995; 20: 27-32 PubMed    DOI

20    Angell M. The Truth about the Drug Companies: How They Deceive Us and what to Do about it. Random House

        Publishing 2005; 1-319

21    D'Haens G, Baert F, van Assche G, Caenepeel P, Vergauwe P, Tuynman H, De Vos M, van Deventer S,

        Stitt L, Donner A, Vermeire S, Van de Mierop FJ, Coche JC, van der Woude J, Ochsenkuhn T, van

        Bodegraven AA, Van Hootegem PP, Lambrecht GL, Mana F, Rutgeerts P, Feagan BG, Hommes D. Early

        combined immunosuppression or conventional management in patients with newly diagnosed Crohn's

        disease: an open randomised trial. Lancet 2008; 371: 660-667 PubMed    DOI

22    Sandborn WJ. Initial combination therapy in early Crohn's disease. Lancet 2008; 371: 635-636 PubMed    DOI

23    Harvey RF, Bradshaw JM. A simple index of Crohn's-disease activity. Lancet 1980; 1: 514 PubMed    DOI

24    Wright JP, Young GO, Tigler-Wybrandi N. Predictors of acute relapse of Crohn's disease. A laboratory and clinical study.

        Dig Dis Sci 1987; 32: 164-170 PubMed   

25    Wright JP, Marks IN, Parfitt A. A simple clinical index of Crohn's disease activity--the Cape Town index. S Afr Med J 1985;         68: 502-503 PubMed   

26    van Hees PA, Bakker JH, van Tongeren JH. Effect of sulphapyridine, 5-aminosalicylic acid, and placebo in patients with

        idiopathic proctitis: a study to determine the active therapeutic moiety of sulphasalazine. Gut 1980; 21: 632-635

        PubMed    DOI

27    Freeman HJ. Natural history and clinical behavior of Crohn's disease extending beyond two decades. J Clin Gastroenterol

        2003; 37: 216-219 PubMed    DOI

28    Freeman HJ. Temporal and geographic evolution of longstanding Crohn's disease over more than 50 years. Can J

        Gastroenterol 2003; 17: 696-700 PubMed   

 

       S- Editor  Li DL    L- Editor  Wang XL    E- Editor  Zhang WB

 

 

 

 

 

Reviews Add
more>>


Related Articles:
Adenosine: An immune modulator of inflammatory bowel diseases
Emerging treatments for complex perianal fistula in Crohn's disease
IL-10 and TNF-alpha promoter haplotypes are associated with childhood Crohn's disease location
Correlation of MRI-determined small bowel Crohn's disease categories with medical response and surgical pathology
Long-term results of endoscopic balloon dilatation of lower gastrointestinal tract strictures in Crohn's disease: A prospective study
more>>