Editorial
Copyright ©The Author(s) 2015. Published by Baishideng Publishing Group Inc. All rights reserved.
World J Methodol. Dec 26, 2015; 5(4): 175-178
Published online Dec 26, 2015. doi: 10.5662/wjm.v5.i4.175
Conflicts of interest in nutritional sciences: The forgotten bias in meta-analysis
Michel Lucas
Michel Lucas, Department of Social and Preventive Medicine, Université Laval, Population Health and Optimal Health Practices Research Unit, Centre Hospitalier Universitaire de Québec, Québec G1V 2M2, Canada
Michel Lucas, Department of Nutrition, Harvard T.H. Chan School of Public Health, Boston, MA 02115, United States
Author contributions: Lucas M conceived the idea of the manuscript, interpreted the data and wrote the manuscript.
Conflict-of-interest statement: (1) Dr. Lucas is Assistant Professor at Université Laval since July 2012, and Visiting Scientist at the Harvard T.H. Chan School of Public Health. Full salary of Dr. Lucas comes from Université Laval and CHU de Québec, and is cover by a salary award from the Fonds de recherche du Québec - Santé (FRQS); (2) Between 1999 and 2012, while he was a student, Dr. Lucas often spoke at conferences (mainly on omega-3 fatty acids). His honoraria and expenses were covered by private industries. He has never received research funding from private industries; (3) Dr. Lucas has no relationships with entities that might have an interest in the submitted work; (4) Dr. Lucas’ spouse, children and partners have no financial relationships with the submitted work; and (5) Dr. Lucas does not have any non-financial interests in the submitted work.
Open-Access: This article is an open-access article which was selected by an in-house editor and fully peer-reviewed by external reviewers. It is distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
Correspondence to: Dr. Michel Lucas, Assistant Professor, Department of Social and Preventive Medicine, Université Laval, Population Health and Optimal Health Practices Research Unit, Centre Hospitalier Universitaire de Québec, 2875 Laurier Blvd., Delta 2 Building, Suite 600, Québec G1V 2M2, Canada. michel.lucas@crchuq.ulaval.ca
Telephone: +1-418-5254444 Fax: +1-418-6542726
Received: May 22, 2015
Peer-review started: May 22, 2015
First decision: August 19, 2015
Revised: September 14, 2015
Accepted: September 29, 2015
Article in press: September 30, 2015
Published online: December 26, 2015

Abstract

Awareness of conflicts of interest (COI) in medicine began in the 1980s. More recently, the problem has gained notoriety in nutritional sciences. COI with industry could bias study conclusions in the context of research activities and scientific publications on nutritional sciences. The issue of COI in nutritional sciences deserves more attention and requires careful analyses as biased information can negatively impact the development of dietary guidelines and, ultimately, population health. Decision-making is generally based on available, published evidence, but when the results are ambivalent, it is easier to opt for the status quo and ask for more studies. Readers might wonder if research is subsidized by industry as a counterbalancing strategy based on levels of evidence-only to slow down eminent positions and/or legislation on the food sector? How can this problem be overcome without producing paranoia and McCarthyism while trying to be as methodological as possible?

Key Words: Conflicts of interest, Nutrition, Nutritional sciences, Bias, Systematic reviews, Meta-analysis

Core tip: Decision-making in the field of nutrition is based on published evidence, but when results are ambivalent, it is easier to opt for the status quo and ask for more studies. Because conflicts of interest (COI) in nutritional sciences can bias conclusions and negatively impact dietary recommendations and population health, it deserves more attention and requires careful analyses. To regard evidence properly and in a rigorous manner, COI in systematic reviews and meta-analyses must be evaluated systematically to guarantee the trustworthiness of nutrition-related studies, and must therefore be obligatory sub-analyses to reduce the risk of bias in data interpretation.


Citation: Lucas M. Conflicts of interest in nutritional sciences: The forgotten bias in meta-analysis. World J Methodol 2015; 5(4): 175-178
INTRODUCTION

Thompson[1] defined conflicts of interest (COI) as “a set of conditions in which professional judgment concerning a primary interest (such as a patient’s welfare or the validity of research) tends to be unduly influenced by a secondary interest (such as financial gain)”. To researchers, financial incentive is not necessarily the only influent interest. The desire for recognition, academic advancement, success in publication and funding are other powerful stimulants[2]. Scientists delight in believing they are immune to and very mindful of COI. According to Young[3]: “We are not always aware of our own biases. The idea that scientists are objective seekers of truth is a pleasing fiction, but counterproductive in so far as it can lessen vigilance against bias.” The purpose of this editorial is to discuss justifiable concern about the COI problem in nutritional sciences and the need to seriously take it into account with critical reading of scientific journals and inclusion of its analysis in systematic reviews (SR) as well as meta-analyses (MA). The nature of COI and human behavior relevant to COI are beyond the scope of this editorial, as they have already been well-described by other authors[3,4].

Even if we cannot accurately ascertain the beginnings of COI investigation in medicine, its consideration intensified in the 1980’s[5,6] and it still continues[7]. In 2009, the Institute of Medicine dedicated a full report to COI, indicating that its concerns are justifiable[8]. Corruption of healthcare by Big Pharma is a long-standing debate, but the one on Big Food is much more recent[9]. Indeed, PloS Med and BMJ recently published a complete series on the food and beverage industries, their influence and COI[10,11]. To Loder[10], the industry-researcher relationship “is not evidence of research malpractice. It does, however, contribute to perceptions that nutrition science might be for sale.” However, nutritional sciences are not the exclusive domain of COI. Such biases are well-known in the tobacco[12] and pharmaceutical industries[2], and parallels also apply to the food industry[13].

Although most scientific journals instruct authors to report all COI, not all published studies declare them. Lesser et al[14] noted that 54% of scientific articles - relating to drinks (beverages, juice, and milk) and published between 1999 and 2003 - named their financial sponsorships. They assessed the influence of funding bias by determining the relationship between industry (sponsorship) funding (yes, no, mixed support) and the conclusions of scientific articles (favorable, unfavorable or neutral). They reported an odds ratio of 7.61 (95%CI: 1.27-45.73) for favorable vs unfavorable conclusions in all industry-funded articles compared to those without industry funding. They concluded that “industry funding of nutrition-related scientific articles may bias conclusions in favor of sponsors products, with potentially significant implications for public health”. Diels et al[15] scrutinized the relationship between COI and study outcomes (favorable/unfavorable) in the realm of genetically-modified food products, using similar methodology. They found that financial COI were not associated with the results, but discerned strong linkage between professional COI (author affiliation with industry) and study outcomes. Bes-Rastrollo et al[16] examined relationships between COI and food companies, conclusions on sugar-sweetened beverage (SSB) consumption, and weight gain in published SR. Among the 6 SR that identified “COI with food companies”, 83.3% (n = 5) reported no positive linkage between SSB intake and weight gain, whereas among the 12 SR that found “no COI with food companies”, 83.3% ascertained positive associations. They noted that studies with “COI with food companies” were 5 times (relative risk = 5.0; 95%CI: 1.3-19.3) more likely to present no positive association between SSB consumption and weight gain than those without COI. These contradictory findings do not, however, establish which SR is right, but they clearly indicate discrepancies, depending on whether or not COI exist.

Drug studies have advantages over those in nutrition-the results are first submitted to government agencies for scrutiny before drug approval. Therefore, data from unpublished drug research are available, but this is not the case in nutrition. Moreover, by accessing trials registered with the United States Food and Drug Administration[17], the European Medicines Agency[18] and other government bodies, it can be determined if they have been published or not, if more negative studies are unpublished, if published results agree or conflict with agency decisions, and if there is risk of publication bias. Although not perfect, different methods detect and correct for publication bias[19,20]. However, unless bias is severe, these tests have low power and high false-positive rates in perceiving significant asymmetry[19]. Therefore, no statistical methods are superior to any others in assessing publication bias and they should be viewed as exploratory analyses. Publication bias in SR and MA is related not only to published and unpublished studies, but also to factors which influence published studies (e.g., statistical significance, study size and quality, type of study design, etc.)[21]. COI are often forgotten factors.

To help in the critical analysis of published SR and MA, guidelines such as PRISMA[22] (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) should be followed. The publication of protocols for SR and MA in the Cochrane Library (http://community.cochrane.org/ ) or Prospero (http://www.crd.york.ac.uk/prospero/ )[23] could ensure rigorous methodology. Although these tools are driven by methodological markers, they do not constitute an analysis of quality in themselves. Peer review committees and scientific panels do not always guarantee the quality of published studies. If included studies are of poor methodological quality, their results are likely to be biased. Therefore, the outcomes of SR and MA could be linked with high risk of bias, even if the methodology is implemented with great rigor. The Cochrane Statistical Methods Group and the Cochrane Bias Methods Group developed a risk of bias tool that focuses on 6 domains: Selection, performance, detection, attrition, reporting and other biases[24]. However, this risk of bias tool seems insufficient to capture biases related to study funding sources[25]. A Cochrane Review found that the risk of bias between drug industry and non-drug industry-funded studies was similar, but observed that drug industry-funded studies reported more “favorable” results than non-drug industry-funded studies[26].

As mentioned earlier, the problem of COI is complicated by the fact that not all studies sufficiently declare sponsorships and the financial affiliations of authors. Indeed, in the 2010 Cochrane Database of Systematic Reviews, a very low proportion of published drug studies reported funding sources (30%, 46/151 reviews), author-industry financial ties or employment (11%, 16/151 reviews)[27]. These findings are overwhelming, considering that Methodological Expectations of Cochrane Intervention Reviews Item No. C44 (Describing Studies) is mandatory[28]. Funding sources and COI declarations by primary researchers should be collected in this process and appear in the table on “Characteristics of included studies”.

As suggested by Bero[25]: “The impact of the bias can be assessed descriptively or by using subgroup analysis, comparing industry-funded to non-industry-funded studies, as is commonly done in Cochrane Reviews. A bias should not be ignored even if we do not fully understand its mechanism, just as we should not ignore harms of interventions if we don’t understand how they arose, or ignore the harm of smoking because we don’t know how smoking causes cancer. Therefore, a study’s funding source should be evaluated as an independent risk of bias.” As pointed out by Rothman[29], there is a risk of McCarthyism with labeling of scientists as having COI. He recommended “that a work should be judged solely on its merits” and “We can halt this new McCarthyism in science and get back to focusing on the work of a scientist rather than on his or her life story”.

To regard evidence properly and in a rigorous manner, COI in SR and MA must be evaluated systematically to guarantee the trustworthiness of nutrition-related studies, and must therefore be obligatory sub-analyses to reduce the risk of bias in data interpretation. COI may influence the results not only by showing statistically significant associations between exposure and disease, but also by demonstrating lack of associations, especially among groups that protect interests by inducing doubts and claiming unproven causation. Surprisingly and unfortunately, none of the MA in nutritional sciences assessed COI - to the best of the author’s knowledge while writing this editorial! Therefore, SR and MA must include sub-analyses that try to examine if studies with COI: (1) industry-sponsored; (2) authors-industry-affiliated; and (3) sponsorship or author affiliation - have more favorable outcomes (results, conclusions) than other investigations. The methodology employed by Diels et al[15] for SR and by Lundh et al[26] for MA could establish definitions, such as: (1) Sponsorships: industry-funded, non-industry-funded, and unknown/unclear sponsorship; (2) Authors’ affiliations: Industry-affiliated, non-industry-affiliated, and unknown/unclear; and (3) Classifications that combine sponsorship and author affiliations: COI (sponsorship or author affiliations), no COI, and unknown/unclear.

Nutrition is one of the most vital health determinants of society, not only in regard to the etiology of chronic diseases, but also because it is an important target for public health interventions. Investment in epidemiological approaches - allowing rigorous study into the roles of both individual and overall diets in disease risk - is undoubtedly a key to success. However, to continue to attract interest and trustworthiness, nutritional sciences must be faultless.

Footnotes

P- Reviewer: Costa RF, Gonzalez-Reimers E, Zhang Q S- Editor: Qiu S L- Editor: A E- Editor: Lu YJ

References
1.  Thompson DF. Understanding financial conflicts of interest. N Engl J Med. 1993;329:573-576.  [PubMed]  [DOI]
2.  Bekelman JE, Li Y, Gross CP. Scope and impact of financial conflicts of interest in biomedical research: a systematic review. JAMA. 2003;289:454-465.  [PubMed]  [DOI]
3.  Young SN. Bias in the research literature and conflict of interest: an issue for publishers, editors, reviewers and authors, and it is not just about the money. J Psychiatry Neurosci. 2009;34:412-417.  [PubMed]  [DOI]
4.  Levinsky NG. Nonfinancial conflicts of interest in research. N Engl J Med. 2002;347:759-761.  [PubMed]  [DOI]
5.  Relman AS. Dealing with conflicts of interest. N Engl J Med. 1985;313:749-751.  [PubMed]  [DOI]
6.  Relman AS. The new medical-industrial complex. N Engl J Med. 1980;303:963-970.  [PubMed]  [DOI]
7.  Rosenbaum L. Understanding bias--the case for careful study. N Engl J Med. 2015;372:1959-1963.  [PubMed]  [DOI]
8.  Lo B, Baldwin W, Bellini L. for the Institute of Medicine. Conflict of interest in medical research, education, and practice [consensus report]. In: Lo B, Field MJ, editors. National Academy of Sciences.  Available from: http://www.iom.edu/Reports/2009/Conflict-of-Interest-in-Medical-Research-Education-and-Practice.aspx.  [PubMed]  [DOI]
9.  Nestle M. Food company sponsorship of nutrition research and professional activities: a conflict of interest? Public Health Nutr. 2001;4:1015-1022.  [PubMed]  [DOI]
10.  Loder E. Big food, big pharma: is science for sale? BMJ. 2015;350:h795.  [PubMed]  [DOI]
11.  Barbour V, Clark J, Simpson P, Veitch E. PLoS Medicine series on Big Food: the food industry is ripe for scrutiny. PLoS Med. 2012;9:e1001246.  [PubMed]  [DOI]
12.  Barnes DE, Hanauer P, Slade J, Bero LA, Glantz SA. Environmental tobacco smoke. The Brown and Williamson documents. JAMA. 1995;274:248-253.  [PubMed]  [DOI]
13.  Brownell KD, Warner KE. The perils of ignoring history: Big Tobacco played dirty and millions died. How similar is Big Food? Milbank Q. 2009;87:259-294.  [PubMed]  [DOI]
14.  Lesser LI, Ebbeling CB, Goozner M, Wypij D, Ludwig DS. Relationship between funding source and conclusion among nutrition-related scientific articles. PLoS Med. 2007;4:e5.  [PubMed]  [DOI]
15.  Diels J, Cunha M, Manaia C, Sabugosa-Madeira B, Silva M. Association of financial or professional conflict of interest to research outcomes on health risks or nutritional assessment studies of genetically modified products. Food Policy. 2011;36:197-203.  [PubMed]  [DOI]
16.  Bes-Rastrollo M, Schulze MB, Ruiz-Canela M, Martinez-Gonzalez MA. Financial conflicts of interest and reporting bias regarding the association between sugar-sweetened beverages and weight gain: a systematic review of systematic reviews. PLoS Med. 2013;10:e1001578; dicsussion e1001578.  [PubMed]  [DOI]
17.  Turner EH, Matthews AM, Linardatos E, Tell RA, Rosenthal R. Selective publication of antidepressant trials and its influence on apparent efficacy. N Engl J Med. 2008;358:252-260.  [PubMed]  [DOI]
18.  Taylor D, Sparshatt A, Varma S, Olofinjana O. Antidepressant efficacy of agomelatine: meta-analysis of published and unpublished studies. BMJ. 2014;348:g1888.  [PubMed]  [DOI]
19.  Song F, Khan KS, Dinnes J, Sutton AJ. Asymmetric funnel plots and publication bias in meta-analyses of diagnostic accuracy. Int J Epidemiol. 2002;31:88-95.  [PubMed]  [DOI]
20.  Thornton A, Lee P. Publication bias in meta-analysis: its causes and consequences. J Clin Epidemiol. 2000;53:207-216.  [PubMed]  [DOI]
21.  Delgado-Rodríguez M, Llorca J. Bias. J Epidemiol Community Health. 2004;58:635-641.  [PubMed]  [DOI]
22.  Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009;339:b2535.  [PubMed]  [DOI]
23.  Booth A, Clarke M, Dooley G, Ghersi D, Moher D, Petticrew M, Stewart L. The nuts and bolts of PROSPERO: an international prospective register of systematic reviews. Syst Rev. 2012;1:2.  [PubMed]  [DOI]
24.  Higgins JPT, Altman DG, Sterne JACe. Chapter 8: Assessing risk of bias in included studies. In: Higgins JPT, Green S, editors. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0. The Cochrane Collaboration.  Available from: http://www.cochrane-handbook.org.  [PubMed]  [DOI]
25.  Sterne JA. Why the Cochrane risk of bias tool should not include funding source as a standard item. Cochrane Database Syst Rev. 2013;12:ED000076.  [PubMed]  [DOI]
26.  Lundh A, Sismondo S, Lexchin J, Busuioc OA, Bero L. Industry sponsorship and research outcome. Cochrane Database Syst Rev. 2012;12:MR000033.  [PubMed]  [DOI]
27.  Roseman M, Turner EH, Lexchin J, Coyne JC, Bero LA, Thombs BD. Reporting of conflicts of interest from drug trials in Cochrane reviews: cross sectional study. BMJ. 2012;345:e5155.  [PubMed]  [DOI]
28.  Chandler J, Churchill R, Higgins J, Lasserson T, Tovey D. Methodological Expectations of Cochrane Intervention Reviews (MECIR). Methodological standards for the conduct of new Cochrane Intervention Reviews. Version 2.3.  Available from: http://www.editorial-unit.cochrane.org/mecir.  [PubMed]  [DOI]
29.  Rothman KJ. Conflict of interest. The new McCarthyism in science. JAMA. 1993;269:2782-2784.  [PubMed]  [DOI]