Financial Conflicts of Interest and Reporting Bias Regarding the Association between Sugar-Sweetened Beverages and Weight Gain: A Systematic Review of Systematic Reviews

Summary

Background:
Industry sponsors' financial interests might bias the conclusions of scientific research. We examined whether financial industry funding or the disclosure of potential conflicts of interest influenced the results of published systematic reviews (SRs) conducted in the field of sugar-sweetened beverages (SSBs) and weight gain or obesity.

Methods and Findings:
We conducted a search of the PubMed, Cochrane Library, and Scopus databases to identify published SRs from the inception of the databases to August 31, 2013, on the association between SSB consumption and weight gain or obesity. SR conclusions were independently classified by two researchers into two groups: those that found a positive association and those that did not. These two reviewers were blinded with respect to the stated source of funding and the disclosure of conflicts of interest.

We identified 17 SRs (with 18 conclusions). In six of the SRs a financial conflict of interest with some food industry was disclosed. Among those reviews without any reported conflict of interest, 83.3% of the conclusions (10/12) were that SSB consumption could be a potential risk factor for weight gain. In contrast, the same percentage of conclusions, 83.3% (5/6), of those SRs disclosing some financial conflict of interest with the food industry were that the scientific evidence was insufficient to support a positive association between SSB consumption and weight gain or obesity. Those reviews with conflicts of interest were five times more likely to present a conclusion of no positive association than those without them (relative risk: 5.0, 95% CI: 1.3–19.3).

An important limitation of this study is the impossibility of ruling out the existence of publication bias among those studies not declaring any conflict of interest. However, the best large randomized trials also support a direct association between SSB consumption and weight gain or obesity.

Conclusions:
Financial conflicts of interest may bias conclusions from SRs on SSB consumption and weight gain or obesity.

Please see later in the article for the Editors' Summary

Introduction

The use of industry funding for scientific research might influence the results of published studies, leading to conclusions that could ultimately support the industry's interests. Examples of this include biased findings by the tobacco industry [1] and the energy industry's approach to climate change [2]. This issue has been thoroughly discussed in pharmaceutical studies, where the dangers of the use of so-called scientific evidence in industry marketing and profit-making strategies have been noted [3]–[6]. However, little is known about the potential role of industry sponsorship in the field of nutrition, where not only industry-sponsored studies might be biased: it is also possible that some degree of bias might exist in studies conducted by academic authors who work independently of industry funding. They may have other sources of funding with other interests, and they may have their prejudices, too. In an ideal world free from such biases, a perfect consistency between studies with different sources of funding would be expected. If that consistency is not found, this may represent empirical evidence of bias. This issue requires serious analysis, because biased information about scientific evidence regarding nutrition may negatively affect the health of the entire population. Furthermore, scientific evidence from nutrition research leads to the formulation of governmental and professional dietary guidelines as well as public health interventions and regulation [7], heightening our concern regarding possible partiality or distortion of facts.

The influence of sugar-sweetened beverages (SSBs) on weight gain and obesity has been extensively researched and debated in the last few years [8],[9]. The potential influence of the source of sponsorship has become a crucial issue in this context, because high financial profits are at stake [10],[11]. For example, in May 2008, the Australian Competition and Consumer Commission reported that a marketing campaign for a well-known SSB company was misleading [12]. However, little information exists regarding how research funded by beverage companies or sugar industries may try to counteract detrimental findings by independent researchers, and may contribute to disseminating contradictory and inconclusive information to the scientific community and the general public.

Systematic reviews (SRs) and meta-analyses represent an efficient and comprehensive way to access the available evidence on particular exposure–disease associations. However, publication bias related to authors' conflicts of interest in a SR may affect the reliability of its conclusions. Beverage and sugar industries tend to play leading roles in the reported conflicts of interest of some researchers actively publishing in the field of SSB and obesity. Therefore, we assessed whether the disclosure of potential financial conflicts of interest with these industries was associated with conclusions on SSB consumption and weight gain or obesity in published SRs.

Methods

Standard methods for conducting and reporting SRs were used [13].

We conducted a search of three databases (PubMed [http://www.ncbi.nlm.nih.gov/pubmed/], the Cochrane Library [http://www.thecochranelibrary.com/view/0/index.html], and Scopus [http://www.elsevier.com/online-tools/scopus]) in the time period from the inception of the databases to August 31, 2013. Additional articles were identified from reference lists of relevant studies and reviews. We used a sensitive search strategy in order to retrieve SRs of studies conducted on humans and written in English, Spanish, or French. The following combinations of terms were used: (soft drink or soft drinks or soda or beverage*) and (body mass index or bmi or weight or obes* or overweight). We included all SRs (with or without meta-analyses) that stated specific search criteria and information about the databases used, and that conducted a SR on the topic of SSBs as a potential risk factor for weight gain or obesity.

Two researchers, blinded to the authors' financial conflicts of interest and stated sources of funding, independently extracted the conclusions stated in the articles. The agreement between the researchers was 93.3% (Kappa index: 0.86; p<0.001); disagreement was resolved through a third researcher's assessment, to reach a consensus. Based on these conclusions, we classified the SRs into those that had found a positive association versus those that had not for the relationship between SSB consumption and weight gain or obesity. SRs were considered to have a conclusion of a positive association when they concluded that SSB consumption may increase the risk of weight gain or overweight/obesity. By contrast, SRs were considered to have a conclusion of no positive association when they concluded that there was insufficient evidence to assess the risk of SSB consumption on weight gain or obesity, or when they presented contradictory results without stating any definitive conclusion about the association.

A third researcher classified the SRs according to the authors' financial conflicts of interest or stated sources of funding. Potential financial conflicts of interest were identified if an explicit statement in this regard was made in the text by any of the authors, or if a declared affiliation or financial disclosure by the author evidenced a link with a food industry.

We also evaluated whether the identified SRs used standard methods for conducting and reporting SRs.

The association between stated conflicts of interest and the articles' conclusions was assessed using Poisson regression analysis to adjust for year of publication and whether the article was published in a journal in the first quartile of impact factor within its category (according to ISI Web of Knowledge), or to adjust for the number of citations per year for each SR since its publication. We also adjusted for the existence/inexistence of summarizing point estimates (meta-analyses). Risk ratios and their 95% confidence intervals were calculated. Stata 12.1 (StataCorp) was used for all analyses.

Results

Our final study was based on 17 out of 405 potentially eligible articles (Figure 1) [14]–[30]. Twelve of them focused on adults and child/adolescent populations, four only on children/adolescents, and one only on adults. Twelve were SRs with no meta-analysis (Table 1).

One of the reviews [15] was identified twice because the analyses were reported separately for adults and children/adolescents and achieved different conclusions; therefore we included a total of 18 conclusions from the 17 SRs in the analysis.

Six SRs [17],[19],[21]–[23],[27] declared potential conflicts of interest with industry, and 11 declared having no potential conflicts of interest with industry or did not report on potential conflicts of interest. Among those that reported having no potential conflicts of interest, seven of them stated that grants from governments, universities, or academic research centers funded their studies. Four SRs did not report on sources of funding [16],[20],[24],[30], although two of these SRs explicitly declared having no conflicts of interest [20],[30]. We contacted the corresponding authors for the other two SRs [16],[24], who confirmed that there were no conflicts of interest when the SRs were performed.

Sixty-one percent of the conclusions from the 17 SRs (11/18 conclusions) supported an adverse association between SSB consumption and weight gain or obesity; none reported any significant benefit.

Thirty-three percent (6/18 conclusions) of the conclusions from the 17 SRs were associated with a potential financial conflict of interest. The conflict of interest in four of these six reviews (66.7%) was based on the funding to conduct the SR. However, three out of four SRs in this category stated that the food company did not play a role in the selection or methodological assessment of the included studies, nor in the interpretation of the results or conclusions reached.

Among the SRs that reported having no conflict of interest (11 SRs with 12 conclusions), 83.3% conclusions (10/12) were that SSBs were directly associated with increased weight gain or obesity. In contrast, 83.3% (5/6) of the conclusions from SRs that reported having some conflict of interest with the food industry were that there was insufficient scientific evidence to support a positive association (Table 2). The SRs with conflicts of interest were five times more likely to present a conclusion of no positive association than those without them (95% CI: 1.29–19.34 for the non-adjusted risk ratio). This association remained basically unchanged even after considering the year of publication and the impact factor quartile of the journal in the analysis (adjusted relative risk: 5.16, 95% CI: 1.30–20.48) (Table 3). No substantial modifications were noted when adjusting for the number of citations per year since publication, or the existence of summarizing point estimates (relative risk: 4.71, 95% CI: 1.22–18.13, and relative risk: 5.00, 95% CI: 1.32–18.96, respectively).

We identified only two SRs [15],[29] that specifically reported using the PRISMA guidelines as the standard method for conducting and reporting the meta-analysis. Nine of the SRs were published in 2009 or before, but none of these mentioned the MOOSE guidelines, the standard reference before the PRISMA statement was issued in 2009. One SR [19] reported the use of the Scottish Intercollegiate Guidelines Network as the guideline for reporting the SR. Among the 17 SRs included in our study, only three [15],[17],[29] reported a flowchart of the study search and selection process as recommended by PRISMA.

When we analyzed the original articles included in each SR, we observed the existence of high heterogeneity in the selection of original studies to be included in the SRs. Part, but not all, of this heterogeneity could be explained by differences in inclusion criteria such as the time frame of the meta-analyses, the types of study designs to be included (there were some SRs that included only randomized controlled trials [RCTs], others selected only prospective studies and RCTs, and other SRs also included cross-sectional studies as well as prospective studies and RCTs), and the population included in the meta-analysis (in some SRs only children and adolescents, and in other SRs only adults). We identified two SRs without conflicts of interest [14],[16] and one SR funded by the food industry [19] that did not include in their search strategy all the available literature when the review was undertaken. Similarly, another food industry–funded SR [27] did not include one of the RCTs already included in a previous SR [28], and therefore available at the time of the literature search.

Discussion

The main finding of our assessment was that those SRs with stated sponsorship or conflicts of interest with food or beverage companies were five times more likely to report a conclusion of no positive association between SSB consumption and weight gain or obesity than those reporting having no industry sponsorship or conflicts of interest. This difference could be explained by a potential bias in the design, analysis, or interpretation of the results obtained in the SRs, depending on whether the authors reported having any financial conflict of interest or not.

To our knowledge, this is the first SR that specifically examines the influence of financial conflicts of interest on the conclusions of SRs connecting SSBs and weight gain. Our results concur with those of a previous study that concluded that industry funding of nutrition-related scientific articles may bias conclusions in favor of sponsors' products [7]. The blind and independent assessment by two researchers reinforces the reliability of our data. To maintain objectivity, we did not attempt to acquire independent information about study sponsorship beyond that declared by the authors in their articles. The strengths of our study include the blinded scaling of the conclusions of SRs, and the almost unanimous agreement between the two researchers.

It might be worthwhile to further explore the implications of biased reviews, with their consequent dissemination of flawed information to public health policy makers and medical practitioners. Industry sponsorship is likely to have contributed to this detrimental bias. On the other hand, some researchers argue that industry should be allowed to also play a role because science should not be the dominion of only one segment of society. In their view, the body of literature would be poorer in both breath and scope if some segments were excluded from the research arena [31]. We agree with this view, as industry-funded research projects, large and small, comprise a large proportion of all food science and nutrition research [32],[33], but the present results remain as a reason for concern when interpreting reviews funded by food industries with vested interests in the conclusions of those reviews.

An alternative, but less likely, explanation for our results could be the potential existence of publication bias only among non-industry-funded research projects [34].

Our results showed that potential financial conflicts of interest do influence the conclusions of SRs. It could be argued that we have not assessed which interpretation is truly accurate and that the bias might be on the part of the non-industry-funded researchers because of prejudices or publication bias [34]. However, the interests of food industry (increased sales of food products) are different from a researcher's task (which, at best, is the honest pursuit of knowledge and, at worst, the advancement of her or his career). In addition, the most recently published evidence in this field [35] and a new comprehensive SR and meta-analysis [29] support a positive direct association between SSB consumption and weight gain or obesity. The two largest and best RCTs in children [36],[37] and the largest study assessing the biological plausibility of gene–SSB interactions in adults [38] also support a detrimental effect of SSB on overweight/obesity. Notably, the last review with potential conflicts of interest was conducted in 2009. After that year, research funded by the food industry on this topic centered more on methodological issues than on providing new numerical results [39].

We should consider that, in the first place, scientific endeavor should seek the truth, irrespective of financial or other interests. If other concerns influence the results of research, nutrition science as a whole is likely to suffer, partly because of incorrect information and partly through a loss of confidence in the discipline from the general public. Eventually, nutrition research itself might be at risk because perceived biases would threaten to make it irrelevant. The influence of biased reviews on policy makers and medical practitioners might also be another potential threat for public health [40],[41]. Furthermore, we must take into account the fact that the potential misleading role of the food industry on health issues is greater in developing countries than in developed ones [42].

For all these reasons, the scientific community should make special efforts to preclude funding by parties with vested interests at all levels, to sustain the credibility of nutritional science within the general population and to protect the scientific endeavors in this field. This does not imply that industry sponsorship should be avoided completely, since it serves to drive nutrition research. However, clearly implemented guidelines and principles need to be established, to avoid dangerous conflicts of interest (for example, requiring industry sponsors to sign contracts that state that they will not participate in the selection of data or methodological assessment, nor in the interpretation of the results or conclusions reached) [32]. All the stakeholders should take the necessary steps to achieve this goal. Public health organizations should play a leading role in addressing these issues, to revitalize their upstream political functions and to regain their role in society [43]. In addition, according to Moodie and colleagues, there is no evidence to support the effectiveness or safety of self-regulation and public–private partnerships to improve public health [44]. Indeed, requiring or creating the conditions that would permit the public health sector to work independently of the food industry might actually lead to more significant results, with no threat of bias.

Our results confirm the hypothesis that authors of SRs may draw their conclusions in ways consistent with their sponsors' interests [45]. Researchers working with or sponsored by the industry may be subjected to conscious or unconscious pressure, and they need help to resist such pressure. In this context, journal editors have a role in reducing this potential bias by formulating and reinforcing policies that require the disclosure of conflicts of interest, and assuring that objective standards are achieved [46]. A uniform and full disclosure of conflicts of interest is an important, though not the only, step in the prevention of bias in research, though some might consider it excessively burdensome [47].

Summarizing, conclusions that are based on evidence about SSBs and weight gain substantially differ depending on the authors' financial conflicts of interest. SRs supported by beverage and sugar industries frequently reported a lack of association between the consumption of SSBs and obesity, leading to contradictory results when compared to original studies included in the SR. However, most reviews that reported having no conflicts of interest argued that current evidence justified public health strategies that discourage the consumption of SSBs. This lack of consistency between both groups of SRs suggests an empirical evidence of bias.

Conclusions

SRs with financial conflicts of interest were five times more likely to present a conclusion of no positive association between SSB consumption and obesity than those without them.

Our findings serve to draw attention to possible inaccuracies in scientific evidence from research funded by the food industry.

Supporting Information

Attachment 1

Attachment 2

Attachment 3