Impacts on Breastfeeding Practices of At-Scale Strategies That Combine Intensive Interpersonal Counseling, Mass Media, and Community Mobilization: Results of Cluster-Randomized Program Evaluations in Bangladesh and Viet Nam
Phuong Nguyen and colleagues present a cluster-randomized program evaluation of strategies combining intensive interpersonal counseling, mass media, and community mobilization to improve breastfeeding practices.
Published in the journal:
. PLoS Med 13(10): e32767. doi:10.1371/journal.pmed.1002159
Category:
Research Article
doi:
https://doi.org/10.1371/journal.pmed.1002159
Summary
Phuong Nguyen and colleagues present a cluster-randomized program evaluation of strategies combining intensive interpersonal counseling, mass media, and community mobilization to improve breastfeeding practices.
Introduction
Globally, only 38% of infants are exclusively breastfed during their first 6 mo of life [1,2]. One of the six Global Nutrition Targets 2025 endorsed by the World Health Assembly is to “increase the rate of exclusive breastfeeding in the first 6 months up to at least 50%” [3]. Despite the well-documented benefits of exclusive breastfeeding (EBF) [4,5], and longstanding inclusion of interventions to improve EBF in child survival [6] and nutrition [4] strategies, tracking of global child survival goals shows slow progress in achieving adequate EBF levels in most developed and developing countries [2,7]. Past EBF promotion approaches, although often successful [8–10], have generally failed to achieve and maintain scale [11–13]. Achieving the ambitious World Health Assembly target for EBF will require a greater focus on effective delivery platforms [11] with multipronged approaches to implement successful programs at scale [10], including approaches that tightly link policy advocacy, investments in human resource development, data-driven implementation, research, and evaluation [12].
Suboptimal breastfeeding practices, including non-exclusive breastfeeding, contribute to 11.6% of mortality in children under 5 y of age [1]. Breastfeeding also prevents illnesses and provides essential nutrients for optimal child growth and development during the first 2 y [1,14,15], conveys several benefits for the mother [16], and may even have long-term effects on IQ and income [17]. Currently, the World Health Organization recommends initiation of breastfeeding within 1 h of birth, EBF until 6 mo of age, and continued breastfeeding until 2 y of age or beyond.
Systematic reviews have documented the impact on breastfeeding practices of various approaches, including those based on the use of individual- and group-based peer counseling and contact with lay counselors or trained personnel [8,9]. The studies reviewed, however, are generally implemented at small scale and under relatively controlled conditions. The reviews highlight the need to rigorously test the effectiveness of these and similar strategies when implemented at large scale. Although one study reports on the results of at-scale programs [18], the adequacy design used [19] does not provide irrevocable evidence that shifts in practices were attributable to the intervention strategies promoted by the program. A new review [10] provides evidence that combinations of interventions delivered through different platforms are more effective than single interventions, and recommends incorporation of combined strategies using complex adaptive systems for scaling up. However, to our knowledge, there are no studies, that combine at-scale programming with a rigorous evaluation using a randomized study design. Therefore, public health evidence on whether the magnitude of impacts on breastfeeding practices seen in efficacy studies and synthesized in systematic reviews can be achieved when programs operate at scale under real-life conditions is lacking [11,12].
This paper reports on findings from cluster-randomized impact evaluations of two at-scale programs, in Bangladesh and Viet Nam, that provided intensified interpersonal counseling (IPC) to pregnant women and mothers of children up to 2 y of age, combined with mass media (MM), community mobilization (CM), and policy advocacy (PA) intervention components, to improve breastfeeding practices [20]. The two program models that were evaluated reached large scale through distinct delivery platforms. In Bangladesh, IPC and CM were delivered by the community-based health platform of a large non-governmental organization (BRAC) through its network of field officers, community-based frontline workers (FLWs), and volunteers. In Viet Nam, IPC and CM were delivered through a social franchising approach integrated within the facility-based government health system [21]. In both countries, a nationwide MM campaign was implemented, as well as PA, to create a supportive environment for optimal infant feeding practices. Both implementation models used data-driven approaches that were focused on impact and delivery at scale and adapted to implementation conditions and context, thus fulfilling several elements recently identified as critical to scaling up impact on nutrition [22], and specific elements central to scaling up breastfeeding in particular [12].
Methods
Ethical Approval
Approval for the study was obtained from the institutional review board at the International Food Policy Research Institute (IRB #00007490), the Bangladesh Medical Research Council (IRB #BMRC/NREC/2007-2010/99), and the Vietnam Union of Science and Technology Associations (IRB #0904). All mothers of study children were provided with detailed information about the study verbally and in writing at recruitment. Verbal informed consent was obtained from mothers in Bangladesh; written informed consent was obtained in Viet Nam.
Evaluation Design
A cluster-randomized, non-blinded impact evaluation design was employed in each country to compare the impact of two Alive & Thrive (A&T) intervention packages, i.e., an intensive package consisting of intensified IPC, MM, CM, and PA compared to a non-intensive package consisting of standard nutrition counseling on breastfeeding along with less-intensive MM, CM, and PA on the primary and secondary outcomes of interest. Table 1 describes the interventions and the differences between the intensive and non-intensive packages. Cross-sectional household surveys were conducted at baseline (2010) and 4 y later (2014) in the same communities, among households with children under 6 mo of age. The questionnaires administered at each survey round were the same, with the exception of a detailed set of questions to measure program exposure included at endline. Within a large rollout of the intensive intervention package in both countries, 20 sub-districts (upazilas) in Bangladesh and 40 communes in Viet Nam were randomized to either the intensive or non-intensive intervention. The technical rationale for the impact and process evaluation approach used for A&T is available elsewhere [23,24]. The process evaluation used a variety of methods, tailored to implementation timelines, and data were collected in 2011, 2012, and 2013 in both countries. In both countries, the evaluation was restricted to a smaller geographic area than the full coverage area of the program.
In both countries, the evaluation was conducted in a subset of the total number of geographic areas chosen for programming. In Bangladesh, the program areas and the subset of evaluation areas were both rural. In Viet Nam, the program areas included both urban and rural areas, but the subset of evaluation areas were rural. At the outset of the evaluation, given the challenges of generalizability of a combined urban-rural evaluation model in Viet Nam, a decision was made to focus on rural areas only for the evaluation. By selecting rural areas only, we tried to ensure that the pool of areas included in the randomized allocation were somewhat homogenous.
The implementation teams were distinct from the evaluation teams. In Bangladesh, the implementation team was BRAC and FHI360, and the data collection team came from DATA, a survey research firm that had limited interactions with the implementation team. In Viet Nam, the implementation team was Save the Children and the government health system, and the data collection team came from the Institute of Social and Medical Studies. International Food Policy Research Institute researchers in charge of the evaluation connected and shared the information between the implementation and evaluation teams.
The study was registered at ClinicalTrials.gov in August 2012, about 2 y after the start of the program evaluation (April 2010). The sole reason for the delay in registering the trial was our understanding, at the time the study was initiated, that a program evaluation did not warrant registration, given the distinct differences between program evaluations and standard clinical trials. However, as discussions grew in the program evaluation community for preregistration of impact evaluations [25], a decision was made to register this program evaluation in a trial registry to ensure transparency and public availability of this information. No changes were made to the planned evaluation design or the planned analyses in the period between the design of the evaluation in 2010 and the registration of the evaluation in at ClinicalTrials.gov in 2012.
Interventions
In Bangladesh, BRAC delivered intensified IPC and CM in 50 rural sub-districts in five of six divisions (later subdivided into seven) through its existing countrywide Essential Health Care program that already included standard counseling (S1 Fig) [26]. For standard nutrition counseling (available in both non-intensive and intensive areas), BRAC FLWs, called Shasthya Kormi, and health volunteers, called Shasthya Sebika, conducted routine home visits and provided standard information on infant and young child feeding (IYCF) practices, including breastfeeding. In intensive areas, IPC was based on multiple age-targeted IYCF-focused visits to households with pregnant women and mothers of children up to 2 y of age by the FLW and volunteer, as well as home visits by a nutrition-focused FLW, called Pushti Kormi, who was an additional human resource to provide more skilled support for breastfeeding and complementary feeding. In these areas, Shasthya Kormi and Pushti Kormi conducted monthly home visits and introduced age-appropriate IYCF practices, coached mothers as they tried out the practices, and engaged other family members to support the behaviors (see Table 1 for more details). These workers were supervised using observation checklists, and their workload was monitored. Cash incentives (US$6–US$8/mo) were given to the volunteers in the intensive areas for intervention delivery performance, which included ensuring high coverage, carrying out age-appropriate counseling at home visits, and collecting maternal reports of practicing the recommended behaviors. Households were unaware of this performance incentive. In intensive areas, CM included sensitization of community leaders to IYCF, and community theater shows focused on IYCF. The MM component consisted of the national broadcast of seven TV spots that targeted mothers, family members, health workers, and local doctors with messages on various aspects of IYCF; two of the spots focused on breastfeeding. Buys of media airtime were designed for multiple airings during the country’s most watched programs. In intensive areas that had limited electricity and TV access, supplemental activities were conducted to air the TV spots, and other IYCF films produced by the project, through local video screenings. PA included workshops to share data, engagement of journalists to broaden reporting on IYCF in the media, creation of an IYCF alliance and other such activities, which aimed at creating additional countrywide awareness of policies and programs to support breastfeeding.
In Viet Nam, standard nutrition counseling (available in both non-intensive and intensive areas) consisted of messages and information on IYCF delivered as part of routine child health care contacts at the government health facilities. Intensive areas received A&T program activities, which were implemented in 15 of 63 provinces (S2 Fig). Save the Children worked with the government of Viet Nam to establish a total of 781 government health facilities at the province, district, and commune levels that used a social franchising model, called Mat Troi Be Tho (MTBT), to deliver facility-based individual and group counseling. All facilities were required to meet minimum criteria including a standardized counseling room, trained staff, and availability of job aids and client materials. The program aimed to deliver 9 to 15 counseling contacts to each mother-child pair from the last trimester of pregnancy through the child’s first 2 y of life, including eight breastfeeding-focused contacts in the first 6 mo of life. Referrals, CM, promotional print materials, and TV advertising were used to generate demand for preventive IYCF counseling services, a concept new to most families. Training and supervision, incentives to the health facilities, and tools to collect data were applied to improve the quality of services. The MM component consisted of a nationally broadcast campaign using TV and the digital space (internet and mobile phone applications); three of four TV spots focused on breastfeeding. In intensive areas, the MM campaign also included additional out-of-home advertising through billboards and LCD screens. PA at the national and provincial levels targeted the extension of paid maternity leave to 6 mo, strengthening of the code of marketing of breast milk substitutes, and improving provincial planning for IYCF and nutrition actions.
The major components of the interventions started at the same time in all intervention areas in both Bangladesh and Viet Nam (Fig 1). In Bangladesh, intensified IPC began in 22 sub-districts (upazilas) by August 2010 and in another 28 sub-districts by August 2011. MM was launched in December 2010 and intensified to reach national coverage by February 2011. CM was operational in August 2010. In Viet Nam, IPC was initiated in March 2011, MM in November 2011, and CM in March 2011. PA activities commenced in August 2010 in both Bangladesh and Viet Nam. With the endline survey in 2014, the total duration of implementation of the full intensive package of interventions was about 3 y in both countries. All components continued uninterrupted throughout the implementation period once they had started. See Box 1 for information on A&T’s approach to operating at scale and Box 2 on the development of the MM campaign.
Box 1. Delivering Infant and Young Child Feeding Interventions at Scale: The Alive & Thrive Approach
The A&T programs in Bangladesh and Viet Nam operated from the outset with an “at scale mindset,” requiring the building of partnerships across diverse stakeholders. To reach large numbers of mothers with sufficient support for improving IYCF practices required the utilization of program platforms with existing high coverage such as the national primary health care system in Viet Nam and BRAC’s nationwide community-based networks of FLWs and volunteers in Bangladesh. Behavior change on a large scale required the strategic use of multiple harmonized communication channels with proven high reach and working with various types of opinion leaders. Mothers and family members needed to buy into benefits of the recommended practices that were of salience to themselves and their families. Mothers needed to feel confident about the feasibility of making changes, and families and mothers needed to perceive that social norms were shifting. The achievement of scale itself was intended to help shift the perception of social norms related to recommended feeding practices.
The A&T initiative was expected to demonstrate that improvement in IYCF could be achieved on a large scale in diverse contexts. Each country program was guided by formative research that narrowed the program focus to key leverage points for changing behaviors among mothers in each context, from among the many potential factors that influence IYCF practices. Streamlining was key for both countries and allowed us to set ambitious targets for the millions of pregnant women and mothers of children under 2 y to be reached with intensified IPC and for influential family/community members to be reached through multiple MM channels, advocacy, and CM. In 2013, at the height of implementation, approximately 17 million children under 2 y of age lived in the 50 of 493 sub-districts in Bangladesh where BRAC provided intensified IPC. Between December 2011 and February 2014, BRAC conducted almost 2.2 million home visits to mothers of children 0–5.9 mo. This required training more than 11,000 FLWs and supervisors in BRAC alone. Training was also provided to government staff and other stakeholders as part of support given to a national IYCF alliance formed for this purpose. Evidence of improved practices from early monitoring results, and an increasingly streamlined operational model with ready-made tools, facilitated other stakeholders’ joining the national IYCF initiative. The Viet Nam program worked with the government health system to establish an innovative social franchise model, MTBT, to deliver IYCF counseling at health facilities. Approximately 800,000 children under 2 y of age lived in 15 of the country’s 63 provinces where franchises were first established; between January 2012 and December 2014 there were 1.1 million counseling contacts with mothers of infants 0–5.9 mo of age at these franchises. Reaching this number of contacts required overcoming caregivers’ lack of experience in seeking preventive counseling and required community outreach and TV advertising to generate demand.
These large numbers of contacts were further enhanced with the addition of national MM campaigns to reach an estimated 8.5 million mothers of children below 2 y during more than 3 y in Bangladesh, and over 2 million mothers in Viet Nam. In addition, the media campaigns reached fathers, grandmothers, community leaders, physicians, village doctors, non-governmental organization workers, government FLWs, and policy makers. In each country, national and provincial or regional advocacy led to greater awareness of IYCF practices in communities and an improved enabling environment that supported investments in scaled-up programs and helped push the boundaries of scale even further.
For further reading, see the report “Scaling up in Agriculture, Rural Development, and Nutrition” [27] and the Food and Nutrition Bulletin 2013 supplement “Designing Large-Scale Programs to Improve Infant and Young Child Feeding in Asia and Africa” [28].
Box 2. Development of the Alive & Thrive National Mass Media Campaigns
A&T used proven processes to design, produce, and conduct its MM campaigns, following eight steps: (1) situation analysis, (2) formative research and a media audit, (3) media habit studies, (4) development of a communication strategy, (5) concept testing, leading to creative development of prototype materials, (6) material pretests followed by revisions, (7) material production, media planning, and media buys, and (8) campaign implementation and ongoing monitoring, leading to mid-course adjustments. The process ensured that A&T identified feasible behaviors for mothers to adopt, narrowing the focus to critical leverage points for changing behaviors, emotionally compelling storylines and audiovisuals, and strategic placement in the media to reach each audience segment repeatedly over a sustained period of time. In both Bangladesh and Viet Nam, media airs were timed to reach multiple audiences with frequent, repeated exposure with effective materials.
A&T’s MM campaigns were designed to influence the adoption of optimal breastfeeding behaviors by
greatly increasing the number of mothers repeatedly exposed to the program’s messages;
reaching additional audiences nationwide—fathers, grandmothers, physicians, village doctors and pharmacists, government and non-governmental organization FLWs—who influence and support mothers’ behaviors;
presenting compelling and positive stories that operate at an emotional level to help increase mothers’ self-efficacy and to shift the perception of social norms;
reinforcing FLWs’ and volunteers’ commitment to IYCF and reminding them of key messages;
lending credibility to community volunteers’ and health workers’ messages about breastfeeding by delivering them through “doctors” in TV stories with endorsements by the Ministry of Health and international agencies (in Viet Nam);
consistently delivering the program’s tested messages in a standardized way across thousands of communities and diverse audience segments;
reaching scale rapidly and preparing the ground for better uptake of messages delivered through direct interpersonal contacts that took several months to scale up;
provoking conversations about IYCF in communities, doctor offices, and families, sometimes for the first time, through exposure to deeply meaningful stories such as babies asking to be breastfed, a child saving his father’s life, and a new mother asserting her right to breastfeed her newborn immediately after delivery;
preventing a decline in motivation and knowledge/skills of FLWs following their training by acting as reminders over the years;
building community demand for the counseling services provided by health workers and community volunteers.
For further reading, see a description of A&T’s MM campaigns online [29].
Primary and Secondary Outcomes
The primary outcome of the analysis presented in this paper is EBF in the previous 24 h, defined as the proportion of mothers of infants 0–5.9 mo of age who fed only breast milk (based on a previous-day recall of all foods and liquids) [30]. A key secondary outcome is early initiation of breastfeeding (EIBF), defined as the proportion of infants who were reported by mothers to have been put to the breast within 1 h of birth. Other related breastfeeding behaviors were also measured. Women with obstetric complications or cesarean delivery were included in the counts in determining EIBF. We categorized breastfeeding as exclusive, predominant (infant given water, water-based drinks, fruit juice, or ritual fluids in addition to breast milk), partial (infant given liquids and non-liquids such as milk, non-milk-based products, and other foods in addition to breast milk), and no breastfeeding [31], and also report EBF for the age bands 0–0.9 and 1–5.9 mo. We assessed prelacteal feeding based on maternal recall of foods consumed by the infant immediately after birth and during the first 3 d of life. Intervention exposure was measured by maternal recall of FLW home visits in the last 6 mo, recall of attendance at a CM event in the last 1 y, recall of ever having seen an A&T-promoted TV spot, and recall of specific breastfeeding messages contained within the TV spot. To help address the challenge of recall-based self-reported measures of breastfeeding, we collected information on infant diarrhea (defined as three or more loose stools in a 24-h period [32]).
Sample Size Estimations
Sample size calculations were carried out to determine the sample size needed to detect differences in the primary outcome, i.e., EBF, between the two intervention groups at endline, considering an alpha of 0.05, power of 0.80, intra-class correlation (ICC) of 0.01 (estimated from previous national or sub-national surveys), and estimated baseline prevalence of EBF of 43% in Bangladesh and 30% in Viet Nam. We hypothesized that the intensive intervention would increase the primary outcome indicator, and therefore a one-sided test was used. For cost and logistical reasons, 20 clusters (sub-districts) were selected to be randomized in Bangladesh, and 40 clusters (communes) in Viet Nam. In Bangladesh we estimated that a sample size of 49 infants aged 0–5.9 mo per cluster—for a total sample of 980 (490 per group)—was sufficient to detect a difference at endline in the practice of EBF of 10 percentage points (pp) or larger. In Viet Nam, we estimated that a sample size of 23 infants per cluster—for a total sample of 920 (460 per group)—was sufficient to detect a minimum difference of 9 pp. Prior to conducting the endline survey, we re-verified sample size estimates based on the original sample size, the observed baseline EBF prevalence in our sample, and the ICC for EBF from the baseline survey (ICC of 0.04 for Viet Nam, and 0.1 for Bangladesh). No changes in sample sizes were made at the endline survey, based on these parameters and anticipated effect sizes based on the baseline survey.
Randomization and Blinding
In Bangladesh, 100 sub-districts, across five divisions, were selected by BRAC as possible A&T intensive areas based on high poverty, stunting levels in excess of 30% among children < 5 y of age, and non-inclusion of the sub-district in the government National Nutrition Program. This list was narrowed to 78 based on geographic proximity (i.e., within the same agro-ecological and/or administrative zone, also called a division in Bangladesh), size, and other operational aspects to ensure homogeneity across the sample. The first phase of implementation took place in 50 of these sub-districts. Within each of five divisions, four sub-districts were randomly selected for inclusion in the evaluation sample using a computer program, for a total of 20 sub-districts. Sub-districts within each division were then randomly assigned, using a computer program, to either the intensive (10 sub-districts) or non-intensive (10 sub-districts) intervention. The randomization process was carried out in the presence of BRAC and A&T staff and the program evaluators in BRAC’s headquarters in Dhaka.
In Viet Nam, 15 provinces were selected for program implementation based on stunting levels, absence of other large organizations working in nutrition, population density, and representation of the different ecological regions covered by the initiative. Four rural provinces, representing four distinct ecological zones, were then selected for inclusion in the evaluation sample, and within these provinces, ten rural districts; two to six communes per district were selected for the evaluation sample based on the presence of a health center that met the eligibility criteria for the A&T franchise model; this ensured homogeneity across the sample. Communes were randomly assigned to either the intensive (20 communes) or non-intensive (20 communes) intervention. The randomization process was carried out using a simple public lottery system in the presence of local, district, and provincial health authorities as well as the program evaluators.
In both countries, households within the intensive and non-intensive areas were not explicitly made aware of the results of the randomization. Additionally, there was no blinding of the intervention at the level of service delivery.
Sampling and Data Collection
In Bangladesh, within each sub-district, five unions and two villages within each union were randomly selected, to yield a total of 200 villages. Each village had an average size of 250 households. Within each village, a household census was conducted at baseline and endline to list mothers and infants and infants’ date of birth. A list of all households with infants less 6 mo of age was then drawn up. In Viet Nam, communes were sampled, and household listings were obtained from the health authorities, which maintain all birth records. In both countries, from these census lists that identified all households with children < 6 mo of age, households were selected for the survey using systematic sampling beginning with a random seed start point, to yield the desired sample size per cluster. Household visits for the survey were conducted only after sampling the desired number of households per village/commune. Desired sample sizes were 50 households per village in Bangladesh and 25 households per commune in Viet Nam. In Viet Nam, when there were insufficient infants within a commune due to small population sizes, we oversampled infants from another commune within the same district and intervention group.
A household questionnaire was administered to mothers of children under 6 mo of age to collect data on primary and secondary outcomes, along with data on several other household, maternal, and child characteristics (S1 Table). The interview was conducted in the local language, and almost all interviewees agreed to participate in the surveys. The refusal rate among mothers selected for inclusion through the random selection process and contacted was 0.9% for Bangladesh and 0.6% for Viet Nam. We excluded only mothers who had a clear mental disability, defined as inability to answer basic questions about their name or willingness to be interviewed that would prevent them from understanding and answering the questions.
Statistical Analysis
Baseline differences between the two interventions were tested using ordinary least squares regression models (continuous variables) or logit regression models (categorical variables) with random effects, accounting for child age, sex, and geographic clustering [33]. We derived difference-in-differences estimates (DDEs) of impact using fixed-effects regression models that assessed differences between the two study groups over time [34]. The difference-in-differences method relies on comparing the difference in changes (i.e., differences) between baseline and follow-up in the intervention and control groups. Even though there are other methods of attributing the impact of interventions, the difference-in-differences method with randomization allows a best estimate of the impact attributable to the program by taking into account the changes in outcomes that may occur among the non-beneficiary population as a result of non-program factors such as secular trends, other types of programs, or climate-related or other types of shocks that may have independent positive or negative impacts on the study’s main outcomes. Difference-in-differences impact analyses have been widely used in health and nutrition impact evaluations [34].
We present intent-to-treat DDEs adjusting for geographic clustering, infant age, and gender. Using a subset of five items adapted from Reynolds [35] that were collected in the endline survey, we conducted a robustness analysis for EBF to test for social desirability bias, i.e., tendency of respondents to respond so as to be viewed favorably by others. Data analysis was performed using STATA 13; a statistical analysis plan was developed prior to endline data collection and discussed with the funder and program implementers. Although the prespecified plans assumed a one-sided test, we conducted analyses using two-sided tests to allow for the possibility of uncovering unexpected effects.
Results
Trial Flow
No evaluation clusters were lost to follow-up (Fig 2); none crossed from non-intensive to intensive during implementation. In Bangladesh, cluster size varied little across clusters or over time; in Viet Nam, there was greater variability, reflecting commune population size.
Sample Characteristics
Desired sample sizes were achieved at baseline (June 7–August 29, 2010, in Viet Nam; April 28–June 26, 2010, in Bangladesh) and endline (June 16–August 30, 2014, in Viet Nam; April 20–June 23, 2014, in Bangladesh) in both countries. In Bangladesh, 977 households were surveyed at baseline, and 998 households at endline. In Viet Nam, achieved sample sizes were 948 at baseline and 1,002 at endline.
The two intervention groups were well-balanced for characteristics potentially associated with intervention effects in both countries (e.g., infant age and sex, household economic status, and maternal education and nutrition). In Bangladesh, there were small differences at baseline in maternal age, maternal employment, and household headship, and a 10.0-pp difference in ownership of agricultural land (Table 2). In Viet Nam, a higher mean level maternal mental stress and slightly higher mean level of mild food insecurity were seen in the non-intensive group at baseline.
Impact of Intervention on EBF and Other Breastfeeding Practices
DDEs (Fig 3) show that there were greater increases between baseline and endline in the proportion of women practicing EBF in the intensive group than in the non-intensive group, both in Bangladesh (36.2 pp, 95% CI 21.01–51.46, p < 0.001) and Viet Nam (27.9 pp, 95% CI 17.74–38.07, p < 0.001) (Fig 3). The proportion of women practicing EBF in the intensive group increased from 48.5% to 87.6% in Bangladesh, and from 18.9% to 57.8% in Viet Nam. There was no significant increase in the proportion of women practicing EBF in the non-intensive group over time in Bangladesh, but an increase of 10.0 pp in Viet Nam.
In the intensive group in Bangladesh, effects on EBF were primarily achieved through replacement of partial breastfeeding with EBF (Fig 4). In Viet Nam, effects on EBF were primarily achieved through replacement of predominant breastfeeding with EBF (Fig 5). In Bangladesh, DDEs were also statistically significant for EIBF (16.7 pp, 95% CI 2.78–30.57, p = 0.021) and feeding of prelacteals during the first 3 d after birth (−49.3 pp, 95% CI −65.60 to −32.92, p < 0.001); in Viet Nam, DDEs were statistically significant for feeding of prelacteals during the first 3 d after birth (−18.8 pp, 95% CI −30.86 to −6.15, p = 0.003), formula use during the first 3 d after birth (−22.4 pp, 95% CI −33.53 to −10.67, p < 0.001), and bottle feeding in the first 6 mo (−13.0 pp, 95% CI −20.26 to −5.54, p < 0.001) (Table 3).
EBF in children under 1 mo of age did not differentially improve by intervention group in either country. Impacts in both countries were due to the differential improvements in EBF in favor of the intensive group among children 1–5.9 mo (Table 3).
Intervention Exposure
In the 6 mo preceding the survey, mothers in Bangladesh reported receiving 6.6 visits by the IYCF worker (Pushti Kormi) and health volunteer (Shasthya Kormi) trained to deliver nutrition-related IPC as part of A&T, while mothers in Viet Nam visited the health facilities for counseling an average of two times (Table 4). Fidelity in terms of contacts with FLWs and volunteers was high in Bangladesh (85%–98%, depending on the type of FLW or volunteer), whereas use of the health facility in Viet Nam was lower (<50% reported visiting the A&T franchise facility [MTBT] in intensive areas). In both countries, the breastfeeding-related knowledge of FLWs and volunteers was higher in intensive compared to non-intensive areas. Attendance at a CM session ranged from 12% to 22% in the intensive group in Bangladesh. Maternal exposure to the TV spots was 61%–64% in Bangladesh, and did not differ between groups. Similarly, exposure to TV spots was 70% in Viet Nam, with no statistically significant differences between groups. As expected, awareness and exposure to the social franchise brand was significantly higher among individuals in the intensive than in the non-intensive group.
Accuracy of Main Outcome Measures
We measured social desirability in both countries to assess, and account for, potential biases in our main impact estimates for reported breastfeeding practices (S1 Text). We found evidence of a social desirability bias for EBF in Viet Nam, but not in Bangladesh (S3 Fig). There was no evidence of this bias for other breastfeeding outcomes (S4 Fig). In Viet Nam, as social desirability scores for EBF increased, reported EBF increased in both groups, but more so in the intensive group. After adjusting for this differential increase, the impact estimate for EBF in Viet Nam remained strong and statistically significant (DDE 15.2 pp, p = 0.008). In addition, based on the premise that diarrhea could potentially be lower in the EBF group, we cross-checked EBF self-reports and infant diarrhea and found that the prevalence of diarrhea was indeed lower among EBF infants than among non-EBF infants (3.2% versus 5.0% in Bangladesh, p = 0.044, and 3.7% versus 9.7% in Viet Nam, p < 0.001).
Discussion
An at-scale behavior change program that focused on integrating intensified IPC, MM, and CM (the A&T intensive intervention) had a greater impact on breastfeeding practices, especially EBF than MM with standard nutrition counseling (the A&T non-intensive intervention), within the context of national advocacy to create a supportive environment for optimal feeding practices. In Bangladesh and Viet Nam, the proportion of women who reported practicing EBF in the previous 24 h among children <6 mo was 36 pp and 28 pp higher, respectively, in the intensive compared to the non-intensive intervention areas. In Bangladesh, where intensified IPC was delivered through repeated home visits at critical ages combined with CM, the proportion of women practicing EBF at endline was 88% in the intensive group (from a baseline prevalence of 49%). In Viet Nam, the proportion of women practicing EBF reached 58% (from a low 19% at baseline) through a facility-based delivery model for IPC that was built on principles of social franchising and helped strengthen the health system’s capacity to deliver counseling. These impacts were seen despite positive changes in household economic conditions, maternal education, and occupation that in many settings in Asia are associated with lower rates of EBF [36].
The higher EBF prevalence in the intensive compared to the non-intensive group at endline in Bangladesh and Viet Nam is comparable to results from systematic reviews of breastfeeding promotion interventions [8,9]. By contrast with previous literature, the magnitude of the effect we report was achieved in a large at-scale program. In Bangladesh the intensive approach was implemented in 50 of 493 rural sub-districts, 20 of which were in the evaluation. Based on program monitoring, BRAC reported conducting 2.2 million home visits focused on the promotion of EBF to mothers of infants 0–5.9 mo old between December 2011 and February 2014. In Viet Nam, a total of 781 A&T franchises in 15 of 63 provinces (four of which were in the evaluation) were operational at endline, and there were 1.1 million counseling contacts with mothers of infants 0–5.9 mo of age at health facilities between January 2012 and December 2014. The Bangladesh results are generalizable to other program models that rely on incentivized community volunteers and/or skilled FLWs conducting home-based or community IPC and CM, and suggest that intensifying and strengthening contacts and linking them with MM could have significant benefits [37,38]. The results for Viet Nam are applicable to other countries where primary health care utilization is high, MM reach is almost universal, and facility-based platforms can be used to deliver preventive and curative health care. In Viet Nam, the four provinces selected for evaluation were representative of the A&T program areas in terms of geographic regions (north, south, and central). Compared to the rest of the country and parts of the program areas, however, they were more rural and had a higher level of stunting. Similarly, in Bangladesh, the program was operational primarily in rural areas. Therefore, the results are primarily generalizable to rural areas served by government health services (in countries like Viet Nam) and rural areas in countries like Bangladesh.
The A&T model for improving breastfeeding at scale was initiated in 2008, and developed in 2009–2010, based on prior experience [18]. Much of the evidence on the impacts of breastfeeding [1], and on elements necessary to assure scale up of breastfeeding programs using multiple platforms and data-driven coordinated efforts [12], was available only after the initial development of the A&T model. This rigorous evaluation of a complex intervention now deeply strengthens the programming evidence base for improving breastfeeding, and supports the data-driven and adaptive approach that has been recommended but not always put into practice. The A&T model, thus, provides guideposts for developing a practical and well-coordinated approach that links PA, strengthening of systems for implementation at scale, and the use of data from formative research, monitoring, and evaluation.
The plausibility of our findings are strengthened by the findings from a process evaluation [21,39,40] on service delivery and intervention exposure. Interventions were implemented largely as designed in both countries [21,40,41], but demand-side constraints to use of facilities were a challenge in Viet Nam [39]. In Bangladesh, intensified IPC was delivered well by FLWs, who were incentivized and monitored to cover all targeted households; achieved coverage was very high. In Viet Nam, high-quality counseling was established in the intensive group compared to the non-intensive group [21]; since reach was dependent on mothers visiting the health facilities, and subject to demand-side constraints, the model achieved lower coverage [39] than the outreach-based model in Bangladesh. MM reached a substantial proportion of the population in both settings, and we saw evidence of shifts in some breastfeeding practices in the non-intensive group as well. It is likely the MM played multiple roles and worked synergistically with the IPC, but our evaluation design does not tease these apart.
A challenge in assessing impact on feeding practices is the use of recall-based self-reported measures. Our study was subject to this challenge, particularly because the intervention included a MM component that provided regular reminders of recommended behaviors. Although we did not collect data on lactational amenorrhea, we did collect information on infant diarrhea (reported by the mothers). We compared differences in diarrhea prevalence between groups, finding, as expected, that there was lower prevalence of diarrhea among EBF infants compared to non-EBF infants. We also assessed the role of social desirability in relation to the main impact indicators [35]. In Bangladesh, the results were unaffected by respondents’ desire for social approval. In Viet Nam, it appears that respondent desire for social approval had some influence on reporting (S1 Text), which was differential between intervention groups, but strong and significant intervention effects were still demonstrated after accounting for this reporting bias.
In both countries, the evaluation was restricted to a significantly smaller geographic area than the true coverage of the program. In order to assess the possibility that there was a differential quality of service delivery due to the non-blinded nature of the intervention, we randomly assessed service delivery in a subset of intensive areas that were not included in the impact evaluation. We found no evidence of differential quality of service delivery in either country, further supporting the external validity of the evaluation findings to the at-scale program in both countries.
From the perspective of understanding the scaling up of a successful breastfeeding program, and the special efforts made by this initiative to ensure delivery of a comprehensive set of interventions at large scale, an analysis focused on the scaling up of this program identified the presence of several critical elements for scaling up [22]. Specifically, the program appears to have successfully included multiple elements deemed necessary for successful scale-up, including the following: (1) a vision for impact on breastfeeding; (2) finding the right combination of interventions and operational contexts in the two countries; (3) having access to adequate, stable, and flexible financing to stay adaptive and goal-focused; (4) actively engaging champions and alliances via PA; (5) using multiple pathways to scaling up—expanding and strengthening the capacities (increasing FLWs in Bangladesh and establishing counseling rooms within facilities in Viet Nam); and (6) including adequate learning through the use of data and learning. Much of what occurred in the context of this program also reflects elements of the complex adaptive health care systems framework [42,43]. Looking forward, assessments of the sustainability of these actions at scale will be needed to understand the extent to which these investments led to a sustained legacy focus on infant feeding in the context of the BRAC program in Bangladesh and the health system in Viet Nam.
Given that the A&T intervention was a large-scale intervention involving IPC, MM, and CM, there was some potential for between-group contamination. In Bangladesh, there was no between-group contamination because the sub-districts were administratively separated for implementation, and we verified the lack of contamination through routine interactions with the program implementation team. In Viet Nam, since the communes were situated within districts that were in turn located inside the provinces chosen for the overall A&T program, there was potential for some between-group contamination. We assessed this contamination informally in 2013 and ascertained that some content-related overlap had occurred in refresher training of health workers. Given that between-group contamination is likely to have dampened intervention effects, overall intervention effects may have been even higher than those seen.
This study was not designed to assess the impact of MM alone on breastfeeding practices, because the media campaign was implemented nationwide. Similarly, our design did not allow us to isolate the contributions of the nationwide PA activities, which aimed to create an enabling environment for implementation and scale-up of IYCF programs in the country. Our impact estimates may thus underestimate the full potential of such a multipronged intervention because the evaluation lacks a “pure control” area with no MM or national/provincial PA. Lastly, the EBF indicator itself (EBF in the previous 24 h), though currently recommended by WHO, has limitations. Most notably, it is reflective only of the previous day’s practice and does not inform about usual or continued breastfeeding practices over time. A study of the dynamics of EBF in Peru showed that mothers switched back and forth between exclusive and predominant breastfeeding during the first 6 mo of the child’s life [44]. The possibility of this practice is also supported by smaller scale qualitative research in our process evaluations [45,46]. Although there is some evidence that the EBF indicator is accurate [47], further research is needed to develop stronger and more reliable indicators of EBF, beyond the 24-h recall-based indicator that is currently used.
Conclusion
Evidence has been mounting on the positive impacts of breastfeeding on a range of maternal and child health outcomes in diverse settings [16,17], and yet progress on improving breastfeeding practices is held back globally [2], possibly because policies and interventions to date have not embraced full-scale efforts to deliver integrated, tailored, and well-coordinated strategies [12]. In this global health context, this study fills an important gap in the public health literature [11] on the impact of delivering a critically important child survival, nutrition, and human development intervention at scale. Using rigorous cluster-randomized evaluation designs, it shows that comprehensive behavior change strategies implemented at scale, under real-life conditions, and delivered through outreach-based (Bangladesh) and facility-based (Viet Nam) platforms have strong and significant impacts on breastfeeding practices. Strategies that combine intensive IPC with MM campaigns, CM, and advocacy are more effective than standard counseling with less-intensive accompanying strategies. Our study demonstrates the impacts of recommended complex adaptive systems-based approaches to programming for scaling up combined interventions to improve breastfeeding in low- and middle-income countries [10]. We conclude that investments in combined, coordinated, and data-driven strategies, especially those that intensify counseling and are supported by MM, CM, and PA, are recommended for replication in similar contexts and for sustained implementation in Bangladesh and Viet Nam.
Supporting Information
Zdroje
1. Black RE, Victora CG, Walker SP, Bhutta ZA, Christian P, de Onis M, et al. Maternal and child undernutrition and overweight in low-income and middle-income countries. Lancet. 2013;382:427–451. doi: 10.1016/S0140-6736(13)60937-X 23746772
2. Requejo JH, Bryce J, Barros AJ, Berman P, Bhutta Z, Chopra M, et al. Countdown to 2015 and beyond: fulfilling the health agenda for women and children. Lancet. 2015;385:466–476. doi: 10.1016/S0140-6736(14)60925-9 24990815
3. World Health Organization. Global nutrition targets 2025: policy brief series. Geneva: World Health Organization; 2014 [cited 2016 Sep 23]. Available from: http://wwwwhoint/nutrition/publications/globaltargets2025_policybrief_overview/en/ 2014.
4. Bhutta ZA, Das JK, Rizvi A, Gaffey MF, Walker N, Horton S, et al. Evidence-based interventions for improvement of maternal and child nutrition: what can be done and at what cost? Lancet. 2013;382:452–477. doi: 10.1016/S0140-6736(13)60996-4 23746776
5. Victora CG, Bahl R, Barros AJ, Franca GV, Horton S, Krasevec J, et al. Breastfeeding in the 21st century: epidemiology, mechanisms, and lifelong effect. Lancet. 2016;387:475–490. doi: 10.1016/S0140-6736(15)01024-7 26869575
6. Black RE, Morris SS, Bryce J. Where and why are 10 million children dying every year? Lancet. 2003;361:2226–2234. doi: 10.1016/S0140-6736(03)13779-8 12842379
7. Requejo J, Victora C, Bryce J, Scientific Review Group of Countdown to 2015. Data resource profile: countdown to 2015: maternal, newborn and child survival. Int J Epidemiol. 2014;43:586–596. doi: 10.1093/ije/dyu034 24639449
8. Haroon S, Das JK, Salam RA, Imdad A, Bhutta ZA. Breastfeeding promotion interventions and breastfeeding practices: a systematic review. BMC Public Health. 2013;13(Suppl 3):S20. doi: 10.1186/1471-2458-13-S3-S20 24564836
9. Imdad A, Yakoob MY, Bhutta ZA. Effect of breastfeeding promotion interventions on breastfeeding rates, with special focus on developing countries. BMC Public Health. 2011;11(Suppl 3):S24. doi: 10.1186/1471-2458-11-S3-S24 21501442
10. Sinha B, Chowdhury R, Sankar MJ, Martines J, Taneja S, Mazumder S, et al. Interventions to improve breastfeeding outcomes: systematic review and meta-analysis. Acta Paediatr. 2015;104:114–134. doi: 10.1111/apa.13127
11. Bhutta ZA, Labbok M. Scaling up breastfeeding in developing countries. Lancet. 2011;378:378–380. doi: 10.1016/S0140-6736(11)60897-0 21752460
12. Perez-Escamilla R, Curry L, Minhas D, Taylor L, Bradley E. Scaling up of breastfeeding promotion programs in low- and middle-income countries: the “breastfeeding gear” model. Adv Nutr. 2012;3:790–800. doi: 10.3945/an.112.002873 23153733
13. Chapman DJ, Morel K, Anderson AK, Damio G, Perez-Escamilla R. Breastfeeding peer counseling: from efficacy through scale-up. J Hum Lact. 2010;26:314–326. 20715336
14. Lamberti LM, Fischer Walker CL, Noiman A, Victora C, Black RE. Breastfeeding and the risk for diarrhea morbidity and mortality. BMC Public Health. 2011;11(Suppl 3):S15. doi: 10.1186/1471-2458-11-S3-S15 21501432
15. Lamberti LM, Zakarija-Grkovic I, Fischer Walker CL, Theodoratou E, Nair H, Campbell H, et al. Breastfeeding for reducing the risk of pneumonia morbidity and mortality in children under two: a systematic literature review and meta-analysis. BMC Public Health. 2013;13(Suppl 3):S18. doi: 10.1186/1471-2458-13-S3-S18 24564728
16. Chowdhury R, Sinha B, Sankar MJ, Taneja S, Bhandari N, Rollins N, et al. Breastfeeding and maternal health outcomes: a systematic review and meta-analysis. Acta Paediatr. 2015;104:96–113. doi: 10.1111/apa.13102 26172878
17. Victora CG, Horta BL, Loret de Mola C, Quevedo L, Pinheiro RT, Gigante DP, et al. Association between breastfeeding and intelligence, educational attainment, and income at 30 years of age: a prospective birth cohort study from Brazil. Lancet Glob Health. 2015;3:e199–e205. doi: 10.1016/S2214-109X(15)70002-1 25794674
18. Baker EJ, Sanei LC, Franklin N. Early initiation of and exclusive breastfeeding in large-scale community-based programmes in Bolivia and Madagascar. J Health Popul Nutr. 2006;24:530–539. 17591350
19. Habicht JP, Victora CG, Vaughan JP. Evaluation designs for adequacy, plausibility and probability of public health programme performance and impact. Int J Epidemiol. 1999;28:10–18. 10195658
20. Baker J, Sanghvi T, Hajeebhoy N, Martin L, Lapping K. Using an evidence-based approach to design large-scale programs to improve infant and young child feeding. Food Nutr Bull. 2013;34(3 Suppl):S146–S155. 24261073
21. Nguyen PH, Kim SS, Keithly SC, Hajeebhoy N, Tran LM, Ruel MT, et al. Incorporating elements of social franchising in government health services improves the quality of infant and young child feeding counselling services at commune health centres in Vietnam. Health Policy Plan. 2014;29:1008–1020. doi: 10.1093/heapol/czt083 24234074
22. Gillespie S, Menon P, Kennedy AL. Scaling up impact on nutrition: what will it take? Adv Nutr. 2015;6:440–451. doi: 10.3945/an.115.008276 26178028
23. Menon P, Rawat R, Ruel M. Bringing rigor to evaluations of large-scale programs to improve infant and young child feeding and nutrition: the evaluation designs for the Alive & Thrive initiative. Food Nutr Bull. 2013;34(3 Suppl):S195–S211. 24261077
24. Rawat R, Nguyen PH, Ali D, Saha K, Alayon S, Kim SS, et al. Learning how programs achieve their impact: embedding theory-driven process evaluation and other program learning mechanisms in Alive & Thrive. Food Nutr Bull. 2013;34(3 Suppl):S212–S225. 24261078
25. Rasmussenab OD, Malchow-Mollera N, Andersena TB. Walking the talk: the need for a trial registry for development interventions. J Dev Effect. 2011;3:502–519.
26. BRAC. Scaling up and sustaining support for improved infant and young child feeding: BRAC’s experience through the Alive & Thrive Initiative in Bangladesh. Dhaka: BRAC; 2014 [cited 2015 Apr 9]. Available from: http://aliveandthrive.org/wp-content/uploads/2014/11/BRAC-Final-report-8.28.2014.pdf.
27. Linn JF, editor. Scaling up in agriculture, rural development, and nutrition. International Food Policy Research Institute. 2012 Jun [cited 2016 Sep 21]. Available from: http://www.ifpri.org/sites/default/files/publications/focus19.pdf.
28. Piwoz E, Baker J, Frongillo EA, editors. Designing large-scale programs to improve infant and young child feeding in Asia and Africa: methods and lessons of Alive & Thrive. Food Nutr Bull. 2013; 34(3 Suppl 2). Available from: http://aliveandthrive.org/resources/journal-supplement-designing-large-scale-programs-to-improve-infant-and-young-child-feeding-in-asia-and-africa-methods-and-lessons-of-alive-thrive/.
29. Alive & Thrive. Mass communication. Washington: Alive & Thrive; 2016 [cited 2016 Sep 22]. Available from: http://aliveandthrive.org/program-components/mass-communication/.
30. World Health Organization. Indicators for assessing infant and young child feeding practices. Part I: Definition. Geneva: World Health Organization; 2008.
31. UNICEF. Definitions of breastfeeding categories. New York: UNICEF; 2015 [cited 2015 Apr 9]. Available from: http://www.unicef.org.uk/Documents/Baby_Friendly/Research/infant_feeding_definitions.pdf.
32. World Health Organization, UNICEF. Diarrhea: why children are still dying and what can be done. Geneva: World Health Organization; 2009.
33. Hayes RJ, Moulton LH. Cluster randomized trials. Boca Raton: Chapman & Hall/CRC Press; 2009.
34. Gertler PJ, Martinez S, Premand P, Rawlings LB, Vermeersch CMJ. Impact evaluation in practice. Washington: International Bank for Reconstruction and Development/World Bank; 2011.
35. Reynolds WM. Development of reliable and valid short forms of the Marlowe-Crowne Social Desirability Scale. J Clin Psychol. 1982;38:119–125.
36. Organisation for Economic Co-operation and Development, World Health Organization. Health at a glance: Asia/Pacific 2014: measuring progress towards universal health coverage. Paris: OECD Publishing; 2014. doi: 10.1787/health_glance_ap-2014-en
37. Haider R, Ashworth A, Kabir I, Huttly SR. Effect of community-based peer counsellors on exclusive breastfeeding practices in Dhaka, Bangladesh: a randomised controlled trial. Lancet. 2000;356:1643–1647. 11089824
38. Haider R, Rasheed S, Sanghvi TG, Hassan N, Pachon H, Islam S, et al. Breastfeeding in infancy: identifying the program-relevant issues in Bangladesh. Int Breastfeed J. 2010;5:21. doi: 10.1186/1746-4358-5-21 21118488
39. Nguyen PH, Menon P, Keithly SC, Kim SS, Hajeebhoy N, Tran LM, et al. Program impact pathway analysis of a social franchise model shows potential to improve infant and young child feeding practices in Vietnam. J Nutr. 2014;144:1627–1636. doi: 10.3945/jn.114.194464 25143372
40. Saha KK, Rawat R, Khaled A, Sanghvi T, Afsana K, Haque R, et al. Behavior change counseling (BCC) by frontline health workers (FHW) and a mass media campaign improved complementary feeding (CF) practices more than mass media alone in rural Bangladesh. FASEB J. 2013;27:243.5.
41. Avula R, Menon P, Saha KK, Bhuiyan MI, Chowdhury AS, Siraj S, et al. A program impact pathway analysis identifies critical steps in the implementation and utilization of a behavior change communication intervention promoting infant and child feeding practices in Bangladesh. J Nutr. 2013;143:2029–2037. doi: 10.3945/jn.113.179085 24068790
42. Paina L, Peters DH. Understanding pathways for scaling up health services through the lens of complex adaptive systems. Health Policy Plan. 2012;27:365–373. doi: 10.1093/heapol/czr054 21821667
43. Bradley EH, Curry LA, Taylor LA, Pallas SW, Talbert-Slagle K, Yuan C, et al. A model for scale up of family health innovations in low-income and middle-income settings: a mixed methods study. BMJ Open. 2012;2:e000987. doi: 10.1136/bmjopen-2012-000987 22923624
44. Ambikapathi R, Kosek M, Olortegui M, Caulfield L. High resolution longitudinal analysis to evaluate the timing, duration and dynamics of exclusive breastfeeding in the Peruvian Amazon. FASEB J. 2014;28:119.3.
45. Henry M, Christian P, Kim S, Nguyen P, Rawat R, Menon P. Breastfeeding difficulties at three months are associated with formula use in Vietnam. FASEB J. 2014;29(Suppl):898.34.
46. Zongrone AA, Roopnaraine T, Bhuiyan M, Afsana K, Pelto G, Rasmussen K, et al. A longitudinal study on infant and young child feeding (IYCF) trajectories identifies maternal and household capacities that influence the effectiveness of a behavior change communications (BCC) intervention in Bangladesh. FASEB J. 2013;27(Suppl):844.10.
47. Moore SE, Prentice AM, Coward WA, Wright A, Frongillo EA, Fulford AJ, et al. Use of stable-isotope techniques to validate infant feeding practices reported by Bangladeshi women receiving breastfeeding counseling. Am J Clin Nutr. 2007;85:1075–1082. 17413108
Štítky
Interní lékařstvíČlánek vyšel v časopise
PLOS Medicine
2016 Číslo 10
- Příznivý vliv Armolipidu Plus na hladinu cholesterolu a zánětlivé parametry u pacientů s chronickým subklinickým zánětem
- Berberin: přírodní hypolipidemikum se slibnými výsledky
- Flexofytol® – přírodní revoluce v boji proti osteoartróze kloubů
- Vliv kombinace nutraceutik na remodelaci levé komory srdeční u osob s metabolickým syndromem
- Nutraceutika a jejich ovlivnění mírného kardiometabolického rizika
Nejčtenější v tomto čísle
- Prophylactic Oral Dextrose Gel for Newborn Babies at Risk of Neonatal Hypoglycaemia: A Randomised Controlled Dose-Finding Trial (the Pre-hPOD Study)
- Orthostatic Hypotension and the Long-Term Risk of Dementia: A Population-Based Study
- Improving the Science of Measles Prevention—Will It Make for a Better Immunization Program?
- Conveying Equipoise during Recruitment for Clinical Trials: Qualitative Synthesis of Clinicians’ Practices across Six Randomised Controlled Trials