Global Research Priorities to Better Understand the Burden of Iatrogenic Harm in Primary Care: An International Delphi Exercise

Summary

article has not abstract

Tackling the Provision of Unsafe Primary Care Internationally

It is now well established that medical errors are common and that these can result in considerable morbidity and mortality [1]–[3]. Much of this evidence, however, comes from hospital settings in industrialised countries where considerable progress has been made in describing the epidemiology of errors, understanding underlying contributing factors, and, more recently, taking steps to intervene to enhance patient safety [4].

In contrast, much less is known about the frequency of patient safety incidents and preventability of harm in primary care, particularly in low- and middle-income countries (Box 1). This is of concern as, in many parts of the world, primary care-based services now provide the first point of contact with health systems and often play a key role in coordinating more specialist care provision [5]–[8]. The increasing move to primary care-based health systems internationally [9],[10] adds further impetus to the urgent need for research into the frequency and preventability of patient safety incidents, but this is complicated by the considerable variation in population needs, economic and political circumstances, structures of health systems, and manifestations of primary care globally.

In an attempt to support the development of a more comprehensive evidence-base, the World Health Organization (WHO) convened an international group of experts to discuss, debate, and advise on directions to bridge knowledge gaps around safe primary care, which would also serve to catalyse research in these areas internationally. A key strand of this foundational work was to identify a shared vision on relevant contexts of primary care and areas that would need further study to better understand the burden of harm in primary care settings internationally.

Developing Agreement on Primary Care Contexts and Priority Areas

We conducted a three-stage modified Delphi exercise, aiming to seek agreement on the most important contexts of primary care and the potential causes of patient safety incidents in different economic settings [11],[12]. This exercise was undertaken during a two-day expert meeting in February 2012 at the WHO headquarters in Geneva, Switzerland. AS, DB, and IL jointly chaired this meeting, which consisted of presentations, discussion groups, and plenary sessions focusing on understanding the challenges of assessing patient safety in primary care in low-, middle-, and high-income settings [13]–[15].

The Delphi technique has been widely used to help promote agreement amongst international experts. Key strengths of this process include the fact that it does not force consensus, but rather it can help to identify where agreement does and does not exist [16]–[19]. Although the general purpose and procedures have been retained in modified versions, some important differences in methods relate to: (1) approaches to managing interactions between experts, (2) the design of the initial item generation, and (3) feedback of individual scores [20]–[22].

Identifying Experts

We identified experts from academic, policy, and clinical backgrounds with expertise relating to patient safety in primary care settings. This initial long-list was generated by drawing on existing WHO contacts, profiling academic institutions with relevant expertise in the area, identifying authors of published studies, and by searching Google Scholar. Selected experts were invited to participate at the meeting. Provisions were made to facilitate representation from low- and middle-income countries in different geographical regions, and by meeting travel costs where financial considerations were a possible barrier to attendance.

Generating Candidate Statements and Prioritisation Exercise

Participants were provided with a review of the literature surrounding the frequency of patient safety incidents, burden of harm, and preventability of these incidents in primary care. Data were collected in three iterative stages with corresponding data collection forms (see Text S1). The forms were distributed and collected face-to-face by members of the research team (KMC, SAS, SSP, and ACS). Opportunity for free text comments was provided throughout and each participant was assigned a number for anonymisation purposes.

The forms included a list of candidate areas identified from the literature, which were grouped into three sections with corresponding statements for low-, middle-, and high-income countries (see Text S1). After piloting, the list was shared with the experts at the beginning of day 1 of the meeting, asking participants to add additional items. This list was amended on the basis of participant feedback.

The amended list formed the basis for the second round of data collection. Here, experts were asked to score items in terms of importance (frequency of occurrence, severity of outcome, preventability, inequity of occurrence) on a 9-point Likert-type scale for each income category ranging from 1 = “not important” to 9 = “extremely important” [15]. Data were independently scrutinised and transcribed by two members of the research team (KMC and ACS) into Microsoft Excel spread sheets and the median score for all items and the percentage agreement for items scoring 7, 8, or 9 (“usually important,” “very important,” and “extremely important,” respectively, i.e., the highest scores) were calculated.

The medians and percentage agreements obtained for each item were then included in the revised questionnaire that formed the basis for round 3 of data collection, giving participants the opportunity to revise their scoring on the basis of other participants' rankings. The third questionnaire was distributed and collected at the end of day 1, followed by calculation of the percentage agreement with individual items.

Items with an agreement of >80% in each section at the end of the Delphi exercise were fed back to participants on day 2 of the meeting. Rather than feeding back the actual distribution of panellists' ratings on the prior round, because of time and resource constraints the process fed back the median rating and percentage agreement of the prior round for the 7, 8, or 9 category as a proxy for the full distribution. This was followed by a plenary discussion, which gave participants the opportunity to collectively discuss emerging conclusions and recommendations. It enabled an exploration of areas of convergence and divergence across countries and perspectives, giving participants the opportunity to air concerns and discuss potential next steps.

Overarching Considerations to Improve Understanding of the Extent of Unsafe Primary Care

We distributed 40 questionnaires in round 1. Of these, 37 questionnaires were completed. Reasons for non-completion were participants either failing to return the questionnaire (n = 1) or leaving the meeting early (n = 2). No potential participant explicitly refused to participate in the study. Of the 37 questionnaires distributed in round 2, 34 were returned (non-responses were again mainly because some participants needed to leave the meeting early (n = 3)). In round 3, we distributed 30 questionnaires to the remaining participants (the other four had left the meeting), all of which were completed. The overall response rate was therefore 30/40 (75%; see Figure 1). Key characteristics of those who completed all three rounds of the Delphi exercise are detailed in Table 1.

Overall, there was over 80% agreement across 15 items in low-income country contexts, 16 items in middle-income country contexts, and 16 items in high-income country contexts. Family practice and pharmacy were important primary care contexts across all income categories (Table 2). Additional contexts identified as warranting particular attention were community midwifery and nursing in low-income countries, and care homes in high-income countries (Table 2).

Tables 3 and 4 summarise the factors responsible for patient safety incidents that were identified as particularly needing further investigation across income settings. Important additional items in low- and middle-income settings included counterfeit drugs and errors in the execution of clinical tasks, whilst additional items in high-income settings were systems management and technology-related issues (Table 5).

Participants also prioritised the importance of cross-cutting systems' issues (Table 6). As can be seen, a range of interventional, regulatory, and methodological issues emerged; it is noteworthy that improved education and training for primary care workers received unanimous support.

Overall, we identified family practice and pharmacy as the main contexts to focus attention on in order to advance patient safety in primary care across all income categories. The sources of patient safety incidents requiring further study identified across all economic settings were communication between health care professionals and with patients, teamwork within the health care team, laboratory and diagnostic imaging investigations, issues relating to data management, transitions between different care settings, and chart/patient record completeness.

Strengths and Limitations of the Approach Employed

This work provides a foundation from which to focus efforts on how to better quantify the extent of iatrogenic harm in primary care and, in due course, to develop interventions to enhance the safety of primary care provision globally [5],[6]. The exercise allowed us to identify areas for research into safer primary care, focusing on areas with the greatest propensity for harm and where prevention was considered feasible. Incorporating this exercise within a two-day face-to-face meeting helped to ensure good response rates retaining the majority of participants, and allowed feeding back results to participants in real time, taking their comments into account in analysis activities and questionnaire design. The iterative element of the exercise helped to inform the meeting's proceedings and ensuing discussions. We provided participants with the opportunity to discuss emerging areas of agreement, thereby contributing to the face validity of the results. The different backgrounds and expertise of participants created the opportunity to explore the specific challenges associated with primary care provision across a range of geographical and political contexts.

Our work also has some important limitations. The total number of participants was limited by resource constraints. Furthermore, as the focus was on policy and research deliberations, we had an over-representation of high-income country-based scholars and doctors, potentially influencing the results in favour of medical concerns important to those working in industrialised countries. That said, it is important to note that community pharmacy, nursing, and midwifery emerged as consistent priority areas. Some participants acknowledged that they had limited insights into provision of care in low-income settings, which may have influenced their ability to make informed judgements. Expansion of this exercise, involving additional experts from wider professional domains and world settings may therefore generate additional important insights.

Because of resource and time constraints in collating data over a narrow time window, we were unable to include a reminder of participants' own prior ratings, which may to an extent have been mitigated by the fact that all three rounds were conducted on the same day. We were also unable to provide additional information on distributions of ratings that could point to potentially diverging ratings and hence disagreements amongst experts that might not be reflected in the summary scores. We did however examine the raw data from each round for ambiguous items, but did not detect any such instances.

Finally, it should be noted that some known important patient safety issues in primary care such as injection safety were not included in this exercise because of a lack of specific expertise among participants, though it was noted as an important gap [23].

Implications and Unresolved Issues

Some of the existing knowledge underlying the measurement, causal factors, and interventions to enhance patient safety in primary care may be applicable across a wide array of income settings. This knowledge may be particularly relevant in relation to common contexts of care provision, including the central positioning of family practice and community pharmacy in health systems globally, although there may be other contextual and institutional factors at play that need to be better understood. The expert consultation strongly advocated the need for further research surrounding the frequency and preventability of patient safety incidents in primary care.

The discipline of patient safety is built on the premise that harm arises from errors in a multifactorial chain of events [24],[25]. The underlying assumption is that if systems (i.e., organisations and networks of organisations) and working conditions within these organisations can be optimised, then the occurrence of adverse events is less likely. This systems approach is increasingly being applied as the patient safety culture of institutions and systems matures. Our findings support this trend, as reflected in the cross-cutting areas identified that all relate to improving ways of working collaboratively [26],[27].

The work accomplished in this meeting can now be used as a starting point to inform and focus efforts in relation to epidemiological investigations that are urgently needed, particularly in low- and middle-income country contexts. These insights can then be used to develop interventions that aim to reduce risks of iatrogenic harm and improve health outcomes. Once tested, effective interventions need to be incorporated into local and international policy making in order to ensure that findings are effectively translated into practice.

Conclusions

Family practice and pharmacy were identified as important contexts across all income categories. Particular areas identified as warranting further investigation included communication between health care professionals and with patients, teamwork within the health care team, laboratory and diagnostic imaging investigations, issues relating to data management, transitions between different care settings, and chart/patient record completeness. The WHO will be issuing a roadmap within the next 12 months to ensure that the momentum from this important initiative is maintained.

Supporting Information

Attachment 1