Pacific Island nations operate in a highly dynamic socio-economic, cultural, and governance contexts shaped by migration, natural disasters, and economic instability. Traditional monitoring and evaluation (M&E) frameworks, which are typically based on linear models, often struggle to capture the dynamic and evolving nature of these contexts. This challenge is amplified when multi-country programs apply a single M&E framework across the region, overlooking the distinct realities of individual Pacific nations and sub-national settings. Although complexity-aware M&E is well established conceptually, Pacific-specific contextual drivers and constraints remain underexamined. This article proposes using the Cynefin Framework as a participatory sensemaking scaffold to design adaptive, context-sensitive M&E systems in the Pacific. Rather than treating Cynefin as an external classification tool, or using it to assign whole countries to fixed domains, the article applies it as a diagnostic prompt for examining specific program situations, components, sectors, island settings, and governance levels. The paper analyses key implementation challenges—alongside enabling conditions. It concludes by identifying practical opportunities to leverage regional strengths and advance complexity-aware M&E. The article offers a contextual and applied contribution for practitioners seeking more relevant, useful, and adaptable M&E systems across diverse and evolving Pacific realities.
This article reflects on methodological insights from a study that combined research and evaluation to examine vocational skills development in six low- and middle-income countries. The study sought to understand the role of vocational skills development in driving industrial transformation, growth, and inclusivity but encountered key challenges in defining what was being evaluated, mapping causal pathways, and managing data limitations. One difficulty was whether the evaluation assessed individual programmes, broader policies and strategies, or the entire skills formation ecosystem. The mixed-methods approach allowed for triangulation but the absence of a sharp enough focus, complicated data analysis. Limited opportunities for reflection between research phases – due to funding uncertainties and tight deadlines – constrained iterative learning. Practical challenges also arose: historical records were inconsistent, and data collection was complicated by the fact that training managers were rarely the same individuals responsible for work organisation, technology adoption, or company strategy. Despite these constraints, the study underscored the value of an approach that integrates research and evaluation and was able to achieve results that meaningfully contribute to the knowledge about the ways in which vocational skills development supports workplace transformation, inclusivity and growth.
This article reports on an evaluation study of Breast Cancer Trials, an Australian non-profit cancer research organisation, using the Payback Framework. The organisation’s impact over a 40 year period was assessed through a mixed methods design, assessing impact across the five dimensions of the framework: knowledge production, informing policy and product development, the research system, health and health sector benefits, and broader economic benefits. The evaluation found that Breast Cancer Trials created impact in each of these five traditional dimensions. Interestingly, findings highlighted the importance of a sixth dimension – social benefits, in particular psycho-social benefits, involving connections and supportive interactions for various individuals and communities. These benefits included and resulted from improved health literacy and mental health of patients’ family, and personal impact on researchers and others involved in clinical trials, representing a significant dimension for Breast Cancer Trials and potentially other organisations wishing to comprehensively evaluate impact. Impact evaluation is an ongoing endeavour and is strengthened by good design, stakeholder engagement, and accountability. We contend that using an extended Payback Framework to include a sixth dimension, social benefits , allows organisations to reflect more broadly on the significance, scope, and impact of their work, incorporating the wide range of impacts on various stakeholder groups.
