Realist methodologies are increasingly being used to evaluate complex interventions in health and social care. Realist evaluation 24 is a theory-driven evaluation approach 25 used to understand how, for whom and in what circumstances an intervention âworksâ to produce intended outcomes. Presented at the Founding Conference of the Danish Evaluation Society, September 2000 Thank you very much for inviting me to speak at the Inaugural Conference of the Danish Evaluation Society. The information gathered was analysed in accordance with realist evaluation methodology. Briefly consider a realist research design. Realist evaluation is a theory-driven approach, rooted in a realist philosophy of science, which emphasises an understanding of causation and how causal mechanisms are shaped and constrained by context. I hope that your Society thrives and that you spend some time working out ways in which evaluation can best serve the needs of your communities. Realist evaluation acknowledges âontological depthâ, . Can provide generalisable insights on how to scale a programme up or roll it out to different contexts, therefore provides findings with external validity. Participant recruitment occurred through purposive and theoretical sampling of children and parents participating in the Local Environment Model intervention at Beitostolen Healthsports Centre in Norway. Keywords: Realist evaluation, context and mechanisms, curriculum evaluation, curriculum model, realist program theory, formal theory in realist evaluation, curriculum model abstract Realist evaluation is based on the premise that aspects of context trigger particular mechanisms in response to an intervention, which result in observable outcomes. REALIST EVALUATION â¢Drawn from Pawson and Tilleyâs âRealistic Evaluationâ (1997) â¢Realism is a school of philosophy and sits between positivism and constructivism â¢A member of the family of theory-based evaluation approaches - start by clarifying the âprogram theoryâ Where relevant to our discussions we highlight instances of later reï¬ nements. Conclusions This realist evaluation substantiates the literature and reveals deeper understandings about quality assuring medical education. It is based on a philosophy (realism), and is primarily concerned with identifying causal mechanisms. Propositions 1-3 . conduct of the qualitative interview within a realist evaluation research study, and it will focus exclusively on Pawsonâs approach to realist qualitative interviewing. Realist evaluation uses a theory-driven approach to evaluate healthcare or social programmes. This second evaluation involves conducting four case studies, each one involving one CC group, from initiation to completion of a behavior change â¦ Kazi et al. 3. This makes it particularly suitable for evaluations of certain topics and questions â for example, complex interventions and programmes that involve human decisions and actions. Strategies and methods of realist evaluation 4. In 2018, the Realist Evaluation Learning Group was formed to discuss and reflect on Itadâs experiences and distil what has been learned along the way.2 This paper presents examples and lessons from four evaluations: BCURE (2013â18). Realist evaluation follows a cycle as shown in figure 2: 9 . Realism's place in the policy cycle: formative, summative and synthetic approaches 5. One can find, however, several self-professed realist studies that lack this essential process. Basic concepts in the explanation and understanding of programmes 3. Contents: Introduction 1. While standardised approaches are implemented, interventions need to be contextually proportionate. Realist evaluation is an approach within theory-driven evaluation . This introduction will help evaluators and commissioners of evaluations to decide whether a realist approach is appropriate for evaluating the impact of â¦ Realist evaluation framework is particularly suited for unpacking how contextual factors and intervention mechanisms or processes influence the outcome [23, 25]. Realist evaluation is avowedly theory-driven; it searches for and refines explanations of programme effectiveness. For us, this means that what manifests in terms of CBPR process and outcomes can be understood in terms of layers of reality. The reader should note, additionally, that there are several approaches to realist evaluation (e.g., Henry, Julnes, and Mark, 1998) and to qualitative research (e.g., Hammersley, 1992, 2008; Maxwell, 2012, 2013). (2011) provide a typical example. < i> Realistic evaluation: by Ray Pawson and Nick Tilley, Sage Publications, 1997, 235 pp Ethnographic methods comprising participant observation, interviews, and focus groups were employed over 15 weeks in the field. current realist evaluation position is weak, and discuss the methodological consequences of taking a critical realist approach to them. This realist evaluation protocol sets out the approach that will be used to identify and explain which aspects of the programme are working, for whom and in what circumstances to produce the outcomes intended. The second step is to develop CMO hypotheses that the evaluator thinks should be tested. Realistic evaluation: by Ray Pawson and Nick Tilley, Sage Publications, 1997, 235 pp This means understanding what works, in which circumstances, and for whom. Why choose realist evaluation? In stage 1, â¦ 1999); the evaluation researchers Pawson and Tilley (1997; Pawson, 2006) and Henry, Julnes, and Mark (1998; Mark, Henry, & Julnes, 2000); and the quali- tative researchers Huberman and Miles (1985; Miles & Huberman 1994) and Hammersley (1992a, 1998, 2002, 2009). 2, 2009 (pp. Realist Evaluation develops a particular kind of programme theory, structured as Context- Mechanism-Outcome Configuration (CMOCs). Methods/design: This mixed method realist evaluation will develop theories about the relationship between the context, mechanisms and outcomes of the diabetes programme. The nature of programmes and how they work 2. How Do You Modernize a Health Service: a Realist Evaluation of Whole-Scale Transformation in London The Milbank Quarterly, Vol. 1998) and Realistic Evaluation (Pawson and Tilley, 1997). The second report (Chapter 3) provides an account of an illuminative small scale research study. 7. TCAT is a five year programme funded by Macmillan Cancer Support. We have organized the article in four main sections. A REALIST EVALUATION OF THE PROCESSES AND OUTCOMES OF INFANT MASSAGE PROGRAMS ANGELA UNDERDOWN University of Warwick RHONDA NORWOOD Louisiana State University JANE BARLOW University of Warwick ABSTRACT: The sensitivity of early interactions conveyed through eye contact, voice tone, facial expression, and gentle touch plays a crucial role in â¦ In addition, to aid explan-ation we have used a hypothetical smoking cessation programme to illustrate the issues that we discuss. Realist Research and Evaluation FIVE DAY INTENSIVE WORKSHOP 30 September - 4 October 2019 (La Trobe University, Melbourne) _____ This intensive workshop will introduce participants to the philosophical assumptions of a realist philosophy of science and their implications for understanding how policies and programs work. Programme theory (ideas and assumptions of how a particular intervention works) development is the first step in a realist evaluation or a realist synthesis, with literature reviews providing important evidence to support this. Lastly, substantive theory feeds realist evaluation with clues on the mechanisms (e.g. â¦ Methods: This study was designed as a realist evaluation. Thus, its focus is on not just whether or not a programme such as an NZ regional DHB grouping âworksâ but how, for whom and in what contexts it âworksâ. In this cycle, the first step is to understand the formal theory upon which the programme is based. Realistic Evaluation, Pawson & Tilley, 2001), focussing on the identification of processes and contexts supportive of reflective practice, would contribute to the development of knowledge in the field. Consider, in some detail, five principles of realist methodology, which may be applied to research practice including evaluation. 391â416) Paper by Trisha Greenhalgh about applying realist evaluation to understand a range of factors supporting change across four large health care organisations and their delivery of three areas of health services. Realist evaluation itself is a particular evaluation theory. â¢ Realist evaluation is useful when we donât yet understand how, why and for whom programmes work/donât workâ¦ And when we want to know how to adapt a programme to new contexts and new people 4 . 87, No. Figure 2: the Realist evaluation cycle. Realist evaluation is a largely qualitative approach to developing, testing and refining ideas or theories about the effectiveness of certain interventions or programs in the real world.12 Drawing on the philosophical position of realism, the realist evaluation approach focuses particular attention on â¦ The theory is then translated into CMO terminology. The evaluation traces the outcome patterns associated with a care coordination programme called âWraparoundâ. realist evaluation is a specific type of theory-based evaluation. Realist impact evaluation is an approach to impact evaluation that emphasises the importance of context for programme outcomes. The second realist evaluation study explore: How, why, and for whom a community engagement intervention (titled Community Conversations [CCs]) influences behavior change communication for health within Marsabit, Kenya. This realist evaluation (RE) is located within a 5 year na-tional programme of Transforming Care After Treat-ment in Scotland (TCAT) [24, 25]. Routine communication is beneficial to verify data, share concerns and check risk; however, ongoing partnership working can foster assurance. Interviews were held with staff from the SN teams and managers, both on an individual basis and in groups. The nature, presentation and use of findings from realist evaluation 6.
2020 realist evaluation pdf