What role should evaluation play in systems change and transformation? How must we rethink evaluation itself to adapt to this role? Emily Gates, assistant professor at Boston College, will share her thoughts on these questions grounded in theoretical scholarship and a case study.
There is much that can be learned from analysing discourse (‘the written and spoken word’). Rigorously applied discourse analysis can reveal, for example, assumptions embedded in legislation, policy and strategy as well as the uptake of these by different actors, including the public.
On 21st September 2021, Brendan Bromwich (Principal Engineer, Asset Management and Investment Planning, Mott MacDonald) hosted a CECAN webinar.
This course is an introduction to Qualitative Comparative Analysis (QCA). QCA is a method for the comparative study of cases and is used to analyse qualitative social data systematically. The analysis compares cases by assigning set memberships across a set of attributes.
This course covers the theory and practice of diagnostic evaluation and Bayesian Updating. It addresses its epistemological and mathematical basis, its appropriateness and strengths / weaknesses in comparison with other methods, and its application steps.
Process Tracing is a method used to understand causal chains in single case analysis settings. It is the systematic analysis of contribution claims through explicit investigation of how pieces of evidence support or undermine a particular hypothesis or claim.
One of the country’s top research hubs for evaluating complex policies has published a new toolkit that could help government officials judge the effectiveness of their work.
The great acceleration of human activities over the past 10, 50, 100 years has changed the very nature of life support for all species who live together on this big “blue marble” we call planet Earth.
Tuesday 21st September 2021, 13:00 – 14:00 BST Presenter: Brendan Bromwich, Principal Engineer, Asset Management and Investment Planning, Mott MacDonald Webinar Overview: There is a consistent appeal for a systems approach to be applied to water and environmental...
In June 2021, the Sustainability Research & Innovation Congress 2021 (SRI2021) held a series of online workshops as part of its “Transformations Conference 2021: Enabling Positive Tipping Points”. This post shares the learning from one workshop, “Evaluation as a Pathway to Transformation for a Sustainable Future.”
This seminar introduces case-based scenario simulation (CBSS) to evaluators. CBSS is well aligned with existing evaluation approaches, most directly realist evaluation which emphasizes ‘what works for whom in which circumstances’.
On 6th July 2021, Dr Corey Schimpf, Dr Brian Castellani and Dr Pete Barbrook-Johnson hosted a CECAN webinar, which discussed case-based scenario simulation (CBSS) in relation to evaluation purpose (learning or accountability) and evaluation design (cross-sectional or longitudinal).
Our new CECAN training and support series ‘Handling Complexity in Policy Evaluation’ will provide you with knowledge and practical advice to allow you to deal with complexity in policy analysis and evaluation.
CECAN has been developing a new app, called PRSM, which runs in a web browser and which helps groups of people collaboratively develop networks or ‘maps’ of policy and other systems online.
This workshop will focus on material presented in the first two chapters of the Supplementary Guide, which describes key features of complex systems and the challenges these present both to policy makers, and to those planning, commissioning and undertaking evaluation of policy interventions.
This workshop will focus on material presented in chapter three of Supplementary Guide to explore the particular challenges complexity presents to the management and commissioning of a policy evaluation.
This workshop will review material presented in chapter four of the Supplementary Guide, which provides guidance on how to select an appropriate evaluation approach for a complex intervention, reviews some of the different evaluation approaches available and indicates when these are most useful.
On 31st March 2021, Pete Barbrook-Johnson and Alexandra Penn hosted our CECAN Webinar: ‘Participatory Systems Mapping for Policy Evaluation’.
Betheney was awarded a PhD in November 2020 following a viva in which her thesis was approved without corrections.
This 1-day course (split across two consecutive half-days) introduces participants to influence mapping, within the context of evaluation or as a general introduction.
CECAN recently guest edited a special issue of the leading evaluation journal ‘Evaluation’. The issue, written by members of CECAN and some of its collaborators, aims to bring together a set of ideas and methods for handling complexity in evaluation based on extensive practical experience in addressing these issues, from a research perspective, in UK central government evaluation.
In our webinar, we will share key insights and have a rich discussion about what resilience really means, with a focus on practical elements.
This 1-day course introduces participants to the basics of agent-based modelling and how it can be used in policy analysis and evaluation.
Process Tracing is a method used to understand causal chains in single case analysis settings. It is the systematic analysis of contribution claims through explicit investigation of how pieces of evidence support or undermine a particular hypothesis or claim.
On 24th November 2020, Tom Oliver (University of Reading) hosted a CECAN webinar.
Dr Barbara Befani, CECAN Research Fellow, has expanded and partially redeveloped the CAEM tool originally published by BOND to include, amongst else, more complexity-appropriate methodologies.
This course is an introduction to Qualitative Comparative Analysis (QCA). QCA is a method for the comparative study of cases and is used to analyse qualitative social data systematically.
The need to take a whole-systems approach to policy to avoid unanticipated outcomes and burden shifting across sectors is now widely recognised.
In this webinar, Pete and Alex will present their recent paper in Evaluation on the role ‘Participatory Systems Mapping’ can play in policy evaluation.
Research methods usually struggle with the complexity of social processes, such as policy processes, and how they play out over time.