From ‘i2insights.org’ 24th January 2017
Pete Barbrook-Johnson, Research Fellow at the Policy Studies Institute at the University of Westminster & Knowledge Integrator Research Fellow at the Centre for the Evaluation of Complexity Across the Nexus (CECAN) at the University of Surrey.
How can we improve the often poor interaction and lack of genuine discussions between policy makers, experts, and those affected by policy?
As a social scientist who makes and uses models, an idea from Daniel Dennett’s (2013) book ‘Intuition Pumps and Other Tools for Thinking’ struck a chord with me. Dennett introduces the idea of using lay audiences to aid and improve understanding between experts. Dennett suggests that including lay audiences (which he calls ‘curious nonexperts’) in discussions can entice experts to err on the side of over-explaining their thoughts and positions. When experts are talking only to other experts, Dennett suggests they under-explain, not wanting to insult others or look stupid by going over basic assumptions. This means they can fail to identify areas of disagreement, or to reach consensus, understanding, or conclusions that may be constructive.
For Dennett, the ‘curious nonexperts’ are undergraduate philosophy students, to be included in debates between professors. For me, the book sparked the idea that models could be ‘curious nonexperts’ in policy debates and processes. I prefer and use the term ‘interested amateurs’ over ‘curious nonexperts’, simply because the word ‘amateur’ seems slightly more insulting towards models!
In this role, models are not intended to provide answers to policy makers’ questions, or tell them what might happen in the future. Instead, models aim to help policy makers, experts, and those affected by policy – all ‘experts’ on the policy topic at hand – improve their interaction and discussion, as well as their own thinking.
Models therefore become not ‘truth’ for policy makers to accept and take on board, but objects for everyone involved in making or advising or affected by the policy to consider and ‘wrestle’ with – even to attack. Let me provide two examples.
An agent-based model of farmer decision making
A group of local and regional policy stakeholders working on natural resource management and agricultural policy in Ethiopia was presented with an agent-based model of farmers’ decision making related to investing in soil conservation measures. The model set out decision and interaction rules for farmers based on theory developed from empirical work with farmers in the developing world.
The simple but specific model was quickly attacked by the stakeholders – they called it out on what they thought was missing or what was represented incorrectly. However, on some points, others jumped to the model’s defence, and stated that they agreed with it. The model’s detail helped to structure and focus conversation on specific issues, providing discipline to the discussions. The willingness of participants to attack the (unfeeling) model also brought out sensitive topics for discussion that might otherwise have remained untouched.
A fuzzy cognitive map of a river catchment
A varied group of local stakeholders discussing management of a river in the north of England aimed to explore future options for the operation of a large and ageing barrage on the river. In this process, stakeholders developed a fuzzy cognitive map of the river and the surrounding area. Building the map made clear the sheer number of factors important in the area, and the complexity of their interaction.
Of most value perhaps, was the fact that building the map helped stakeholders to realise themselves, in a non-confrontational manner, what they didn’t know, and/or which of their assumptions may be wrong. This happened because the mapping process forced them to agree collaboratively the links between key factors in the river system. Participants concluded some gaps in their knowledge could be filled easily with better interaction with other stakeholders, whereas others required primary research on the processes of the river.
Conclusions
Both of these projects benefited from the use of intuitive and accessible modelling techniques, used not to give answers or forecasts, but to structure a discussion and ‘ask’ potentially ‘stupid’ questions – just like Dennett’s philosophy undergrads. Like much participatory modelling work, the real value was in the process, not the model itself. However, the models’ specificity, intuitive appeal, and neutrality aided discussions in a way other methods or facilitation may not have. I, for one, am looking forward to building more models in the future for policy stakeholders to attack with relish!
What do you think? Do you agree models can act as ‘interested amateurs’? What types of models might work best in this way? What types of policy processes might find most value in using models in this way?
To find out more:
Johnson, P. (2015). Agent-Based Models as “Interested Amateurs”. Land, 4, 2, 281- 299. Online (DOI): 10.3390/land4020281
Reference:
Dennett, D. (2013). Intuition Pumps and Other Tools for Thinking. Allen Lane: London, United Kingdom.
Acknowledgement:
Thanks to Dr Alexandra Penn (University of Surrey) who leads the second case study.
Biography: Pete Barbrook-Johnson is a Research Fellow at the Policy Studies Institute at the University of Westminster, UK, and a Knowledge Integrator Research Fellow at the Centre for the Evaluation of Complexity Across the Nexus (CECAN) at the University of Surrey, UK. His research interests fall at the crossroads between environmental policy, social and behavioural science, and complexity science. He has experience in a range of research methods including agent-based modelling of social and policy systems, stakeholder causal mapping, and qualitative and quantitative social research methods. He is on Twitter @bapeterj.