Lessons from The Covid Inquiry as to ‘What Works’ in the reviewing and evaluation of community and youth work.

by | Sep 27, 2024 | General Youth Work | 1 comment

Periodically (over perhaps now twenty years) I get asked to undertake reviews and evaluations of community and youth work projects. Typically, I use that ‘old’ methodology of going to speak to people, especially front line workers and, when and wherever possible, young people and members of the wider community. And if its detached youth work I’ll ask also to go out on the streets with the workers. I suppose I believe it’s important to get up close to the work (‘proximity’, in detached youth work speak) in order to be able to judge its merits, or, in today’s parlance, its ‘impact’.

As a school governor I remember well asking an Ofsted inspector if they intended to do any lesson observations. I was told: “No, it isn’t necessary; everything we need to know is in the books.” No doubt this experience has made me wary of technocratic approaches to assessing the work we do, approaches, I have to say, that seem both increasingly common and popular.

Fast forward to recent testimony of witnesses to the UK Covid-19 Inquiry, and specifically that of Dr Kevin Fong who at the height of the pandemic was the National Clinical Advisor in Emergency Preparedness, Resilience and Response. You can view his testimony on playback here.

Fong described making visits (which is a word I use too) to forty or so hospitals, the aim of which was “to get a sense of what was really happening”, particularly in terms of “what the pandemic was like for the people on the frontline.” And he goes on to say: “You cannot understand the NHS today outside the context of the pandemic and what happened to those people.”

Old school methodology perhaps, wherein it is important to look, see, listen and hear. I did something similar in my attempt to document the experiences of detached youth workers during lockdown.

Pertinently, Fong explains, “My role was to close the gap between the data we were understandably collecting and the things we could count on the spread sheets and the information and the insight you could get from actually getting into the units.” To me, this is more than an argument that evaluation must have these qualitative dimensions; ethical questions have to be addressed too.

Indeed, Radio 4 presenter Mishal Husain, who interviews Fong, suggests: “That role had a great responsibility, all those people you met, they are looking to you to take the message back to higher powers and to get them what they need.”

Fong responds in profoundly moral terms: “Part of the promise [yes, promise] to them is that I would give voice to them and pass on their experience.” For him, it is unimaginable that technical approaches suffice in judgement-making; relaying their experiences is essential: “So much of the pandemic response was about the capacity. To be able to assess that properly you have to go beyond the numbers.”

This makes me think about the work I’ve done. Like Fong, I can’t imagine a standardised approach to reviewing and evaluating community and youth work. After all, community and youth workers are not like for like. Some are part-time; some are full-time; some are on short-term contracts, some permanent; and some have little or no training whilst some have a great deal. And then each and every area they work in is different, presenting different issues and, fundamentally, having  a variety of people within them, each of whom is also different, in their own ways, even from their peers.

Also, if we are concerned about who we are reviewing and evaluating, we ought to be concerned too about who makes this assessment. Where standardised and technocratic systems are employed, arguably, anyone can use them. But they are likely to lack credibility. Fong’s credibility comes from extensive experience as a consultant anaesthetist and as a Professor of Physiology. It can’t be unreasonable to suggest that those who are tasked with undertaking reviews and evaluations need to know what they are looking at. And be able to see and hear.

Then we get more of the, important, human stuff: “Another function of those visits was to provide support to those teams in the thick of that fight.” And in articulating this support as peer support we sense Fong’s commitment to equality; it is important to him that those he is visiting regard him as one of their own, with the same primary aim (concern for patients) in mind. Which is a million miles away from the critique levelled at many an Ofsted inspector. And he implores those in power to ensure this mechanism of peer support teams is preserved and kept going. Support, he argues, is intrinsically connected to wellbeing. Fong recounts: “You saw a massive injury to the wellbeing of frontline workers.”

All this resonates with my own experiences as I visit more and more youth work projects drawn into a reductive focus on ‘anti-social behaviour’, youth violence (and ‘Serious Youth Violence’). Work, I argue, that involves emotional labour, especially in dealing with events that can cause considerable moral distress (Reflections on a Tragic Event; lessons for youth workers, other agencies and policy-makers working in the context of young people and violence, YPAC Manchester, 2024).

So, I certainly agree with Fong when he says: “We need to find ways, better ways, to monitor, measure then protect and promote the wellbeing of the teams. And that needs to happen during a pandemic and outside as well. You cannot improve it without paying attention to the wellbeing of the frontline.”

Husain delves deeper in asking: “What’s the main lesson you think we need to take away; what do the people who make decisions need to learn?”

For Fong it’s simple enough; we need a “mechanism by which you can short-circuit the flow of information from the frontline”, to those making decisions, and this is “applicable to any organisation as it is to the NHS”. And essential to “organisations really knowing what’s going on.” Furthermore, this should happen “not just at times of crisis but any ordinary day.”

Which raises other issues; the resources to do this kind of proximity and developmental work are often not present in community and youth work. And, I suspect many other services. If it’s important it must be invested in.

We are left then with a take on Husain’s final question; whether there are any parallels with the applicability of the word ‘broken’ used by Wes Streeting to describe the state of the NHS to community and youth services.

Fong acknowledges this is an emotive word but points out “these are people who are not going to quibble too much about semantics, they do want to see change, they do want to see someone understand what they are to the service.”

Enough said about ‘broken’. Rather, to focus on the crux of the matter. Fong again: “We are very good at managing the technical elements of the service, the stuff that we can count, the stuff that is easy to manage. The social bit, the people, the human workforce, those are the people who stop this system from tearing itself apart, every single day. We need to pay better attention to them. If you cannot care for the carers you cannot care for the service.” Which is certainly where parallels with community and youth work lie given, typically, the only resources we have, especially in detached youth work, are our human resources.

Allow me, as ever, a few philosophical thoughts. Whilst care is a value it is, perhaps more importantly, also a virtue; in the sense of it being a practical value: not a technique or a technocratic operation but a behaviour, a behaviour evidencing higher moral standards. Which makes me think of the work of Simone Weil who proposed (perhaps in terms of the reviews and evaluations as ‘visits’ considered here) that: “Attention is the rarest and purest form of generosity.“ (Joseph Marie Perrin, Mon dialogue avec Simone Weil, 1942 (1984)). This is a translation from the French, a translation rarely disputed but often contested in its interpretation. Variously, but persuasively, it might mean to accord those we are working with (which absolutely includes those whose work we are reviewing and evaluating) ‘the strange compliment of being real, and putting our own real selves at their disposal’. For Michael Leddy “Weil’s sentence seems especially suited to early-twenty-first-century life. To pay attention, when so many things compete to distract us, is to make a gift of oneself.”

It seems to me then that community and youth work may actually be in advance of other services provided, that is, we respect its long-term commitment to the principle of participation (in the thick sense) in which “those who will be substantially affected by decisions made by social and political institutions must be involved in the making of those decisions.” (as quoted in Bullock et al. (eds.), 1977). And if we remember that community and youth work are relational practices, practices that are intrinsically social and human. Which is something universally acknowledged and accepted in terms of the critical importance of ‘trust-based relationships’ in and for our work, even by those keen on (and sometimes seduced by) standardisation and spreadsheets.

1 Comment

  1. Lisa Matera

    Thank you Graeme. I really enjoyed this in particular Weil’s ideas around giving people attention. It’s made me think about how I do this in my own work….

    Reply

Submit a Comment

Your email address will not be published. Required fields are marked *