Measuring impact – and getting better at it


Measuring impact – and getting better at it


14th June 2017

Measuring impact – and getting better at it

We started our impact journey in 2009. It is only through looking back that we realised how far we have come. We did not set out to change the world, simply to answer a single question: What difference did we make?

Since then, we have assessed more than 600 programmes worth more than R3 billion. We have assessed development programmes over 15 portfolios – from education to health, enterprise to sports development, and literally everything in between. We have crossed the continent in search of scalable and replicable successful programmes to understand what works (or not) in the development space. In the process, we have identified more than 15 dimensions of impact and return, and developed a library of more than 5 000 quantitative and qualitative indicators. And what have we learned?

  1. Any resource can be measured – from books and wheelchairs to money, water pumps and schools.
  2. All programmes have impact – but not all impact is positive.
  3. In order to have a really sustainable programme, you must consider economic, environmental and social dimensions.
  4. One size does not fit all – one type of evaluation does not work for everything and, more importantly, there is a big difference between monitoring and evaluation. And monitoring and evaluation are two separate activities with different outcomes, purposes and importance.
  5. Trying to measure and define “change” is difficult. Understanding, defining, qualifying and quantifying long-term social change is an incremental effort and ongoing process.
  6. The same project can deliver varied results for different funders.
  7. How and what you spend the money on (inside the programme) has a direct influence on the impact and return of such a programme.
  8. The strategy and focus areas must clearly define the return and impact required – upfront. Sustainability must be clearly defined for exit and completion. Indicators must be developed, agreed and documented as part of the contractual phase. Internal monitoring and external evaluation processes must be established and adhered to – impact assessment does not replace evaluation and monitoring.
  9. You must consider the impact of the impact assessment on many levels. As a result of our work, we can categorically state that most programmes have only short-term impact. Those with medium-term impact are not necessarily sustainable. The long-term impact is mostly social impact, as opposed to economic impact that really contributes to poverty eradication.
  10. It is possible to determine impact and return on investment of social and community programmes. The real value lies in independent, verifiable assurance of social investment expenditure, programme results, outcomes and impact.

This presentation shows our progress over time and reflects the impact assessments we conducted during 2015. It is our way of sharing our knowledge and contributing to the growing field of practice. We would love to hear from and engage with other practitioners in this space. Communicate with us via rrossouw@nextgeneration.co.za.

Related Articles


Scaling impact, or impact at scale?

One of the biggest challenges in the development, humanitarian and social sectors is scaling the work undertaken by a large range of stakeholders to bring about greater impact on multidimensional levels. In this presentation below we...

Fingers touching a display that says "think differently"

Rethinking the funding of NGOs

The Next Generation Research Report 2020, Disruption with Impact dived deep into how the development sector, and how the funding of NGOs, is changing. Some of the most significant pressures that organisations face is the demand to become...

Diverse professionals touching hands around a table

Blended Finance

Innovative and blended finance as a route to greater social impact and sustainabilityThere are three ways in which private resources can be harnessed for meeting societal needs: Through charitable giving and philanthropy Through corporat...

Diverse group of laughing professional women

Social Innovation: beyond the buzz

From organ transplant deliveries by drone to smartphone apps that help diagnose eye disease and plant-based burgers that taste just like meat right through to entrepreneurship programmes that aim to build thriving early child development...

Understanding social capital

Presentation delivered to MBA students about the importance of social capital. What it is, how to measure it, case studies and applications. How it is different to other capitals and what is happening in the field....

Reporting on stakeholder engagement

Sustainability and integrated reporting guidelines and frameworks require in-depth reporting on stakeholder relationships and engagement activities.  However, it seems that companies are at a loss of how to engage, what to engage on, ho...