Measuring impact – and getting better at it


Measuring impact – and getting better at it


14th June 2017

Measuring impact – and getting better at it

We started our impact journey in 2009. It is only through looking back that we realised how far we have come. We did not set out to change the world, simply to answer a single question: What difference did we make?

Since then, we have assessed more than 600 programmes worth more than R3 billion. We have assessed development programmes over 15 portfolios – from education to health, enterprise to sports development, and literally everything in between. We have crossed the continent in search of scalable and replicable successful programmes to understand what works (or not) in the development space. In the process, we have identified more than 15 dimensions of impact and return, and developed a library of more than 5 000 quantitative and qualitative indicators. And what have we learned?

  1. Any resource can be measured – from books and wheelchairs to money, water pumps and schools.
  2. All programmes have impact – but not all impact is positive.
  3. In order to have a really sustainable programme, you must consider economic, environmental and social dimensions.
  4. One size does not fit all – one type of evaluation does not work for everything and, more importantly, there is a big difference between monitoring and evaluation. And monitoring and evaluation are two separate activities with different outcomes, purposes and importance.
  5. Trying to measure and define “change” is difficult. Understanding, defining, qualifying and quantifying long-term social change is an incremental effort and ongoing process.
  6. The same project can deliver varied results for different funders.
  7. How and what you spend the money on (inside the programme) has a direct influence on the impact and return of such a programme.
  8. The strategy and focus areas must clearly define the return and impact required – upfront. Sustainability must be clearly defined for exit and completion. Indicators must be developed, agreed and documented as part of the contractual phase. Internal monitoring and external evaluation processes must be established and adhered to – impact assessment does not replace evaluation and monitoring.
  9. You must consider the impact of the impact assessment on many levels. As a result of our work, we can categorically state that most programmes have only short-term impact. Those with medium-term impact are not necessarily sustainable. The long-term impact is mostly social impact, as opposed to economic impact that really contributes to poverty eradication.
  10. It is possible to determine impact and return on investment of social and community programmes. The real value lies in independent, verifiable assurance of social investment expenditure, programme results, outcomes and impact.

This presentation shows our progress over time and reflects the impact assessments we conducted during 2015. It is our way of sharing our knowledge and contributing to the growing field of practice. We would love to hear from and engage with other practitioners in this space. Communicate with us via rrossouw@nextgeneration.co.za.

Related Articles


Community engagement vs stakeholder engagement

There is no simple answer, to the question: What is the difference between community engagement and stakeholder engagement. This is because the definitions used by industries and professionals are similar and so many terms are used that ...

Pensive woman looking out window

Failing at grantmaking?

Failing at grantmaking? Low impact and low return: Funders and grantmakers should be concernedAfter conducting numerous impact assessments for some of South Africa’s largest donors and grantmakers, Next Generation Consultants came up w...

What do donors want?

When donors decide to contribute to a cause, they often seek specific benefits that go beyond mere financial support. Understanding these motivations can help impact organizations tailor their approaches to meet donor expectations...

PROVING IMPACT THROUGH EVIDENCE

‘Impact’ is the word of the moment in philanthropy, charity and even impact investing. Donors want to have an impact with their giving, charities want to know if their work is making a difference, and investors want their investments...

Hands holding a note that says ROI

Social value and return on investment

Lets talk about social return on investmentGrantmakers, donors and philanthropists want nothing else, but to make an impact with their investments.  So do companies, foundations and trusts.  And – if you are a more commercially incli...

Reporting on stakeholder engagement

Sustainability and integrated reporting guidelines and frameworks require in-depth reporting on stakeholder relationships and engagement activities.  However, it seems that companies are at a loss of how to engage, what to engage on, ho...