Measuring impact – and getting better at it


Measuring impact – and getting better at it


14th June 2017

Measuring impact – and getting better at it

We started our impact journey in 2009. It is only through looking back that we realised how far we have come. We did not set out to change the world, simply to answer a single question: What difference did we make?

Since then, we have assessed more than 600 programmes worth more than R3 billion. We have assessed development programmes over 15 portfolios – from education to health, enterprise to sports development, and literally everything in between. We have crossed the continent in search of scalable and replicable successful programmes to understand what works (or not) in the development space. In the process, we have identified more than 15 dimensions of impact and return, and developed a library of more than 5 000 quantitative and qualitative indicators. And what have we learned?

  1. Any resource can be measured – from books and wheelchairs to money, water pumps and schools.
  2. All programmes have impact – but not all impact is positive.
  3. In order to have a really sustainable programme, you must consider economic, environmental and social dimensions.
  4. One size does not fit all – one type of evaluation does not work for everything and, more importantly, there is a big difference between monitoring and evaluation. And monitoring and evaluation are two separate activities with different outcomes, purposes and importance.
  5. Trying to measure and define “change” is difficult. Understanding, defining, qualifying and quantifying long-term social change is an incremental effort and ongoing process.
  6. The same project can deliver varied results for different funders.
  7. How and what you spend the money on (inside the programme) has a direct influence on the impact and return of such a programme.
  8. The strategy and focus areas must clearly define the return and impact required – upfront. Sustainability must be clearly defined for exit and completion. Indicators must be developed, agreed and documented as part of the contractual phase. Internal monitoring and external evaluation processes must be established and adhered to – impact assessment does not replace evaluation and monitoring.
  9. You must consider the impact of the impact assessment on many levels. As a result of our work, we can categorically state that most programmes have only short-term impact. Those with medium-term impact are not necessarily sustainable. The long-term impact is mostly social impact, as opposed to economic impact that really contributes to poverty eradication.
  10. It is possible to determine impact and return on investment of social and community programmes. The real value lies in independent, verifiable assurance of social investment expenditure, programme results, outcomes and impact.

This presentation shows our progress over time and reflects the impact assessments we conducted during 2015. It is our way of sharing our knowledge and contributing to the growing field of practice. We would love to hear from and engage with other practitioners in this space. Communicate with us via rrossouw@nextgeneration.co.za.

Related Articles


Common mistakes in stakeholder engagement

takeholder management can be an effective risk management tool.  But simply engaging for purposes of reporting or compliance and governance underestimates the real value of stakeholder engagement.  These days companies issuing sustaina...

Diverse professionals looking at graphs

How to develop an effective impact report

Communicating impact is growing in importance as more and more stakeholders in the development sector begin to see the value in sharing their journeys and success stories. In a previous article we touched on the importance of transparenc...

A disrupted future

From here to there - and everything in between.Whether you are in health, education, youth, disability, empowerment, capacity building – it does not matter! • What will the sector look like post Covid?Download the report...

Determining impact and return: How now?

How to measure the impact and return on investment of community/social programmes has plagued industry practitioners for a long time. The Investment Impact Index™ was developed as a uniquely African methodology to solve this problem. ...

Community engagement vs stakeholder engagement

There is no simple answer, to the question: What is the difference between community engagement and stakeholder engagement. This is because the definitions used by industries and professionals are similar and so many terms are used that ...