Monitoring and evaluation

We work to maximise the social and economic impact of development efforts. As a trusted provider of monitoring and evaluation services we combine our deeply rooted understanding of the African context with our extensive experience in qualitative and quantitative monitoring and evaluation (M&E) methods to assess progress and measure value creation. 

We provide African governments, companies, international donors, foundations and non-profits with the information and insight they need to improve their interventions and produce better results, ultimately achieving greater impact on economies and people’s lives.

Read More
Expertise Areas

Design, review and support of M&E systems

We provide monitoring and evaluation technical assistance and capacity development to programmes and their staff members. In doing so, we adopt a results-based management approach, which ensures that M&E processes are embedded in programme implementation and decision-making. This ensures that emerging lessons can immediately be fed back to programme decision-makers, who can make adjustments that improve the programme’s ultimate value and impact.

When providing technical assistance, our role varies from being the M&E officer on short- or long-term programmes, to assisting and mentoring internal M&E staff, to conducting workshops and training sessions, and to developing M&E frameworks and tools for implementation.

We have worked with Adam Smith International, Access to Finance Rwanda, Helmsley Charitable Trust, TechnoServe, the Organisation for Economic Co-operation and Development (OECD), Corruption Watch South Africa, Financial Sector Deepening Kenya, the South African Financial Services Board (FSB) and the South African National Treasury’s Jobs Fund on developing their M&E systems and frameworks. 

Evaluation & impact assessment

Evaluations can be conducted at any point in an intervention’s life cycle. They are used to diagnose and analyse constraints, understand the appropriateness of an intervention’s design, estimate and validate the value an intervention has delivered, and uncover ways in which current roll out or future scale-up or replication can be improved so as to maximise impact.

We are committed to making our evaluations as useful as possible for funders, implementers and service providers. We are well versed in refining key questions to be answered by evaluations and generating those answers through multiple data collection methods, always upholding the highest ethical standards and rigour while doing so.

Some of our evaluation clients include DFID, the MasterCard Foundation, the Department of Planning, Monitoring and Evaluation in the South African Presidency (DPME), the IFC, AFD, the Development Bank of South Africa (DBSA), Habitat for Humanity and CARE International. 

Ongoing support as a learning partner

Beyond assisting our clients to validate and improve their own impact, there are important lessons to be learnt that can be shared with other funders and practitioners and applied to their own interventions. This facilitates a collective movement towards improvement and the realisation of greater value for more people.

We partner with our clients to provide ongoing learning support by developing collaborative, dynamic learning frameworks that facilitate learning and knowledge sharing with key audiences.

Market systems development

Undertaking practical and useful results measurement for programmes applying a market systems development approach is complex and requires one to think outside of the traditional linear approach to achieving impact.  

We combine our understanding of market systems, catalytic funding mechanisms and experience in private sector development with deep knowledge and expertise in international M&E standards, including the Donor Committee for Enterprise Development Standard.

Read more

Financial inclusion

Hundreds of millions of people across sub-Saharan Africa lack access to basic financial products and services, including savings, credit and insurance. Lack of access to financial services is particularly acute among the poor, among women and among those living in rural areas where the reach of traditional financial channels has historically been limited.

Read more

Projects

Final evaluation of YouthSave Initiative

Project name:
Final evaluation of the YouthSave Initiative

Service:
Monitoring and evaluation
Financial inclusion

Sector:
Financial Services
Education
Public and Social
Youth economic opportunities

Area of Expertise:
Evaluation & impact assessment

Client:
The MasterCard Foundation

Date:
2014 - 2015

Country:
Canada
Colombia
Ghana
Kenya
Nepal


The YouthSave initiative was a five-year youth savings and financial education programme aimed at 12 to 18-year-olds in Canada, Colombia, Ghana, Kenya and Nepal. It was implemented by a consortium of four partner organisations (Save the Children, CGAP, New America and the Centre for Social Development and Washington University in St Louis) through partnerships with commercial banks and research institutions in each country. 

YouthSave had a substantial research, learning and advocacy agenda that was intended to inform youth-based savings products and policies in and beyond its target countries.YouthSave was one of the first long-term programmes that had been funded by the foundation. 

Genesis was contracted by the MasterCard Foundation to conduct a final evaluation of the YouthSave initiative. The purpose of the evaluation was to document the achievements of the initiative, highlight the lessons learnt during the programme so as to further contribute to the youth savings evidence base, and inform the MasterCard Foundation's approach to the funding and programming of long-term, multi-country programmes and partnerships.

The research methods included a review and synopsis of key documentation, participating in the YouthSave Learning and Exchange Conference in Toronto in March 2015, interviews with 97 stakeholders and focus-group discussions with young people in each of the four countries. 

The evaluation questions were analysed and reported according to five thematic areas which had been identified by the consortium as priority learning areas. While the evaluation captured the achievements of YouthSave, it provided insight into the design and implementation of large, complex programmes by a consortium of partners that had informed the foundation's funding and programming strategy. 

During the evaluation the team also revisited YouthSave's “theory of influence”. This is the creation of knowledge and information to achieve broader systemic impact for youth. It also identified the need for the programme's learning agenda to be taken further and to be disseminated at a country level. Since the evaluation, the YouthSave partners have achieved a high level of dissemination and held dialogue workshops in each of the project countries.

Learning partner for ASISA Foundation

Project name:
Learning partner for the ASISA Foundation

Service:
Monitoring and evaluation
Financial inclusion

Sector:
Youth economic opportunities
Financial Services
Education

Area of Expertise:
Ongoing support as a learning partner

Client:
ASISA Foundation

Date:
2014 - ongoing

Country:
South Africa


The ASISA Foundation was established by the Association for Savings and Investment South Africa (ASISA) under their Foster the Future initiative to implement meaningful consumer financial education (CFE) initiatives on behalf of the industry, with the explicit goal of becoming a centre of best practice for CFE. 

To achieve this goal and become a thought leader in this field, the foundation places a great deal of importance on the monitoring and evaluation (M&E) of its CFE programmes, and the learning that comes through this process. 

By continuously learning from its own CFE programmes and adapting its approach to CFE in response, the Foundation is able to generate lessons and good practices regarding the implementation and M&E of CFE programmes more broadly. The foundation then disseminates these lessons to the ASISA membership as well as to other organisations in the financial sector implementing CFE programmes. 

The foundation first contracted Genesis as its monitoring, evaluation and learning partner in 2014 to evaluate and provide ongoing feedback on its pilot CFE programme, Saver Waya-Waya. This evaluation generated a number of lessons and recommendations. The most notable of these was the effectiveness of repeat messaging through a variety of delivery mechanisms, and the importance of targeting groups of individuals who are in a similar stage of life so as to better contextualise the messaging. 

Considering these lessons, the foundation has since funded three, more targeted, interventions. These interventions have all been designed explicitly, based on the recommendations emerging from the evaluation of the pilot Saver Waya-Waya programme: 
Project Qaphela/Wagewise: This programme targets employed workers and focuses on the importance of understanding payslips, debt and benefit statements. The programme was implemented and evaluated in 2015 and in 2016. A third phase of the programme will begin in 2017. Each iteration has informed the design of the following phase.
Saver Waya-Waya TVET: This programme targets young adults through Technical Vocational Education and Training (TVET) colleges and includes a soft-skills component to prepare the students for the world of work. The programme was implemented and evaluated in 2016.
Saver Waya-Waya FLAME: This programme targets mature adults through savings groups and community centres and incorporates a micro-enterprise element to the CFE. This programme is currently underway. 

Genesis continues to work in close partnership with the foundation as its monitoring, evaluation and learning partner across its full portfolio of CFE programmes. Through this partnership, Genesis has directly unlocked value for the foundation by providing actionable recommendations to improve the design of its programmes.

Top photo: TVET students perform their industrial theatre production as part of  ASISA's Saver Waya-Waya programme

SAVER WAYA-­‐WAYA: ASISA Foundation’s Financial Literacy Programme

Mid-term review of project to support agri-finance innovation

Project name:
Mid-term evaluation of the Financial Inclusion for Smallholder Farmers in Africa Project (FISFAP)

Service:
Monitoring and evaluation
Financial inclusion

Sector:
Agriculture and Agribusiness
Financial Services

Area of Expertise:
Evaluation & impact assessment

Client:
Alliance for a Green Revolution in Africa (AGRA)

Date:
2017

Country:
Ghana
Kenya
Tanzania


The Financial Inclusion for Smallholder Farmers in Africa Project (FISFAP) is a five-year USD 15.5-million project funded by the Mastercard Foundation and implemented by AGRA, which aims to improve food security and incomes of over 700 000 smallholder farmers in Ghana, Kenya and Tanzania. 

The project provides grants and technical assistance to organisations by developing innovations that improve farmer access to critical financial and non-financial services that can improve their productivity and operations. It also conducts a range of learning activities, aimed at crowding in financial service providers, governments and other organisations to deliver improved financial and non-financial products and services for smallholder farmers.

In 2017, in the third year of FISFAP’s implementation, Genesis was contracted to conduct a mid-term evaluation of the project and provide a review of the project to date. The purpose of the evaluation was to provide a reasoned and independent view of the performance of the project against its intended goals and objectives, as well as its design, achievement and challenges. 

The evaluation was conducted using a mixture of qualitative and quantitative data collection methods, including a desktop review; 42 key informant interviews with project staff, partner organisations, consultants and external stakeholders; site visits and focus group discussions with smallholder farmers accessing the products or services funded under FISFAP.

The findings were presented in eight key areas: progress against targets; partner selection and support; implementation successes and challenges; understanding and meeting clients’ needs; impact and additionality; financial sustainability, strategic alignment; and monitoring, evaluation and learning. 

Short evaluative overviews of each of FISFAP’s grantees were also provided. The evaluation concluded by providing recommendations to inform future strategy and identify course corrections to adjust project weaknesses as well as enhance and extend project strengths.

Developing Mpumalanga's M&E framework

Project name:
Developing Mpumalanga's provincial monitoring and evaluation framework and system

Service:
Monitoring and evaluation

Sector:
Public and Social

Client:
Office of the Premier, Mpumalanga

Date:
2014 - 2015

Country:
South Africa


The Office of the Premier in Mpumalanga required assistance in developing the province’s M&E framework. This involved setting up the framework for information flow to support evidence-based decision-making, as well as developing the indicators needed to measure progress across all 14 provincial outcomes.

In developing the M&E framework, we followed a results-based management approach. We leveraged our understanding of government processes to create a framework that provided a foundation for systematic implementation that would deliver consolidated and evidence-based reporting and decision-making.

By reflecting on national documentation and frameworks, and reviewing all existing provincial frameworks, we ensured alignment and comprehensiveness within the M&E framework. 

The M&E framework was developed in a way that sought to instil ownership and ensure usefulness and relevance for the department. In particular, it was tailored to the needs and capacity of provincial staff members, as assessed through readiness assessments, and acquired the necessary buy-in through iterative presentations and workshops.

Microfinance sector in Rwanda still needs support

Project name:
End of project evaluation for the Microfinance Challenge Fund Rwanda

Service:
Monitoring and evaluation
Market systems development
Financial inclusion

Sector:
Financial Services

Area of Expertise:
Evaluation & impact assessment

Client:
Access to Finance Rwanda (AFR)

Date:
2017

Country:
Rwanda


Genesis Analytics evaluated the Microfinance Challenge Fund Rwanda and found that the Rwandan microfinance industry still needs support.

Genesis was contracted by Access to Finance Rwanda (AFR) to conduct the evaluation of the Microfinance Challenge Fund Rwanda, which was designed and capitalized by KfW to address the microfinance industry in Rwanda’s inability to self-correct on the issues of weak technical capacity and access to refinancing.

KfW signed a grant agreement with the Government of Rwanda for €3-million to be channelled through AFR for the support of microfinance institutions (MFIs), and in April 2014 the Microfinance Challenge Fund was established. The fund provided microfinance institutions (MFIs) with refinancing and technical training and assistance for a period of three years.

The purpose of the evaluation Genesis conducted was to provide a holistic review of the fund, including its projects, take stock of how the fund performed, and assess the degree to which its objectives had been achieved. 

The evaluation approach amalgamated a sector review and a framework of good Challenge Fund practices, to create an analysis framework. Data and information collected through a document review, and engagements with the sector, programme staff and clients then fed into this analysis framework to answer the evaluation questions posed and inform the option analysis.

Using the findings of this evaluation Genesis reflected on the lessons learnt through the fund’s implementation and conducted a feasibility analysis for a second phase. Finally, based on the evaluation and an assessment of the recommendations, we provided key considerations for AFR to consider when deciding whether to support and expand the fund.

The results of the project were presented in March 2017 to key stakeholders in the microfinance sector. Stakeholders present included representatives from the Bank of Rwanda, commercial banks, microfinance institutions, donor agencies, industry organisations and NGOs. A robust and frank conversation was facilitated between these stakeholders, where the issues facing the sector were aired and interrogated.

Value assessment of Access to Finance Rwanda

Download report


Genesis studies why 30% of SA births go unregistered

Project name:
Implementation evaluation of the birth registration programme

Service:
Monitoring and evaluation

Sector:
Public and Social

Area of Expertise:
Evaluation & impact assessment

Client:
Department of Planning, Monitoring and Evaluation, South Africa

Date:
2016

Country:
South Africa


A priority for the Department of Home Affairs (DHA) is to ensure the efficient determination and safeguarding of identity and status of South African citizens. A fundamental way to achieve this is an up-to-date, reliable National Population Register (NPR) in which all births are registered in a timely manner. 

Only about 694 000 out of 1.1 million births a year in South Africa are registered. To improve this, the DHA has implemented a variety of initiatives under the Birth Registration Programme. Genesis was contracted by the Department of Planning, Monitoring and Evaluation (DPME) to evaluate the programme to understand why many registrations are not done within the first 30 days of birth.  

Genesis is using a systems thinking approach for this evaluation because birth registration is complex. The evaluation considers the context within which birth registration operates and how this affects the implementation of the DHA’s birth registration interventions. A theory-based evaluation approach is being used in conjunction with the systems thinking approach to better understand the DHA’s birth registration programme and its implementation. To facilitate this, Genesis is developing a theory of change for the Birth Registration Programme. It forms the basis of the evaluation’s analysis framework that is guided by the OECD’s Development Assistance Committee (DAC) evaluation criteria of relevance, effectiveness, efficiency, impact and sustainability.

Genesis is using quantitative and qualitative methods to provide evidence on the barriers to birth registration in South Africa and systematically develop recommendations on how timely birth registration can be improved. In doing so, Genesis is undertaking a rigorous literature review, conducting site observations, interviewing key informants and is engaging with the users of the birth registration system.

Throughout the evaluation, Genesis has committed to a consultative and collaborative approach. To effect this, stakeholder engagements are a priority. In line with this, the Genesis evaluation team met the Minister of Home Affairs, Malusi Gigaba, and the deputy, Fatima Chohan, to understand the ministry’s objectives of the evaluation and what is envisioned as the key evaluation outcomes. As part of a collaborative approach and skills transfer initiative, Genesis has included four members for the DHA and one member of the DPME to take part in the evaluation. 

Impact evaluation of Industrial Innovation programme

Project name:
Impact evaluation of Support Programme for Industrial Innovation

Service:
Monitoring and evaluation

Sector:
Public and Social

Client:
Department of Planning, Monitoring and Evaluation in the Presidency and the Department of Trade and Industry

Date:
2014

Country:
South Africa


The Department of Trade and Industry’s Support Programme for Industry Innovation (SPII) was designed to promote and assist technology development in South African industry. It provides grants for projects that develop innovative products and/or processes, specifically up to the pre-production prototype stage. Genesis was contracted to do an evaluation of SPII, to provide insight into the programme’s effectiveness and efficiency, assess its impact and determine how its impact could be strengthened.

The evaluation employed a range of analytical tools, including a probit model. It assessed the probability of success of innovations, used purposeful sampling techniques for qualitative case studies, and analysed MIS data and an online survey, as well as an expanded theory of change for the programme.

Based on the findings from the research, Genesis found that SPII played an important role in the innovation landscape in South Africa. It also has a direct impact on innovation, with potential indirect impact on long-term job creation and increased competitiveness.

The team further found that bridging the gap between the pre-production prototype and commercialisation was the greatest barrier to the success of innovations. This is particularly true in South Africa, where the venture capital market is underdeveloped and investors are often risk averse to extending support beyond pre-production prototype to pre-commercialisation.

Based on the evaluation findings, the team was able to work closely with the DTI and assist with its understanding of whether SPII should be continued and how its impact could be improved. The evaluation recommendations were realised through this iterative and collaborative process, leading to the re-launch of SPII with the expanded mandate to extend support beyond pre-production prototype to pre-commercialisation. 

Genesis won a National Evaluation Plan award for the evaluation. This was awarded on the basis of an evaluation “whose evidence contributed towards improving government performance, or which were assessed to be of good quality and have a potential to be instrumental in improving government performance”.

Download full report

Press report: http://www.bdlive.co.za/business/innovation/2015/12/15/innovation-fund-expands-support-for-local-inventors

Partners with Rockefeller on Digital initiative

Project name:
Monitoring and Evaluation of Digital Jobs Africa

Service:
Monitoring and evaluation

Sector:
Youth economic opportunities

Area of Expertise:
Ongoing support as a learning partner

Client:
Rockerfeller Foundation

Date:
2016 - ongoing

Country:
Kenya
South Africa


Africa’s populations are growing at a rapid pace and job opportunities are not keeping up with the growth, particularly among the youth. Youth unemployment is increasingly a challenge in many African countries and South Africa is no exception.

To overcome this The Rockefeller Foundation launched the Digital Jobs Africa (DJA) initiative in 2013 to catalyse new, sustainable employment opportunities and skills training for African youth, with a focus on the ICT sector. The goal of the DJA is to influence change in business practice by demonstrating the value of impact sourcing and contribute to the social and economic well-being of the youth and their circle of influence.

In order to influence change in business practices, the DJA needs to identify and showcase the benefits of impact sourcing to increase commitment to this among new corporate partners. Genesis has been contracted to fulfill this objective as the monitoring and evaluation (M&E) partner for the DJA.

Additionally, Rockefeller aims to pursue a results-based management approach to the management of the DJA, where on-going learnings are fed back into the initiative’s design and implementation to maximise its effectiveness and impact. Ensuring that this approach is achieved by the initiative is the mandate of the M&E partner. Rockefeller aims to promote accountability of the initiative’s disbursements, which is the final objective of the M&E partner.

Final evaluation of Banking on Change

Project name:
Final evaluation of Banking on Change

Service:
Monitoring and evaluation
Financial inclusion

Sector:
Financial Services

Area of Expertise:
Evaluation & impact assessment

Client:
A CARE International programme managed by Plan UK and Barclays

Date:
2015 -2016

Country:
Egypt
Ghana
India
Kenya
Tanzania
Zambia


Banking on Change was a partnership between Barclays, CARE International UK and Plan UK aimed at extending savings-led financial services to vulnerable individuals. 

The programme had three core components: the introduction and expansion of the Village Savings and Loan Association (VSLA) methodology to low-income youth and adults, the delivery of various forms of training to the VSLAs, including financial literacy, enterprise, employability and bank literacy training, and to link a third of the Banking on Change VSLAs in Africa to Barclays and other formal financial institutions. 

The programme was implemented in two three-year phases. Phase 2 had a greater focus on young people and was rolled out from 2013 to 2015 in Egypt, Ghana, India, Kenya, Tanzania, Uganda and Zambia. 

Genesis was contracted by the partnership to conduct a final evaluation of Phase 2 to understand the achievements and impact of the programme and to document the key learnings that have emerged to inform future efforts in savings-led financial inclusion for the youth. 

The research methods employed by the Genesis team included a desktop review of data and documentation, 45 stakeholder interviews at the global and country levels, and 12 focus-group discussions with savings group members in Tanzania, Uganda and Zambia. 

The evaluation was an important validation of Banking on Change's achievements and highlighted lessons that informed each partner's future approaches to design and programming in the financial inclusion and youth economic opportunities sectors.

Impact evaluation of POWER Africa in Rwanda

Project name:
Impact evaluation of POWER Africa - Rwanda

Service:
Monitoring and evaluation
Financial inclusion

Sector:
Financial Services

Area of Expertise:
Evaluation & impact assessment

Client:
A MasterCard Foundation programme managed by CARE Canada

Date:
2014 - ongoing

Country:
Rwanda


CARE Canada’s Promoting Opportunities for Women’s Economic Empowerment in Rural Africa (POWER Africa) initiative, funded by the MasterCard Foundation, aims to improve financial inclusion in Burundi, Côte d’Ivoire, Ethiopia and Rwanda by linking village loan and savings associations (VSLAs) with formal financial institutions. 

Promoting opportunities for Financial Inclusion in Rwanda (PROFIR), as the project is called in Rwanda, aims to allow more than 180 000 people access to formal financial services. The PROFIR project began in November 2013 and will continue until December 2017.

While the goal of PROFIR is to improve people’s lives by linking their savings groups to the formal financial sector, a broader objective could be to design an intervention that has great impact and is able to be scaled and replicated in other contexts by various financial-sector players. Thus, there is emphasis on measuring the impact of PROFIR using a rigorous evaluation of the intervention.

Genesis was contracted by CARE Canada in 2014 to conduct an impact evaluation on PROFIR. The evaluation was designed to be as unobtrusive as possible without compromising its credibility and statistical validity. 

PROFIR’s quantitative impact will be estimated using difference in differences, while case studies on “typical” members are being used to provide qualitative depth to the study. The baseline for the evaluation was completed in early 2015, and the end line will be completed in the latter half of 2017.

Helping innovation for Africa’s rural farm families

Project name:
Helping to innovate a new sector of microfinance for Africa’s rural farm families

Service:
Monitoring and evaluation
Financial inclusion

Sector:
Agriculture and Agribusiness
Financial Services

Area of Expertise:
Evaluation & impact assessment

Client:
A MasterCard Foundation programme managed by One Acre Fund

Date:
2015 - 2016

Country:
Burundi
Kenya
Rwanda


Despite the economic significance of agriculture in East Africa, smallholder farmers in the region are extremely poor. Many produce only enough food for their families. 

These smallholder farmers' low productivity is exacerbated by a lack of access to quality inputs, financing and efficient farming techniques.

The One Acre Fund was established to extend financing, technical support and other services to smallholder farmers. In 2013, the MasterCard Foundation provided a grant to the One Acre Fund to expand its reach in Kenya, Rwanda and Burundi, and to strengthen its core systems and become a knowledge disseminator. In 2016, One Acre Fund and the MasterCard Foundation engaged Genesis to conduct the mid-term evaluation of this grant.

The evaluation used a mixed-methods, participatory and iterative approach. This included a review and synopsis of key documentation, interviews with stakeholders in rural agriculture financing (RAF), field observations and focus group discussions (FGDs) with existing, previous, and non-One Acre Fund farmers. 

As part of these FGDs, the evaluation team made use of a pocket voting participatory approach to elicit more honest reactions to questions on the constraints facing the farmers, as well as what they found to be the most useful component of One Acre Fund’s package. The evaluation provided insights to inform strategic decisions for the organisation, as well as to inform future efforts in the broader RAF sector. 

Genesis also put forward recommendations to the One Acre Fund to consider for the rest of the grant term and beyond to maximise its impact.

TOP: One Acre Fund testing different post-harvest processing methods

Positve impact of Soul Buddyz Clubs on young women

Project name:
Evaluation of the Soul Buddyz Clubs

Service:
Monitoring and evaluation
Prevention

Sector:
Public and Social
Health

Area of Expertise:
Research, evaluation and design

Client:
Soul City Institute for Health and Development Communication

Date:
2015 - 2017

Country:
South Africa


The Soul City Institute for Health and Development Communication (SCIHDC) has been running Soul Buddyz Clubs (SBC) in primary schools in South Africa since 2003. SCIHDC wanted to determine the long-term impact of participation in SBC on previous members’ overall health, community participation and level of education attainment. 

The clubs, whose members are between 8 - 14 years, focused on promoting positive attitudes and behaviours that related to HIV, such as self-efficacy for safer sexual behaviour, condom use, community activity, gender based violence and alcohol or drug use.

The sample comprised people who were SBC members between 2004 and 2008. We designed a retrospective cohort study design in order to determine the impact of being an SBC member. Cases comprised individuals aged 18-24 years who attended SBC's approximately 6-10 years ago (2004-2008). Controls were individuals aged 18-24 years who never attended SBC but grew up and attended in schools in the same communities. Our fieldwork partner, Social Surveys Africa, were able to interview 800 respondents (300 cases and 500 controls) between Gauteng and KwaZulu-Natal.

The challenges included having to find and recruit members retrospectively without a sample frame, establishing an appropriate control group, getting participants to come to a central venue for interviews and asking participants to get an HIV test.

Winner in Joburg receiving his camera from Mpho Molebatsi from SSA

Winner in Joburg receiving his camera from Mpho Molebatsi from SSA

Our approach was to first conduct a feasibility study to determine the likelihood of being able to locate previous SBC members and to determine the preferred control group. We used these findings to develop an innovative retrospective cohort study design to meet the study objectives. 

We then used a multi-pronged recruitment approach to recruit the ex-SBC members. Methods included radio adverts, a Facebook group, WhatsApp and telephone calls to those identified through snowballing. 

We incentivised referrals of previous SBCs to improve snowballing. We established where the majority of the ex-SBC members attended primary school and together with SSA we identified appropriate community controls using random sampling. SAA staff were at the fieldwork sites and ensured participants were given transport money and thank-you gifts. We ran competitions at the fieldwork sites to improve the response rate.

We were able to combine epidemiological expertise, in-depth sector knowledge and real world experience to solve a difficult evaluation problem for our client using an innovative study design. We found that ex-buddyz were more likely to have completed Grade 12, be involved in community activities and to have used condom at first sex. They were less likely to have sex before 15 years, to have had more than one partner in the past 12 months and have had multiple sexual partners in the past month. 

Female ex-Buddyz were less likely to be HIV positive than controls. There was no effect on male ex-Buddyz, possibly because the sample size of HIV positive men in this age group was too small.

The results of the study will be used to determine whether school-based programmes have any lasting impact on HIV – an area where there is not much evidence. In addition, SCIHDC now has a list of previous members as well as an activate platform (Facebook group) through which it can communicate with them. 

Top picture: Sarah Magni, the manager of the Health practice, addresses a briefing on the study that was presented at the 8th SA AIDS Conference in Durban in June 2017

Positive impact of health club on young women's HIV status

Meet the Team

Genesis contributes to Democratic Evaluation debate

Genesis has contributed to the debate on the role of evaluation in building democracy in South Africa with a chapter in a recently published anthology, Democratic Evaluation and Democracy: Exploring the Reality. 

Alyna Wyatt and Mishkah Jakoet (right) co-authored a chapter entitled "Exploring Economic Development Initiatives and the Link to Democratic Outcomes".

Full report

Our analyst wins young, emerging evaluator award

Genesis staffer Ashleigh Fynn won the South African Monitoring and Evaluation Association's Young and Emerging Evaluator (YEE) Award at their 2017 conference in Joburg.

In the citation, SAMEA said Ashleigh has made "substantial strides in her understanding of evaluation theory and practice through a variety of projects. Most recently as a core team member for the Evaluation of the National Evaluation System. 

"Ashleigh also conducted an evaluation of Corruption Watch’s Bua Mzansi campaign, which was designed to increase and inspire public participation in the appointment of a public prosecutor. Ashleigh will be presenting this evaluation at the upcoming AEA conference in November.

"Ashleigh has been pro-active at identifying, expanding and encouraging her team’s use of digital and social media monitoring tools, ensuring the team remains ‘cutting edge’."

The SAMEA Emerging Evaluator award celebrates  evaluators who, in the earliest stages of their career, have made significant contributions to the field or practice of evaluation and  who demonstrate quality and effectiveness in their work.

Genesis team wins two evaluation awards in 2015

More information about our practice

Our Evaluation for Development practice has extensive experience in assisiting governments, companies, international donors, foundations and non-profits in Africa with the information and insight they need to improve their interventions and produce better results, ultimately achieving greater impact on economies and people’s lives.

Download the brochure

Areas of Service Expertise

  • Design, review and support of M&E systems
  • Evaluation & impact assessment
  • Ongoing support as a learning partner
  • Market systems development
  • Financial inclusion

Related Sectors

Projects

Project

Final evaluation of YouthSave Initiative

Genesis was contracted by the MasterCard Foundation to conduct a final evaluation of the YouthSave initiative. YouthSave was one of the first long-term programmes that had been funded by the foundation. 

View Project
Project

Learning partner for ASISA Foundation

Genesis was appointed the learning partner for the ASISA Foundation, which was established by the Association for Savings and Investment South Africa (ASISA) to implement consumer financial education initiatives on behalf of the industry.

View Project

Search

Search for more Genesis projects

Leading the team

​Alyna Wyatt

Partner (Evaluation for Development)

​Alyna Wyatt
Partner (Evaluation for Development)
Read More

Mishkah Jakoet

Manager

Mishkah Jakoet
Manager
Read More

Dhashni Naidoo

Manager

Dhashni Naidoo
Manager
Read More

Caitlin Smit

Manager

Caitlin Smit
Manager
Read More

Noel Verrinder

Manager (Kenya and UK)

Noel Verrinder
Manager (Kenya and UK)
Read More