Measuring the impact of social entrepreneurship in the field of intercultural dialogue is a challenging enterprise. The World Intercultural Facility for Innovation (WIFI) is developing a comprehensive evaluation methodology to assess the impact of The Intercultural Innovation Award in awardees. This methodology includes analysis of data, self-response surveys and one on one interview with program managers, beneficiaries and other participants in the project. Evaluation will be conducted at the beginning of the one year support, half way through it and after its completion. Results will be crossed with the responsiveness rate of organizations to assess to what extend the relationship with the WIFI has been instrumental in achieving results.
To overcome the challenges of measuring intangibles such as social entrepreneurship, the WIFI will analyze data including variation in the number of beneficiaries, staff and volunteers, partners, budget and existence of complementary new programs.
Surveys will use proxy indicators. In the absence of a direct measure, these proxy indicators will show the Award success in expanding the range of action of projects and helping them replicate. Surveys will address such questions:
ABOUT THE EXPANSION
- Has your initial project/idea evolved?
- Has your approach to intercultural understanding changed?
- Is your organization influencing local or national policy-making?
- What position does your organization hold in the field?
- What is the media impact of your work?
ABOUT THE REPLICATION
- Has your idea been replicated by others?
- Have other projects enriched yours?
- What are the challenges facing replication?
THE SUPPORT OF THE WIFI
- Has the relationship with the UNAOC and the BMW Group enhanced your work?
- Have other partners satisfied your expectations?
- Have we over or under delivered?
The quantitative methodology of data analysis and surveys will be complemented with a qualitative approach. In-depth interviews will be conducted with program managers, beneficiaries and other participants allowing us to capture the nuanced story of success of each winner.
Some limitations to this methodology include:
- Self-reporting – awardees themselves will report on the evolution of their projects, hence being a subjective reporting.
- Internal evaluation – surveys and interviews will be conducted by members of the WIFI team. We intend to seek for external evaluation in the near future.
- Short-term – impact indicators such as sustainability or influence in policy-making require a mid-term evaluation (2 to 3 years). A one year period is limited in assessing outcomes.