Unmesh Sheth Founder, SoPact, “Measure & Build Impact Evidence That Matters”
The social sector is going through a massive change never seen before. Thanks to the advocacy of innovative foundations, impact investments are now becoming mainstream, along with collective impact programs and other initiatives like Social Impact Bonds and Pay for Success Programs. In the U.S. alone, impact (or socially responsible investing) has grown to $6.57 trillion.
Foundations are also shifting their philanthropic strategies to a more targeted approach. As examples, we have the recent change at Ford Foundation toward combating inequality and the new generation of funders, such as Robin Hood Foundation in New York and Tipping Point in San Francisco. These organizations are now adopting outcome and impact measurement to ensure the success of the programs they fund. Many foundations are reducing the grant portfolio size and focusing on fewer grants but with larger and often unrestricted funding. The overall result of this behavior is a higher engagement, and many more touch points throughout the grant process.
Major funding and program development organizations increasingly believe that a structural change in the social sector will happen when like-minded players start working collaboratively.
More and more, the success of new philanthropic models depends on the rise of collective impact initiatives and demonstrating impact evidence. “SSIR's Metrics 3.0: A New Vision for Shared Metrics” 2 presents a strong argument for a collaborative approach at the organization and the ecosystem levels, as the best way to achieve value generation in the social sector.
As these trends spread, we are witnessing the rise of thousands of collective impact ecosystems accompanied by improved Impact Investment models. These ecosystems incorporate different catalysts to impact measurement. A few examples:
●The United Nations needs a better way to roll out its Sustainable Development Goals from a global to a local scope.
●Impact investors need a better approach to demand impact evidence from small growing businesses (SGBs).
●Big corporations, small and medium enterprises, and the public sector need to demonstrate sustainability and social responsibility to different stakeholders.
In this blog series, I will explore the key challenges in building an efficient collective impact measurement system. I will look at the transition from shared measurement to collective impact, and how impact evidence is critical for boosting the investor’s confidence and engagement.
"The absence of a common impact language and supporting data infrastructure is a major barrier to achieving comparable and accessible impact data."
Good impact measurement has four major elements:
2.Better partner, investee, grantee engagement in the metrics/outcomes data collection process.
3.A scheme that provides a better understanding of the qualitative and quantitative impact results relevant to each initiative or program.
4.An integrated system that simplifies the use of the current, but varied standards, frameworks, and tools.
Let’s look at the first element.
Metrics have been spoken of since the creation of program related investments (PRIs), which according to the Foundation Center are “investments made by foundations to support charitable activities that involve the potential return of capital within an established time frame”. However, the state of current standards, frameworks and tools is too confusing for most people.
Funders can take months or even years to define core metrics and program/beneficiary organizations. The main reason for this delay is that the impact context differs between program/beneficiary organizations and impact aggregators such as funders and international development agencies.
A few examples:
●Imagine that a foundation focusing on healthcare wants to fund a few good impact programs doing immunization in West India. After looking at the IRIS metrics, managers decide to use metric PI3902: Health Intervention Completion Rate to measure immunization completion, which is calculated dividing the number of patients completing treatment within the clinically recommended timeframe by the number of patients who started treatment and were expected to complete it (ref. presentation by Rick Jacobus, HomeKeeper). Then, this metric is given to the NGOs executing the immunization program.
Now, let’s suppose that one of the NGOs would also like to report other data to the foundation, such as cost and location of the immunization, since these factors have represented great challenges for them compared to other NGOs in the same program.
In this hypothetical case, the lack of a common context delays the selection of adequate metrics to capture the real impact.
●In a second example, international development agencies like FAO and WHO, charted to lead the SDG “Goal 2: End hunger, achieve food security and improved nutrition, and promote sustainable agriculture”. They are working in eastern Africa with numerous regional and national agencies to implement the goal.
Considering the SDG Goals are global, how can they address national, regional and local level indicators?
●In the last scenario, there are several collective impact organizations such as HomeKeeper for affordable housing, CoMetrics for food related social businesses, and Strive, a Cincinnati-based education example extensively discussed in an article published by Stanford Social Innovation Review.3
Either the target is to build competitive social businesses and programs, or disruptive initiatives for basic services like education; the challenge is to identify programs focusing on common goals and build conjointly agreeable metrics.
There are many sustainability reporting[LR1] standards available today. In fact, according to the Sustainability Disclosure Database and the Tri-State Sustainability Symposium, more than 10,000 organizations (firms and investment funds) are reporting to one or more standards currently. [SA2]
At the same time, many UN initiated agencies are using SDGs to fund billions of international development programs. And innovative community foundations, like Robin Hood Foundation and Tipping Point, have built internal metrics to measure outcomes from key programs that they support.
There are some catalogs and online services available, such as Global Value Exchange, which provide a decent aggregation of metrics.
Even with such systems, thousands of foundations, development agencies, businesses and nonprofits spend months just to pick metrics that meet their program goals. On the other hand, a big challenge lies in demonstrating collaborative impact even though similar organizations are reporting under different metrics.
Standards are used at the top of the pyramid
Most successful standards such as IRIS (commonly used for SGB and SBA reporting to investors), GRI, GRESB, CDP, and SASB (commonly used for sustainability reporting to investors and other stakeholders), are still being used at the top-of-pyramid level.
These metrics are designed to communicate relative performance of social businesses that attract impact fund investments. However, their current approach is often limited to self-reporting, resulting in data that does not provide aggregated impact evidence of the overall program.
Collective impact and impact evidence are key to revolutionize the social sector. To carry them out, we need a new generation of measurement approach with the following key ingredients:
●The possibility to build metrics from standards and goals, and adapt them to the program’s context.
●The ease to batch common metrics based on certain goal or type of program.
●The option to roll-up and roll-down goals without losing context.
●A compendium of the hundreds of already existing metrics; there is no need to reinvent them.
●An open API to build a collaborative metrics pool.
Also, if we want to encourage private capital to go into the social sector, we must demonstrate the success in programs like the ones mentioned above. To be successful, program agencies need to understand their performance against similar players and the best practices that others have adopted to achieve similar goals.
I believe that the highest efficiency in the social sector will only be accomplished when all the organizations start reporting with transparency on specific goals, and allow their data to be aggregated with other organizations’ in order to understand true collective impact.
- Report on US Sustainable, Responsible and Impact Investing Trends. (2014). Retrieved from http://www.ussif.org/Files/Publications/SIF_Trends_14.F.ES.pdf
- McCreless, M., Fonzi, C., Edens, G., & Lall, S. (2014, June 4). Metrics 3.0: A New Vision for Shared Metrics (SSIR). Retrieved from http://ssir.org/articles/entry/metrics_3.0_a_new_vision_for_shared_metrics
- Kania, J., & Kramer, M. (2011). Collective Impact (SSIR). Retrieved December 8, 2015, from http://ssir.org/articles/entry/collective_impact