SEPT 2018 UPDATE:I am excited to announce a new data service for the non-profit sector, Purpose Analytics, developed in partnership with Peter Halsall and incubated at the Canadian Urban Institute.

OCT 2020 UPDATE:We've left the nest! Purpose Analytics is now an independent non-profit organization commited to developing a data-informed public benefit sector. Find out what we're up to at www.purposeanalytics.ca.

The Problem

Community-based agencies have become good data collectors. Service providers register participants, record their personal information, track outcomes, and conduct surveys to help demonstrate impact. More often than not, funders specify which data are collected and require that they be compiled into reports or entered directly into online information management systems.

Apart from reporting, agencies struggle to utilize these data for their own purposes. A lack of time, skills, and inadequate information technology pose challenges to all but the largest agencies. As a result, the sector is unable to unlock information that could reveal trends, identify geographical patterns, and support decision-making. In short, agencies suffer from a net outflow of information.

About This Report

This report presents findings from an investigation into the feasibility of launching a mapping and data analytics service for community-based agencies. Between May and August 2015, 16 key informants offered perspectives on the state of data collection and utilization in the sector. Three service delivery models were also explored.

Findings

Key informants were asked about current data experiences and practices in the sector and the potential market demand for mapping and data analytics services. Resources aside, perceptual barriers appear to have a strong influence on data priorities.

Data Quality Concerns Should Be Explored More Deeply

Non-profits are skeptical about the quality of their data. Concerns about data accuracy, completeness, and comparability between agencies have not been quantified, but they were flagged as primary reasons why data are not utilized more widely. While data quality may impact some types of decision-making, there are valuable insights that can be gleaned from incomplete datasets, including a better understanding of the extent and severity of these issues.

Agency Needs Are Best Met Through Shared Approaches

Agencies are eager to use their data to tell unique stories and there is an impression that this requires independent and customized analysis. Yet, many agencies have identically structured data that are collected for a common funder. This lends itself to aggregation and analysis across combined datasets. A shared approach to data analysis could still provide individualized reporting for each agency, but yield broader, sector-wide insights and context.

Geographic Information Can Be Leveraged To Link Datasets

A common misconception is that meaningful insights cannot be achieved without additional personal information from service users such as ethnicity/race or household income. However, postal code data, which are commonly recorded through program registrations, offer an alternative. These can be linked by geography to other datasets, allowing powerful inferences to be made about population characteristics without further intrusion or data collection effort.

Service Delivery Models

The question "Where should this service live?" was also posed to key informants. Of the service delivery models outlined below, respondents were most eager to see a sector-led approach.

Independent Consultancy

Description: Either a sole proprietorship, private business, or non-profit corporation.

Examples: Powered by Data; OpenNorth.

Pros: Fastest to get off the ground; can be nimble; not tied to non-profit clientele such that private sector contracts could subsidize non-profit work; limited competition in the marketplace.

Cons: Does not directly build sector capacity; has the most operational overhead which, in turn, could drive higher fees; ineligible for most funding opportunities on its own; slowest growth trajectory with no profile or reputation to build on; risk is borne entirely by consultancy.

University Centre

Description: Hosted by a research institution as a conduit for growing academic-community relationships.

Examples: Syracuse Community Geography, Chicago State University's Neighborhood Assistance Center.

Pros: Built-in access to academics and student researchers; lowest overhead costs especially regarding access to software and proprietary data; delivers on institutional community engagement and social innovation goals; risk is shared between institution and non-profit sector.

Cons: Weak tradition of academic-community partnerships in Toronto; limited academic interest in community-based data.

Sector-led Enterprise

Description: Incorporated into an existing community-based agency; especially suited to a member-based organization or an agency that is already aggregating data.

Examples: Canadian Council on Social Development; Data Driven Detroit.

Pros: Embedded in sector; could add value to existing shared platforms; potential revenue generator as a social enterprise.

Cons: Limited expertise within the sector to get this off the ground; few candidate agencies that could take this on, although respondents expressed strong enthusiasm for a social planning council to assume this role.

The Opportunity

While key informants agreed that mapping and data analytics services will eventually be important for the sector, the market readiness for these services – especially for a private enterprise – appears to be underdeveloped.

Furthermore, it is clear that a collective effort will be required to build and sustain the research and analysis infrastructure that is needed for the sector to start benefiting from data-driven insights and decision-making. Much like the collaboration and integration that has taken place around facilities and services, the sector will realize benefits from an aggregated approach to data collection and analysis.

Currently, the conversation around data analytics in the non-profit sector is starting to mature. The Mowat Centre recently released a white paper on open data and the Ontario Nonprofit Network has begun work on framing a data strategy for the sector. While these projects represent a strong starting point for articulating a shared approach, several initiatives that are already underway offer inspiration and possible avenues for implementation.

Where Work Has Already Begun

The City of Toronto's Social Policy, Analysis and Research department has been delivering research and analysis services through its ongoing work with city departments, other levels of government, university researchers, and non-profit agencies, Numerous mapping and data requests from community-based organizations are currently being filled by this department. Furthermore, their online, map visualization tool, Wellbeing Toronto, provides self-service access to a wide range of neighbourhood-level health indicators.


Reconnect Mental Health Services is two years into a data aggregation initiative for 100+ community-based health service providers through funding from the Toronto Central LHIN. Leadership from the funder helped to accelerate agency engagement more rapidly than would otherwise have been achieved through a voluntary process. The project has demonstrated that data aggregation can be accomplished without a unified data management system.


Colour of Poverty - Colour of Change is piloting a standardized data collection format that will provide disaggregated data on ethno-racial characteristics of community service users.


The Parkdale Community Economic Development project is developing a set of indicators to help monitor neighbourhood change. They are actively exploring how shared administrative and program data between agencies can inform this work.


OCASI has 30 agencies across Canada subscribing to its client management system, a software as a service solution. Data analytics services would add value to this shared platform.


Findhelp Information Services has assembled a substantial database of programs and referral records through its 211 service. These records taken together with agency program data would provide unique insight into the geographic supply and demand for community services in Toronto.

Acknowledgements

Special thanks to the individuals and organizations that provided many rich discussions and opened up additional avenues of investigation. Due to time constraints, the number of interviews conducted was limited to the organizations below. This report is therefore a reflection of the opinions expressed by this group and the author and not necessarily representative of the sector as a whole.
Colour of Poverty - Colour of Change
Chicago State University Neighborhood Assistance Center
Family Service Toronto
The Mowat Centre
Neighbourhood Change Research Partnership, Factor-Inwentash Faculty of Social Work, University of Toronto
OCASI
Ontario Nonprofit Network
Parkdale Activity Recreation Centre
Powered By Data
Reconnect Mental Health Services
Social Innovation and Entrepreneurship, School of Child & Youth Care, Faculty of Community Services, Ryerson University
Social Policy Analysis and Research, City of Toronto
St. Stephen's Community House
United Way Toronto and York Region
West Neighbourhood House
Woodgreen Community Services