BYP Group is the Social Impact Evaluation Partner for Creative Victoria’s Social Impact, Diversity and Inclusion Programs, 2018-2020. Over the next two years, we will be working with a range of arts, cultural and community organisations to develop their capacity to evaluate their social impact.
We are delivering an evaluation capacity-building workshop series for Victorian creative industry organisations and practitioners.
As part of this work, we will be creating and sharing on this website a range of workshop presentations, tools, templates and resources for anyone wanting to monitoring and evaluate their social impact. We encourage you to review, adapt and share these resources, and your insights about what works.
For information on how to apply for the Evaluation Exchange, please visit Creative Victoria.
THE BASICS OF SOCIAL IMPACT EVALUATION
This guide gathers key approaches to evaluation of social impact. It covers topics including:
What is social impact?
How do you measure the social impact of creative industry interventions?
Methods for developing an M&E framework
Examples of indicator frameworks
Tools for collecting data
Who is it for? Creative industry, arts and cultural professionals looking for an introduction to social impact evaluation.
THEORY OF CHANGE AND MONITORING & EVALUATION FRAMEWORKS
This is the presentation from the first workshop in the Creative Victoria + BYP Group Evaluation Exchange Workshops, held at State Library of Victoria. The presentation covers:
What is ‘theory of change’?
How do I translate a theory of change into measurable outcomes?
What are the key elements in a monitoring & evaluation (M&E) framework?
How do I design an M&E framework for social impact?
Who is it for? Anyone wanting to learn more about Theory of Change methodology and how to translate a Theory of Change into a monitoring and evaluation framework.
MONITORING & EVALUATION FRAMEWORK
This spreadsheet is a useful practical template for a social impact M&E framework. It includes:
Evaluation template for reporting on the outputs of a program
Evaluation templates for identifying the impacts of a program on participants, audiences and communities
Evaluation template for reviewing the implementation process and the environmental context affecting a program
Who is it for? Anyone looking for practical tools for designing an evaluation framework.
INTRODUCTION TO QUALITATIVE AND QUANTITATIVE DATA METHODS
This is the presentation from the second workshop in the Creative Victoria + BYP Group Evaluation Exchange Workshops, held at State Library of Victoria for Victorian creative industry organisations and practitioners. The presentation covers:
What is the difference between qualitative and quantitative data methods?
When do I use qualitative and when do I use quantitative data?
How do I design a survey?
How do I write questions to avoid bias?
Who is it for? Anyone wanting to learn more about the basics of qualitative and quantitative data collection.
PARTICIPANT, COMMUNITY & AUDIENCE SURVEYS
This spreadsheet includes sample participant, community and audience surveys for before and after participation in projects, events or activities. It also contains a very useful list of hundreds of questions drawn from validated survey tools as examples of the kinds of questions you can ask.
Who is it for? Creative practitioners and arts organisations wanting to design surveys to understand the impact of their programs on participants, audiences and communities.
This is the presentation from the third workshop in the Creative Victoria + BYP Group Evaluation Exchange Workshops, held at State Library of Victoria for Victorian creative industry organisations and practitioners. The presentation covers:
What are some of the main methods of collecting qualitative data?
Are there arts-based methods of collecting qualitative findings?
How do I draw robust and meaningful conclusions from qualitative data?
Who is it for? Creative practitioners and arts organisations wanting to conduct robust qualitative research and draw meaningful conclusions from qualitative data.
QUALITATIVE DATA COLLECTION & ANALYSIS TOOLS
Here are links to a range of useful examples of how we collect and analyse qualitative data. If you use any of these, we ask you to attribute the creators.
This is a simple example of a form you can train observers to fill out about what they are observing. We used this form in our evaluation of Play Me, I’m Yours.
This is a visual exercise we often use with young people or where literacy may be varied.
Here are additional tools including interview guides, permission forms, and qualitative data analysis templates.