Evaluation Resources

BYP Group is the Social Impact Evaluation Partner for Creative Victoria’s Social Impact, Diversity and Inclusion Programs, 2018-2020. Over the next two years, we will be working with a range of arts, cultural and community organisations to develop their capacity to evaluate their social impact.

We are delivering an evaluation capacity-building workshop series for Victorian creative industry organisations and practitioners.

As part of this work, we will be creating and sharing on this website a range of workshop presentations, tools, templates and resources for anyone wanting to monitoring and evaluate their social impact. We encourage you to review, adapt and share these resources, and your insights about what works.

For information on how to apply for the Evaluation Exchange, please visit Creative Victoria.

 
 

GUIDE

THE BASICS OF SOCIAL IMPACT EVALUATION

This guide gathers key approaches to evaluation of social impact. It covers topics including:

  • What is social impact?

  • How do you measure the social impact of creative industry interventions?

  • Methods for developing an M&E framework

  • Examples of indicator frameworks

  • Tools for collecting data

Who is it for? Creative industry, arts and cultural professionals looking for an introduction to social impact evaluation.

 

PRESENTATION

THEORY OF CHANGE AND MONITORING & EVALUATION FRAMEWORKS

This is the presentation from the first workshop in the Creative Victoria + BYP Group Evaluation Exchange Workshops, held at State Library of Victoria. The presentation covers:

  • What is ‘theory of change’?

  • How do I translate a theory of change into measurable outcomes?

  • What are the key elements in a monitoring & evaluation (M&E) framework?

  • How do I design an M&E framework for social impact?

Who is it for? Anyone wanting to learn more about Theory of Change methodology and how to translate a Theory of Change into a monitoring and evaluation framework.

 

TEMPLATE

MONITORING & EVALUATION FRAMEWORK

This spreadsheet is a useful practical template for a social impact M&E framework. It includes:

  • Evaluation template for reporting on the outputs of a program

  • Evaluation templates for identifying the impacts of a program on participants, audiences and communities

  • Evaluation template for reviewing the implementation process and the environmental context affecting a program

Who is it for? Anyone looking for practical tools for designing an evaluation framework.

 

PRESENTATION

INTRODUCTION TO QUALITATIVE AND QUANTITATIVE DATA METHODS

This is the presentation from the second workshop in the Creative Victoria + BYP Group Evaluation Exchange Workshops, held at State Library of Victoria for Victorian creative industry organisations and practitioners. The presentation covers:

  • What is the difference between qualitative and quantitative data methods?

  • When do I use qualitative and when do I use quantitative data?

  • How do I design a survey?

  • How do I write questions to avoid bias?

Who is it for? Anyone wanting to learn more about the basics of qualitative and quantitative data collection.

 

template

PARTICIPANT, COMMUNITY & AUDIENCE SURVEYS

This spreadsheet includes sample participant, community and audience surveys for before and after participation in projects, events or activities. It also contains a very useful list of hundreds of questions drawn from validated survey tools as examples of the kinds of questions you can ask.

Who is it for? Creative practitioners and arts organisations wanting to design surveys to understand the impact of their programs on participants, audiences and communities.

 

presentation

QUALITATIVE DATA

This is the presentation from the third workshop in the Creative Victoria + BYP Group Evaluation Exchange Workshops, held at State Library of Victoria for Victorian creative industry organisations and practitioners. The presentation covers:

  • What are some of the main methods of collecting qualitative data?

  • Are there arts-based methods of collecting qualitative findings?

  • How do I draw robust and meaningful conclusions from qualitative data?

Who is it for? Creative practitioners and arts organisations wanting to conduct robust qualitative research and draw meaningful conclusions from qualitative data.

 

EXAMPLES

QUALITATIVE DATA COLLECTION & ANALYSIS TOOLS

Here are links to a range of useful examples of how we collect and analyse qualitative data. If you use any of these, we ask you to attribute the creators.

Observation Form

This is a simple example of a form you can train observers to fill out about what they are observing. We used this form in our evaluation of Play Me, I’m Yours.

BEFORE AND AFTER REFLECTION

This is a visual exercise we often use with young people or where literacy may be varied.

Star Selfie - Digital O - 261018.jpg

Star Selfie

This is a tool designed by Big hArt, an Australian arts and social justice company, and used with young people at different stages of a project.

 

Here are additional tools including interview guides, permission forms, and qualitative data analysis templates.

Interview Guide - Example

Interview Summary Notes - Template

Interviews - Spreadsheet for Analysis - Template

Before and After Reflection Tool - Spreadsheet for Analysis - Template

Permission Form - Template

PRESENTATION

REPORTING AND COMMUNICATING EVALUATION RESULTS

This is the presentation from the fourth workshop in the Creative Victoria + BYP Group Evaluation Exchange Workshops, held at State Library of Victoria for Victorian creative industry organisations and practitioners. The presentation covers:

  • How to write an evaluation report

  • Ethical considerations in reporting

  • Ideas for using your findings beyond the report

  • How to create a dissemination plan

Who is it for? Anyone wanting to learn more about the basics of evaluation reporting and using your findings.

 

TEMPLATE

DISSEMINATION PLANNING

DISSEMINATION PLAN TEMPLATE

This is a simple template you can use to help you decide what dissemination materials e.g. video, presentation, fact sheets etc. will be most useful for telling people about your results.