10 Steps to Make Sense of Answers to Open-Ended Questions
Two-page tip sheet on how to code and analyse qualitative data.
Two-page tip sheet on how to code and analyse qualitative data.
Results from the 2019 (pre-COVID) survey of Australians attitudes to the arts. The 2019 survey was translated into community languages for the first time: Arabic, Dinka, Mandarin, Spanish, Urdu and Vietnamese.
The research found that the targeted CALD respondents were more likely to attend arts events than Australians overall, and 42% would like to attend more arts than they currently do. CALD respondents are also nearly three times more likely to give to the arts than non-CALD respondents.
Part of the Audience Research Toolkit, developed for arts organisations in Victoria, Australia, this guide outlines how to translate research findings into action. Includes an Action Your Results Template and guidance on running a group session on actioning the research findings.
A warning on the dangers of evaluation in a cross-cultural context and encouragement to:
* Acknowledge the complexity of cultural identity
* Recognise the dynamics of power
* Recognise and eliminate bias in language
* Employ culturally appropriate methods
‘Evaluations cannot be culture free. Those who engage in evaluation do so from perspectives that reflect their values, their ways of viewing the world, and their culture.'
Advice on the basics of analysing research data, including analysing qualitative and quantitative data, interpreting and reporting the results.
An excellent resource developed for arts organisations in Victoria, Australia, by Creative Victoria. The toolkit offers guidance, templates and sample questions for conducting audience research in a variety of formats, as well as guidance on analysing the actioning the results. Also includes a project planner for getting started.
Australian Privacy Principles outline legal obligations when dealing with personal information. A higher standard is applied to 'sensitive information' which includes a person's racial or ethnic origin.
Aimed at healthcare professionals, these guidelines offer advice on briefing a survey translator.
'During the translation process, translators may identify terms or concepts that are difficult to translate because they do not have the same or similar meaning in the target language as they do in English. This will lead to discussions about the goal or intent of the English-language item. Such discussions are integral to the production of a quality translation.'
Free digital designs of black people to use in online projects, such as websites, infographics or mobile apps. Over 40 images of people with different skin tones in workplace and medical settings, downloadable as PNG, JPG and Sketch and fully scalable.
UK research by Black-led British theatre Eclipse blows away any lingering assumptions that Black artists do not attract a mainstream audience. A three-month tour of Black Men Walking, a play created through a three-year project with 16 Black writers, sold out 71 of its 84 performances, with 428 or 512 respondents rating the show as four or five starts. And only 21.4% of the audience identified as Black.
A blog series for the 'Cultural Heritage and Identities of Europe's Future' project addressing challenges in minorities’ rights and cultural diversity. Particular focus on youth radicalisation, questioning of the European project, the revival of tribal identities / separatism, education and policy.
A short article on the ‘Data, Diversity and Inequality in the Creative Industries’ project that explored data and patterns of diversity and inequality within the UK creative industries. Case studies feature The National Theatre Archive, Arts Council England, Digital Creativity Labs and BBC R&D.
A paper introducing inclusive cultural tactics that expose and amplify some of the complexities of culture in order to dissect challenging social problems. Including US case studies, it shows how cultural tactics can act as leverage points for social justice.
Diversity Arts’ Executive Director Lena Nahlous and Creatives of Colour’s Rani Pramesti discuss innovative forms of research in the arts, especially in relation to diverse audiences.
"We're beginning to get a grip on the influence of this work and its impact and it's harder to measure than more traditional means of research, but that doesn't mean that it's not measurable, because it is." - Lena Nahlous
A sample survey developed by Culture Counts for assessing the impact of a work of art on an audience. Includes Likert-style 'dimension' questions on Captivation, Challenge, Distinctiveness, Connection, Meaning, Relevance, Rigour, Risk and Local Impact. These areas can be tailored according to the strategic priorities on the organisation.
A guide for intercultural researchers which provides guidelines for conducting of multinational, multicultural, or multiregional surveys. This extensive site brings together leading practice in survey methodology and in cross-cultural research. Includes case studies and recommendations.
Guidelines for ethical research in Australia and New Zealand.
A toolkit featuring interviews, case studies and activities to introduce "Horizontal Development," a new American urban development approach that centres the margins, highlights diversity, celebrates place and is accountable to those impacted by the racist and classist policies by cities.
Article on collaborations in the arts that have increased profits, expanded audiences and help marketing.
For example, the Saint Louis Symphony Orchestra developed a partnership with local African American churches. It 'is located in an African American neighborhood, but area residents had criticized the orchestra for being aloof from its community. The partnership has created not just better community feelings but also an enthusiastic new audience segment for the orchestra.'
The Inclusiveness Index identifies and captures the degree of group-based inclusion and marginality experienced across the world. Focusing on policy, laws, and institutions, it holistically examines group experience across gender, race/ethnicity, religion, disability, and sexual orientation dimensions. Features datasets, resources and reports.
UK-based independent professional membership association for practising translators, interpreters and language service providers. Offers an online search for translators.
A guide to a participatory approach that links movement building with narrative power analysis towards social change storytelling. Features story elements; breaking-down power for goals, audiences, targets and constituencies; understanding your audience; points of intervention; action logic; cracks and cross-checking.
Case studies, resources and response rates for various creative evaluation tools set up at the Curiosity Carnival, a festival of public engagement with research at venues throughout Oxford University. Includes a graffiti wall, rating cards, audience participation exercise, feedback postcards, text/email feedback, observation, facilitated rating questions and love hearts.
'For short one-off engagement activities, evaluation tools can be light-touch, designed to feel part of the activity.'
A two-part report that aims to reform the way people talk about race and racism in the USA. Outlines impediments to productive racial discourse, lessons from barrier-breaking interventions, considerations for selecting spokespersons and recommendations for framing expertise, skills-building and collaboration.
Information on Survey Monkey's multilingual survey feature, with a 3:20 minute video overview.
The National Accreditation Authority for Translators and Interpreters Ltd (NAATI) provides a searchable online database of all accredited translators and interpreters in Australia, including over 15,000 practitioners in more than 170 languages.
Australian guide to gather data through observation in an educational context.
"The key to using observational data as evidence in an evaluation is to take a systematic and consistent approach as you collect, organise and analyse what is observed."
The Tate has published reviews of its collection by Black, Asian and Minority Ethnic staff, offering insight into the artwork that goes beyond the white gaze.
"Brunias shows the lighter the skin, the freer you are. Darker skinned women of colour are still disproportionately affected by this today."
"In the painting, Europeans are the only ones seated on furniture."
A report for the ‘Equity Indices Research Project’ highlighting that existing metrics such as GDP do not address equity concerns. Offers context, a ‘belonging lens,’ equity indices case studies, and best practices towards a meta-index aligned with the Capabilities Approach to Human Development.
Part of the Audience Research Toolkit developed for arts organisations in Victoria, Australia, this guide outlines key issues to consider when sharing research findings, including:
* When to share externally
* Key groups of people to share your results with
* Methods of sharing
Article on Diversity Arts Australia's 'arts as advocacy' model of research which facilitates creative, open-ended responses and focuses on creating a supportive environment for deep reflection.
“This research and advocacy approach is about shifting culture, not just imposing targets. I’m a big believer in imposing targets, but that’s not going to shift systemic racism. At the end of the day, targets are a response that retrofits a system that doesn’t accommodate us.” ~ Lena Nahlous
Blog post on how to achieve 'strategic alignment' to ensure the outcomes you're measuring align with your goals. Starting from your mission statement you can extract key 'dimension statements' that you can use in audience surveys.
A handout on US-based DS4SI’s “5 S methodology,” signifying Structure, System, Scale, Symbol and Sensation. It is shared as a first step towards designing effective social interventions by exploring and understanding the social, cultural and political terrain before beginning justice work.
Coding qualitative data involves tagging responses with a set of codes which summarise their content, so that statements and responses can be quantified, and thus measured. This article runs through different methods and approaches to coding, including deductive coding, inductive coding, initial coding, line-by-line coding, characterisation and determining themes.
Summary article and link to research on the effectiveness of the British Film Industry Diversity Standards, launched in 2016, which require funded productions to meet diversity criteria, by Dr Clive Nwonka, from the London School of Economics and Political Science.
'Britain’s black and ethnic minority population remain excluded from key areas of the industry, with BAME representation still mostly located in secondary roles rather than as lead characters or in key production roles.'
Advice on how to choose among different types of graphics and charts when presenting evaluation data.
'Graphics can also tell a story, showing proportions, comparisons, trends, geographic and technical data and, in the case of photographs, putting a “human face” on a project.'
A modular toolkit for designing, strategising for and evaluating impact in social change. Designed for documentary or journalist video-makers, and nonprofit organisations that want to / are using video to engage their communities. Focuses on short form video, specifically for low budgets.
Toolkit for designing and carrying out audience surveys at live events, including a survey template, script samples and tips on capturing reliable and high-quality data.
'We've worked with funders and consultants to design scientifically-valid survey methods. We've agonized about how to ask sensitive questions about race or class to perfect strangers. And we've struggled to capture data with staff and volunteers-none of whom are professional researchers or data analysts.'