Envisaging impact
In 2020, NCRM was funded by the ESRC, to provide training and capacity building (TCB) to academic and non-academic, social science researchers in the UK.
NCRM set out to provide evidence on how its TCB activities were making a difference to those participating in these activities, to the research methods ecosystem, and to society in general.
We developed a theory of change which hypothesised that our TCB activities would generate 11 different core impacts; and we planned how we would gather, collate and analyse data that would provide evidence that we were generating these impacts. These hypotheses are outlined below.
In 2024 we collated and analysed these data and wrote an Impact Assessment Report. The report provides a description of how NCRM has achieved all its hypothesised impacts since it began work in 2020.
NCRM’s impact hypotheses
1: Advancing knowledge and skills
Hypothesis: Participants’ engagement with NCRM training and resources will result in a change in their knowledge and skills, thus advancing their methodological literacy and practice.
How we will evidence this impact:
- Analysis of de-identified course and event registration data
- Analysis of course and event evaluation questionnaires
- Analysis of social media posts relating to NCRM events, activities and resources
- User Follow Up Surveys
- Case studies
- Submissions to NCRM Impact Prizes
2: Applying new learning and skills
Hypothesis: Participants who have engaged with NCRM training and resources will apply their new learning and skills to their research and/or teaching.
How we will evidence this impact:
- Evaluation questionnaires
- Analysis of social media posts relating to NCRM events, activities and resources
- User Follow Up Surveys
- Case studies
- Submissions to NCRM Impact Prizes
3: Developing networks and collaborations
Hypothesis: Some participants who engage with NCRM training and resources will develop networks and collaborations during and after taking part.
How we will evidence this impact:
- User Follow Up Surveys
- Case studies
- Submissions to NCRM Impact Prizes
- Interviews and focus groups
4: Developing new methods
Hypothesis: NCRM will enable the development of new, imaginative and innovative methods, and the sharing of knowledge and best practice in these methods, within (and beyond) the social sciences.
How we will evidence this impact:
- Innovation Fora reports
- Analysis of social media posts relating to NCRM events, activities and resources
- Impact reports written by researchers running events
- Case studies
- Submissions to NCRM Impact Prizes
- Interviews and focus groups
5: Networks and communities of practice
Hypothesis: NCRM knowledge exchange events will enable the development of networks and communities of practice.
How we will evidence this impact:
- User Follow Up Surveys
- Case studies
- Submissions to NCRM Impact Prizes
- Interviews and focus groups
6: Multiplier capacity building
Hypothesis: Some NCRM beneficiaries will engage in multiplier capacity building - sharing and cascading knowledge to peers, colleagues and others.
How we will evidence this impact:
- User Follow Up Surveys
- Case studies
- Submissions to NCRM Impact Prizes
- Interviews and focus groups
7: Gaining new job roles or changing roles
Hypothesis: Some NCRM beneficiaries may go on to gain or change their jobs, or their job roles.
How we will evidence this impact:
- User Follow Up Surveys
- Case studies
- Submissions to NCRM Impact Prizes
- Interviews and focus groups
8: Beneficiaries achieve Economic, societal, policy and cultural impact
Hypothesis: Some NCRM beneficiaries will apply their new or improved skills in research that goes on to provide economic, societal, policy and cultural benefits.
How we will evidence this impact:
- User Follow Up Surveys
- Case studies
- Submissions to NCRM Impact Prizes
- Interviews and focus groups
9: NCRM participants achieve economic, societal, policy and cultural impact
Hypothesis: Some of those who have undertaken NCRM research on methods, and then applied these methods to research, will go on to provide economic, societal, policy and cultural benefits.
How we will evidence this impact:
- NCRM 20th Anniversary Impact Prize submissions
- Case studies
10: NCRM's interconnectedness makes the centre more than the sum of its parts
Hypothesis: The interconnectedness of NCRM’s workstreams will make NCRM more than the sum of its parts as an infrastructure organisation.
How we will evidence this impact:
- Interviews and focus groups
- Case studies
- Submissions to NCRM Impact Prizes
11: Benefiting the research methods landscape
Hypothesis: NCRM will continue to develop into more than the sum of its parts enabling it to benefit the research methods landscape.
How we will evidence this impact:
- Interviews and focus groups
- Case studies
- Submissions to NCRM Impact Prizes