Questionnaire Design for Mixed-Mode, Web and Mobile Web Surveys - online
Date:
25/03/2025 - 27/03/2025
Organised by:
NCRM, University of Southampton
Presenter:
Dr Pamela Campanelli
Level:
Intermediate (some prior knowledge)
Contact:
Jacqui Thorp
Training and Capacity Building Co-Ordinator, National Centre for Research Methods, University of Southampton
Email: jmh6@soton.ac.uk
Venue: Online
Description:
In this live online course, learn about questionnaire design in the context of different modes of data collection. Explore question wording issues, the questionnaire as a whole and visual concerns when moving from interviewer-administered to web survey, when creating a web survey in general and when facing the questionnaire design challenges in creating mobile-friendly web surveys. Mirroring in-person training this will be an interactive course and will also have breakout rooms sessions throughout.
The course covers:
- The push towards mixed mode, web and mobile web surveys
- Questionnaire design - Getting started, trade-offs, general guidelines, beware of certain question formats
- Question design solutions for comprehension issues - Appendix for memory and sensitivity issues
- Don't rely on survey templates
- Mixing modes of data collection, some overall mode differences, mode effects by question content and format
- From interview survey to web survey
- Web survey questionnaire requirements and options, web surveys can include … but should we?, importance of visual layout, unexpected issues with HTML formats
Questionnaires for mobile web surveys - earlier evidence, later findings, current thinking on making a questionnaire mobile-friendly
- Push to web
By the end of the course participants will:
- Have better knowledge about questionnaire-related mode differences and effects
- Have the skill to change an existing interviewer-administered questionnaire to a web survey
- Have the ability to create effective web survey questionnaires as well as mobile-friendly ones
- Have greater questionnaire design skills in general and the ability to critique existing survey templates
This course is for anyone involved in mixed-mode, web and/or mobile web surveys. Participants need familiarity with surveys and questionnaire design.
Desirable for participants to read:
https://web.stanford.edu/dept/communication/faculty/krosnick/docs/2009/2009_handbook_krosnick.pdf
https://www.gesis.org/fileadmin/admin/Dateikatalog/pdf/guidelines/mixed_device_mobile_web_surveys_beuthner_2021.pdf
This course is taught over three afternoons on 25-27 March from 12:30-17:00 and equates to two teaching days (for payment purposes).
Programme
DAY 1 (25 MARCH)
12.30-12.55 Introductions and course overview
12.55-13.10 The push towards mixed mode, web and mobile web surveys
13.10-13.30 Key principles of questionnaire design - Getting started, trade-offs, four cognitive stages, question wording guidelines
13.30-13.40 Break
13.40-14.40 Key principles (continued)
14.40-14.50 Break
14.50-14.55 Highlights of Appendix: Demographic questions are always the most difficult to write
14.55-15.15 Key principles (continued)
15.15-15.45 Workshop 1 - Critiquing a survey question
15.45-15.55 Break
15.55-16.10 Solutions to ambiguous terms
16.10-16.20 Issues with respondents' memories and question sensitivity
16.20-17.00 Workshop 2 - Writing a survey question
DAY 2 (26 MARCH)
12.30-12.50 Know the deeper issues with open and closed questions. Mini appendix on coding open questions
12.50-13.25 Problematic question formats to be aware of or avoid (satisfaction and agree/disagree). Mini appendix on other problematic formats (tick all that apply, ranking and hypothetical questions)
13.25-13.35 Break
13.35-13.55 Don't rely on survey templates
13.55-14.25 Workshop 3 - Critiquing web survey software templates
14.25-14.35 Break
14.35-14.40 Modes of data collection: Mixing modes
14.40-15.00 Modes of data collection: Overall mode difference (obvious ones)
15.00-15.15 Modes of data collection: Mode effects. Mini appendix on mode effects due to satisficing; measuring mode effects
15.15-15.25 Break
15.25-16.10 Workshop 4 - Interpreting data from a mixed mode experiment
16.10-17.00 The questionnaire as a whole - Interview survey versus web survey. Day Two Appendix - 8 question testing methods for web surveys
DAY 3 (27 MARCH)
12.30-13.00 The questionnaire as a whole - Web versus paper
13.00-13.15 The questionnaire as a whole - Web versus paper and interviewer-administered - the special things that web surveys can do, but should we?
13.15-13.25 The questionnaire as a whole -Face-to-face / Web / paper versus phone - visual versus not visual
13.25-13.35 Break
Mini appendix on paper self-completion
13.35-14.00 The questionnaire as a whole -Face-to-face / Web / paper versus phone - visual versus not visual (continued)
14.00-14.30 Workshop 5 - Visual layout
14.30-15.00 Web surveys for mobile phones - earlier evidence, current thinking
15.00-15.10 Break
Mini appendix - an issue with Google Forms
15.10-15.30 Mode of data collection difference - what should you do?
15.30-15.50 Push to web
15.50-16.00 Break
Mini appendix -more on push to web
16.00-16.20 Examples of question revisions based on testing results
16.20-17.00 Workshop 6 on revising survey questions. Mini appendix - Can mobile phones be used as an alternative method of data collection?
Cost:
The fee per teaching day is: £35 per day for students. £75 per day for staff at academic institutions, Research Councils researchers, public sector staff and staff at registered charity organisations and recognised research institutions. £250 per day for all other participants In the event of cancellation by the delegate a full refund of the course fee is available up to two weeks prior to the course. NO refunds are available after this date. If it is no longer possible to run a course due to circumstances beyond its control, NCRM reserves the right to cancel the course at its sole discretion at any time prior to the event. In this event every effort will be made to reschedule the course. If this is not possible or the new date is inconvenient a full refund of the course fee will be given. NCRM shall not be liable for any costs, losses or expenses that may be incurred as a result of its cancellation of a course, including but not limited to any travel or accommodation costs. The University of Southampton’s Online Store T&Cs also continue to apply.
Website and registration:
https://www.ncrm.ac.uk/training
Region:
South East
Keywords:
Survey and Questionnaire Design, Questionnaire design, Research Skills, Communication and Dissemination, Research Skills, Communication and Dissemination (other), Online questionnaire, Mode effects, Mobile-friendly, Mixed-mode surveys
Related publications and presentations:
Survey and Questionnaire Design
Questionnaire design
Research Skills, Communication and Dissemination
Research Skills, Communication and Dissemination (other)