Questionnaire Design for Mixed-Mode, Web and Mobile Web Surveys - online

Description:

In this live online course, learn about questionnaire design in the context of different modes of data collection. Explore question wording issues, the questionnaire as a whole and visual concerns when moving from interviewer-administered to web survey, when creating a web survey in general and when facing the questionnaire design challenges in creating mobile-friendly web surveys. Mirroring in-person training this will be an interactive course and will also have breakout rooms sessions throughout.

The course covers: 

• The push towards mixed mode, web and mobile web surveys
• Questionnaire design - Getting started, trade-offs, general guidelines, beware of certain question formats
• Question design solutions for comprehension issues - Appendix for memory and sensitivity issues
• Don't rely on survey templates
• Mixing modes of data collection, some overall mode differences, mode effects by question content and format
• From interview survey to web survey
• Web survey questionnaire requirements and options, web surveys can include … but should we?, importance of visual layout, unexpected issues with HTML formats

• Questionnaires for mobile web surveys - earlier evidence, later findings, current thinking on making a questionnaire mobile-friendly

• Push to web

By the end of the course participants will:

• Have better knowledge about questionnaire-related mode differences and effects
• Have the skill to change an existing interviewer-administered questionnaire to a web survey
• Have the ability to create effective web survey questionnaires as well as mobile-friendly ones
• Have greater questionnaire design skills in general and the ability to critique existing survey templates

This course is for anyone involved in mixed-mode, web and/or mobile web surveys. Participants need familiarity with surveys and questionnaire design.

Desirable for participants to read:

https://web.stanford.edu/dept/communication/faculty/krosnick/docs/2009/2009_handbook_krosnick.pdf

https://www.gesis.org/fileadmin/admin/Dateikatalog/pdf/guidelines/mixed_device_mobile_web_surveys_beuthner_2021.pdf

This course is taught over three afternoons on 25-27 March from 12:30-17:00 and equates to two teaching days (for payment purposes).

 

Programme

DAY 1 (25 MARCH)

12.30-12.55  Introductions and course overview

12.55-13.10  The push towards mixed mode, web and mobile web surveys 

13.10-13.30  Key principles of questionnaire design - Getting started, trade-offs, four cognitive stages, question wording guidelines

13.30-13.40  Break

13.40-14.40  Key principles (continued)

14.40-14.50  Break

14.50-14.55  Highlights of Appendix: Demographic questions are always the most difficult to write

14.55-15.15  Key principles (continued)

15.15-15.45  Workshop 1 - Critiquing a survey question

15.45-15.55  Break

15.55-16.10    Solutions to ambiguous terms

16.10-16.20    Issues with respondents' memories and question sensitivity

16.20-17.00  Workshop 2 - Writing a survey question

DAY 2 (26 MARCH)

12.30-12.50  Know the deeper issues with open and closed questions. Mini appendix on coding open questions

12.50-13.25  Problematic question formats to be aware of or avoid (satisfaction and agree/disagree). Mini appendix on other problematic formats (tick all that apply, ranking and hypothetical questions)

13.25-13.35  Break

13.35-13.55  Don't rely on survey templates

13.55-14.25  Workshop 3 - Critiquing web survey software templates

14.25-14.35  Break

14.35-14.40  Modes of data collection: Mixing modes

14.40-15.00  Modes of data collection: Overall mode difference (obvious ones)

15.00-15.15    Modes of data collection: Mode effects. Mini appendix on mode effects due to satisficing; measuring mode effects

15.15-15.25  Break

15.25-16.10  Workshop 4 - Interpreting data from a mixed mode experiment

16.10-17.00  The questionnaire as a whole - Interview survey versus web survey. Day Two Appendix - 8 question testing methods for web surveys

DAY 3 (27 MARCH)

12.30-13.00  The questionnaire as a whole - Web versus paper

13.00-13.15   The questionnaire as a whole - Web versus paper and interviewer-administered - the special things that web surveys can do, but should we?

13.15-13.25   The questionnaire as a whole -Face-to-face / Web / paper versus phone - visual versus not visual 

13.25-13.35  Break

                      Mini appendix on paper self-completion 

13.35-14.00  The questionnaire as a whole -Face-to-face / Web / paper versus phone - visual versus not visual (continued)

14.00-14.30  Workshop 5 - Visual layout

14.30-15.00  Web surveys for mobile phones - earlier evidence, current thinking 

15.00-15.10  Break

                      Mini appendix - an issue with Google Forms

15.10-15.30  Mode of data collection difference - what should you do?

15.30-15.50  Push to web

15.50-16.00  Break

                       Mini appendix -more on push to web

16.00-16.20  Examples of question revisions based on testing results

16.20-17.00  Workshop 6 on revising survey questions.  Mini appendix - Can mobile phones be used as an alternative method of data collection?

 

Cost:

The fee per teaching day is: £35 per day for students / £75 per day for staff at academic institutions, Research Councils researchers, public sector staff and staff at registered charity organisations and recognised research institutions / £250 per day for all other participants.

In the event of cancellation by the delegate a full refund of the course fee is available up to two weeks prior to the course. NO refunds are available after this date. If it is no longer possible to run a course due to circumstances beyond its control, NCRM reserves the right to cancel the course at its sole discretion at any time prior to the event. In this event every effort will be made to reschedule the course. If this is not possible or the new date is inconvenient a full refund of the course fee will be given. NCRM shall not be liable for any costs, losses or expenses that may be incurred as a result of its cancellation of a course, including but not limited to any travel or accommodation costs. The University of Southampton’s Online Store T&Cs also continue to apply.

Website and registration:

Register for this course

Region:

South East

Keywords:

Survey and Questionnaire Design, Questionnaire design, Research Skills, Communication and Dissemination, Research Skills, Communication and Dissemination (other), Online questionnaire, Mode effects, Mobile-friendly, Mixed-mode surveys

Related publications and presentations from our eprints archive:

Survey and Questionnaire Design
Questionnaire design
Research Skills, Communication and Dissemination
Research Skills, Communication and Dissemination (other)

Back to the training database