QUALTRICS 101 - 8/10 - TESTING YOUR SURVEY

This is a transcript of this video. Please consider this page as a work in progress. My intention is to update this with updated screenshots, to reflect the newer interface, and add some more relevant information. If you have suggestions, please let me know.

Video 8 – Testing Your Survey

Summary of Topics Covered:

• Previewing and testing your survey

• Sharing your survey with colleagues for review

• Adjusting survey options for testing

• Using the preview link

• Generating test responses

Script:

Welcome to the eighth video! In this video, I’ll show you how to preview and test your survey to check for errors. I’ll also demonstrate how to share your survey with colleagues so they can review and test it as well.

Before setting up testing, go into Survey Options and turn on a few features to make testing easier. For example, enable the back button so testers can go back and change their answers. However, note that the back button might not work well with branches. Also, turn on question numbers for testing purposes. This helps testers identify specific questions if there are issues. Save your changes.

To share your survey with colleagues, go to Tools and select Collaborate. Enter an email address, such as your boss or colleague, and they will receive an email to add the survey to their Qualtrics library. You can share the survey with anyone who has a Qualtrics account, even outside your organization.

Next, use the preview link to test the survey. The preview shows the question numbers, making it easier to track down issues in long surveys. For example, if a tester identifies a problem with the “Gender” question, the question number helps you locate it quickly.

Run through the survey to ensure everything works as expected. If a respondent does not consent, they should be redirected out of the survey. If they do consent, they should proceed to the next questions. Test different scenarios to catch any logic errors. For example, test the numeric validation for the age question and ensure that exclusive answers work as intended.

If a respondent is a non-gambler, they shouldn’t see the PGSI or help-seeking questions. If these questions appear, revisit the logic settings. Check both display logic and survey flow to ensure the conditions are set correctly. For example, ensure the PGSI block is only shown to gamblers by setting a branch condition based on the “Gambler” embedded data variable.

Previewing the survey repeatedly can be tedious, especially for long surveys. A handy feature in Qualtrics is generating test responses. This tool simulates random responses to test all possible branches and logic conditions. Go to Tools, select Review, and choose Generate Test Responses. Run a set number of test responses (e.g., 1000) to see if the survey logic works as expected.

After generating test responses, review the data to ensure the logic paths function correctly. For example, check that respondents who did not consent were not asked further questions and that non-gamblers were not shown gambling-related questions.

In the next video, I’ll show you how to get your survey ready for launch. We’ll cover finding your survey link and distributing it to participants. See you in the next video!