QUALTRICS 101 - 5/10 - SCALES AND SCORING

This is a transcript of this video. Please consider this page as a work in progress. My intention is to update this with updated screenshots, to reflect the newer interface, and add some more relevant information. If you have suggestions, please let me know.

Summary of Topics Covered:

• Introduction to scoring scales within surveys

• Recoding scale values for data analysis

• Scoring the Problem Gambling Severity Index (PGSI)

• Using scores to give feedback and control question flow

Script:

Welcome to the fifth video! In this video, I’ll outline some things you can do with scales in a survey. This includes recoding the scale within the survey so that the data are how you want them and scoring a scale within a survey. This can then be used in numerous ways, such as giving people feedback based on their scores or only showing certain questions to people if they meet a certain criterion based on that scale.

We’ll be using the Problem Gambling Severity Index (PGSI) as an example. The PGSI includes nine questions, each with four response options: never, sometimes, most of the time, and almost always. This scale is commonly used in gambling research to determine how at risk someone is of experiencing gambling-related problems. Although our lab has developed better scales, we continue to use the PGSI because it’s widely recognized.

To program this in, create a new block called “PGSI”. The question will be a matrix table, similar to the gambling frequency question. Select “Matrix Table” and choose the single answer matrix table type. Enter or copy your text into the question. If formatting issues arise when copying text, you can manually adjust it using the Rich Content Editor.

Paste the nine PGSI questions into the matrix table. Enter the response options: never, sometimes, most of the time, and almost always. Ensure forced response is enabled so participants must answer every question, which is crucial for scales.

Matrix tables can become cluttered, so consider adding whitespace or repeating headers to improve readability. You can repeat headers in the middle or at the bottom of the table.

Rename the question variable to “PGSI” for easier analysis. Then, go to “Recode Values”. The PGSI is scored 0, 1, 2, and 3, not 1, 2, 3, and 4. Adjust the recoding accordingly.

Next, use the scoring feature. Click on “Scoring” to open a new screen. Use auto-scoring to assign scores to each response option. Ensure the scores match the PGSI’s 0, 1, 2, and 3 scoring system. This scoring will be reflected in the data set, making it easier to analyze later.

Once the PGSI is set up and scored within the survey, you can use the scores dynamically. For example, you can give participants feedback based on their scores, such as suggesting they call a gambling helpline if their score is high. You can also use scores to determine which questions participants see next. This is particularly useful for tailoring the survey to individual responses.

In the next video, I’ll show you how to use the PGSI score to control question flow and demonstrate some features of survey flow.

See you in the next video!