Creating a Study

1. From the Content Rater menu, select Admin. The Content Rater Admin page appears.

2. From the dropdown list in the Study panel, select the subject you wish to create a study for. All the studies that have been previously created for the selected subject appear, along with buttons for performing different actions.

3. In the Study panel, click Add. The Edit Study Configuration section appears.

   Note that the Subject Name field is automatically set to the subject initially selected. To select a different subject, click Go Back.

4. In the Study Name field, enter a name for the new study.

5. Optional: Mark or clear the Display Item Overview checkbox. This determines whether raters receive additional information on each item’s properties.

6. From the Rounds dropdown list, select the number of rounds of questions you want to include in the study. In between rounds, discussion of item content with others may inform the way the raters respond to questions in subsequent rounds.

7. Click Add Question. A row for entering a question appears.

8. Add the following information:

   1. In the Question Text field, enter the question that will be presented to raters.

   2. Optional: If the question is one that raters must respond to, check the Required Response checkbox.

   3. Optional: If raters must provide a comment for the question, check the Required Comment checkbox.

   4. From the Option Types dropdown list, specify how the response options should be displayed to the rater. For example, response options may be displayed as radio buttons; checkboxes; if SingleSelection or MultiSelection is selected, a list; or if None is selected, a text area.

   5. From the Orientation dropdown list, if available, select whether the response options should be presented horizontally or vertically.

   6. In the Rounds column, select the checkboxes to indicate which rounds each question should appear in. The same question may appear in multiple rounds. Every question must appear in at least one round, and every round must include at least one question.

   7. Optional: To delete a question, click Delete Question in the Actions column.

9. Repeat steps 7 and 8 until all questions have been added.

10. Create response options for each question that requires them by doing the following:

    1. Click Edit Options for a question. The Options window appears.

    2. Click Add Option. A row for adding an option appears.

    3. In the Option Text field, enter a response option.

    4. Optional: If the rater needs to provide a comment when selecting the option, check the Required Comment checkbox.

    5. Click Add Option again and proceed to create more response options in the manner described above.

    6. Optional: To delete an option, click the Delete Option button in the Actions column.

    7. Once all the response options have been created, close the window.

    Note:

    For some option types, such as radio buttons, you may also create sub-options. For option types that allow sub-options, Edit Suboptions buttons are displayed in the Actions column of the Options window.

    To create sub-options:

    1. Click Edit Suboptions for the required option. A Suboptions window appears.

    2. In the Suboptions window, click Add Suboption to add a sub-option row and then enter the sub-option description in the Option Text field.

    3. Repeat the above step until all sub-options have been added.

    4. Optional: To delete a sub-option, click the Delete Suboption button in the Actions column.

    5. Close the pop-up window and return to the Options window.

11. To lock the study, click Lock, enter a comment in the pop-up, and click OK. The study must be locked before it can be assigned to content raters. A locked study cannot be edited. To unlock it, click Unlock, enter a comment, and click OK. When a study is assigned, it can no longer be unlocked unless the raters and any rating data are removed.

12. Click Go Back to return to the Content Rater Admin page and perform other actions.