Randomisation block
Randomisation blocks can be used to organise and shuffle a group of questions and blocks within the experiment.
Setting up a randomisation block
Follow these steps to set up a randomisation block:
1. Add a randomisation block
Navigate to the Add questions tab and click on the button at the bottom of the page.
On the Add or import questions pop-out, select the Add a new question tab and click on the question card to add it to the experiment.
2. Organise the randomisation block
Once you add the randomisation block, you can:
- Click-and-drag to move the block.
- Click-and-drag questions into the block.
- Rename the block.
3. Specify the maximum number of questions to display per respondent
You can enter your preferred maximum number of questions to display per respondent.
By default, the field is left blank to display all questions in the block to all respondents. In this example, if 3 is entered, each respondent will only see three randomly selected the questions out of the four questions in the block. Since the questions are randomly selected from the block, it is not guaranteed that each question will be shown to an equal number of participants. However, questions are allocated to an approximate equal number of participants, e.g. for this randomisation block, each question will be shown to approximately 75% of participants.
4. Specify the randomisation logic order
Conjointly offers two options for the order in which randomisation and display logic are applied:
- Recommended: Resolve display logic for each question first, then randomly select questions from the remaining questions.
- Randomly select questions first, then resolve display logic for the selected questions.
Conjointly recommends the first option because the second option risks respondents seeing fewer or even no questions from a block if the selected questions are hidden by display logic.
For example, consider a randomisation block set to display only one out of two available questions, where the first question has conditional display logic. If the first question is randomly selected but then hidden by the display logic, respondents will not see any questions from that block. To avoid this issue, it’s best to resolve display logic before randomly selecting from the remaining questions.
You may also set up display logic for both the randomisation block and the questions within the block to display them conditionally based on other information, such as answers to previous questions in the survey, GET variables, or JavaScript functions.
Respondent view
The example below shows how respondents are shown three survey questions randomly out of the block of four questions.
Randomisation block outputs
The randomisation block outputs are subject to the questions included. Aside from question outputs, the randomisation block outputs also includes the number of participants who saw and answered each question within the block.
FAQs
Can I randomise the order of question groups i.e. randomisation blocks?
Randomising question groups on Conjointly is easy using nested randomisation blocks. Two or more randomisation blocks can be nested inside another block, as shown below:
