Response Quality Management and Warnings
Conjointly offers a wide range of options to improve response quality, eliminate low-quality responses, and restrict responses to certain devices or geographic areas.
If you recruit respondents through Conjointly, you do not pay for low-quality responses. Conjointly employs automated quality checks based on your enabled response quality management options, so that you will only pay for complete, real human responses.
These options can be found within the Response quality management and Response quality warnings tabs under Advanced Settings .
![Additional response quality options in Advanced Settings Additional response quality options in Advanced Settings](https://conjointly.com/img/response-quality-settings-202403.gif)
Response quality management options
Anonymise responses
To comply with privacy standards, including GDPR, you can increase the anonymity of your respondents by ticking the Anonymise Responses checkbox.
![Enabling the Anonymise Responses function to ensure GDPR compliance Enabling the Anonymise Responses function to ensure GDPR compliance](https://conjointly.com/img/response-quality-management-anonymise-responses.png)
By checking this box, your experiment will not record the following respondent details:
- IP address and associated location.
- Browser location.
- Browser cookies and identification strings.
- Type of device used.
To learn more about what information we store and how it is used, please refer to our Terms and Conditions and Privacy Policy.
Prevent respondents from repeating the survey
- Disable respondents from the same IP address
Prevent duplicated or fraudulent responses from the same IP address. Note that this setting should not be used when surveying employees of the same company. - Disable respondents from the same cookie
Prevent duplicated or fraudulent responses by assigning unique “cookies” to each respondent. - Required unique GET variables
Specify a unique GET variable to allow only one unique entry. The survey cannot be accessed without this GET variable.
![Prevent repetitive respondents Prevent repetitive respondents](https://conjointly.com/img/response-quality-management-prevent-repeating-respondents.png)
Filter low-quality responses
- Terminate low-quality respondents early
Prevent respondents marked as low-quality by the system from continuing with the survey. - Filter for sloppy text input
Identify and filter out inattentive respondents, including those with low character counts or gibberish characters detected. - Filter for duplicate text responses
Detect and filter duplicated text responses from different participants. This setting applies to all open-ended responses of more than 50 characters.
![Filter low-quality responses Filter low-quality responses](https://conjointly.com/img/response-quality-management-low-quality.png)
Set accepted device
Specify the device type respondents can use to answer the survey by choosing an option from the dropdown menu next to Accepted device. By default, any mobile device and desktop are accepted.
![Enabling the Anonymise Responses function to ensure GDPR compliance Enabling the Anonymise Responses function to ensure GDPR compliance](https://conjointly.com/img/response-quality-management-accepted-device.png)
Geofencing
Specify the geographic locations where respondents are allowed to participate in your survey.
- Ask respondents to share browser location
Browser location can be more precise than location determined from respondents’ IP addresses. However, it requires additional permissions from respondents that they may refuse to provide. This setting is automatically selected when you select the Only allow respondents from within certain geographic area option. - Check time zone based on location
Automatically detect respondents’ time zones to crosscheck the veracity of their locations. - Allowed locations of respondents
This option allows you to limit your survey to respondents from specific countries based on their location determined from IP addresses. You can use the field as a search bar to find and select your desired countries. This setting is automatically activated for paid samples. Please note that the check will only apply after the experiment is launched. - Only allow respondents from within certain geographic area
This option provides an alternative approach to geofencing your survey based on respondents’ device location. It allows you to define a rectangular area on the map where only respondents within this region can participate in the survey. This check will only apply after the experiment is launched.
![Selecting allowed locations of respondents Selecting allowed locations of respondents](https://conjointly.com/img/only-allow-respondents-from-within-certain-geographic-area.gif)
Detect low-quality open-ended responses
Easily identify and exclude low-quality open-ended responses using a large language model (LLM). This option is available for free when you source respondents through Conjointly’s Predefined panels, Self-serve sample, and Managed general sample.
When you bring your own respondents or send an email campaign, you have the option to enable this quality check. A fee of USD 0.10 per complete response with an open-end will be charged from your team balance. In order to activate this option, a minimum team balance of USD 100 or its equivalent is required.
![SDetect low-quality open-ended responses using a large language model SDetect low-quality open-ended responses using a large language model](https://conjointly.com/img/low-quality-open-end-llm.png)
When this option is enabled, the system will analyse and categorise the open-ended responses in your experiment. To review the categorisation, navigate to the Quality Checker page by clicking the
button on the experiment settings page.![Assessing quality checker Assessing quality checker](https://conjointly.com/img/assessing-quality-checker.png)
At the bottom right of the Quality Checker page, you will find a table that lists all risk signals recorded for each respondent. To identify the categories of the open-ended responses, find the on-review
label in the Occasion column. The corresponding categories will be listed in the Signal column next to this label, as shown in the table below.
Category of responses | Signal | Description |
---|---|---|
Test | open-end-test | Responses that appear to be test submissions |
Careless | open-end-careless | Responses that are overly brief, vague, or fail to address the question adequately |
Copy-pasted | open-end-copy-pasted | Responses that appear to be copied and pasted from other sources |
Keyjamming | open-end-keyjamming | Responses containing nonsensical or gibberish characters |
Good | open-end-good | Responses that are relevant and related to the survey question |
To exclude responses, use one of the following options located in the top-right corner of the Quality Checker page:
- icon: Click this icon below Assessment of quality to exclude low-quality responses.
- button: Click this button to exclude responses due to non-quality issues, such as quota fulfillment or ineligibility.
![Assessing categories of open-ended responses Assessing categories of open-ended responses](https://conjointly.com/img/categorising-open-ended-response.png)
Warnings to respondents
- Warn respondents who do not scroll enough
Prompt respondents to attentively consider the questions and choices. - Warn at-risk respondents once
Warn low-quality respondents once before termination. - Force respondents to read conjoint questions
Force respondents to stay on each choice set for a specified duration before they can make a choice.
![Response quality warnings Response quality warnings](https://conjointly.com/img/response-quality-management-warnings.png)
Redirect for low-quality responses
You can also specify a separate redirect for respondents who have given low-quality responses:
- Open the Redirects upon survey completion module under the Advanced settings tab.
- Insert the redirect URL in the URL for low quality responses field.
- Click the button at the bottom of your screen.
![Redirecting low-quality responses in Advanced Settings Redirecting low-quality responses in Advanced Settings](https://conjointly.com/img/response-quality-management-redirect.png)