Abstract: Indirect questioning techniques aim to provide more valid prevalence estimates for sensitive attributes than conventional direct questions. Despite being an important prerequisite for high estimation validity, indirect questioning techniques’ retest stability has rarely been addressed. For temporally stable attributes, high stability of both prevalence estimates and individual responses is expected; however, insufficient understanding of the instructions and random response behavior may compromise retest stability. The present study is the first to assess the retest stability of the Extended Crosswise Model (ECWM), a recent indirect questioning technique, and to compare it to the retest stability of a conventional direct question (DQ). With a retest interval of approximately 10 days, we asked N = 2,317 mothers twice whether they had smoked during a previous pregnancy. In both ECWM and DQ conditions, prevalence estimates were virtually identical over time, and most respondents answered consistently (ECWM: 89%, DQ: 95%). In the ECWM condition, inconsistent response behavior was slightly more prevalent and negatively associated with respondents’ education. However, as these effects were small, the retest stability of both ECWM and DQ in surveys on sensitive attributes was evaluated as high.

BackgroundSurvey studies in medical and health sciences predominantly apply a conventional direct questioning (DQ) format to gather private and highly personal information. If the topic under investigation is sensitive or even stigmatizing, such as COVID-19-related health behaviors and adherence to non-pharmaceutical interventions in general, DQ surveys can lead to nonresponse and untruthful answers due to the influence of social desirability bias (SDB). These effects seriously threaten the validity of the results obtained, potentially leading to distorted prevalence estimates for behaviors for which the prevalence in the population is unknown. While this issue cannot be completely avoided, indirect questioning techniques (IQTs) offer a means to mitigate the harmful influence of SDB by guaranteeing the confidentiality of individual responses. The present study aims at assessing the validity of a recently proposed IQT, the Cheating Detection Triangular Model (CDTRM), in estimating the prevalence of COVID-19-related health behaviors while accounting for cheaters who disregard the instructions.MethodsIn an online survey of 1,714 participants in Taiwan, we obtained CDTRM prevalence estimates via an Expectation-Maximization algorithm for three COVID-19-related health behaviors with different levels of sensitivity. The CDTRM estimates were compared to DQ estimates and to available official statistics provided by the Taiwan Centers for Disease Control. Additionally, the CDTRM allowed us to estimate the share of cheaters who disregarded the instructions and adjust the prevalence estimates for the COVID-19-related health behaviors accordingly.ResultsFor a behavior with low sensitivity, CDTRM and DQ estimates were expectedly comparable and in line with official statistics. However, for behaviors with medium and high sensitivity, CDTRM estimates were higher and thus presumably more valid than DQ estimates. Analogously, the estimated cheating rate increased with higher sensitivity of the behavior under study.ConclusionsOur findings strongly support the assumption that the CDTRM successfully controlled for the validity-threatening influence of SDB in a survey on three COVID-19-related health behaviors. Consequently, the CDTRM appears to be a promising technique to increase estimation validity compared to conventional DQ for health-related behaviors, and sensitive attributes in general, for which a strong influence of SDB is to be expected.

In the context of personnel selection, self-reports are often biased by social desirability. For example, applicants may overstate their knowledge to make a good impression on a potential employer. Overclaiming questionnaires (OCQs) offer a means to assess whether applicants claim to have knowledge that they do not have. Previous studies evaluating whether OCQs are capable of detecting faking in personnel selection contexts reported mixed results but did not take the fit between the content of OCQ items and the selection context into account. In the present study, we therefore tailored an OCQ to the specific application context and compared its performance to that of Residualized Individual Change Scores (RICS), a competing measure of faking based on an achievement motivation questionnaire. A total of 123 participants first answered the OCQ and the motivational questionnaire in a control condition without application context. The two measures were then completed again as part of a mock application process, and participants were asked to honestly report their faking behavior afterward. Participants exhibited more overclaiming in the application context than in the control condition. The OCQ and RICS scores predicted participants’ self-reported faking with comparable accuracy. These results suggest that OCQs can compete with other measures of faking if their content is appropriately tailored to the application context.

Indirect questioning techniques aim to provide more valid prevalence estimates for sensitive attributes than conventional direct questions. Despite being an important prerequisite for high estimation validity, indirect questioning techniques' retest stability has rarely been addressed. For temporally stable attributes, high stability of both prevalence estimates and individual responses is expected; however, insufficient understanding of the instructions and random response behavior may compromise retest stability. The present study is the first to assess the retest stability of the Extended Crosswise Model (ECWM), a recent indirect questioning technique, and to compare it to the retest stability of a conventional direct question (DQ). With a retest interval of approximately 10 days, we asked N = 2,317 mothers twice whether they had smoked during a previous pregnancy. In both ECWM and DQ conditions, prevalence estimates were virtually identical over time, and most respondents answered consistently (ECWM: 89%, DQ: 95%). In the ECWM condition, inconsistent response behavior was slightly more prevalent and negatively associated with respondents' education. However, as these effects were small, the retest stability of both ECWM and DQ in surveys on sensitive attributes was evaluated as high.

Indirect questioning techniques such as the randomized response technique aim to control social desirability bias in surveys of sensitive topics. To improve upon previous indirect questioning techniques, we propose the new Cheating Detection Triangular Model. Similar to the Cheating Detection Model, it includes a mechanism for detecting instruction non-adherence, and similar to the Triangular Model, it uses simplified instructions to improve respondents' understanding of the procedure. Based on a comparison with the known prevalence of a sensitive attribute serving as external criterion, we report the first individual-level validation of the Cheating Detection Model, the Triangular Model and the Cheating Detection Triangular Model. Moreover, the sensitivity and specificity of all models was assessed, as well as the respondents' subjective evaluation of all questioning technique formats. Based on our results, the Cheating Detection Triangular Model appears to be the best choice among the investigated indirect questioning techniques.

The Randomized Response Technique (Warner, Journal of the American Statistical Association, 60, 63-69, 1965) has been developed to control for socially desirable responses in surveys on sensitive attributes. The Crosswise Model (CWM; Yu et al., Metrika, 67, 251-263, 2008) and its extension, the Extended Crosswise Model (ECWM; Heck et al., Behavior Research Methods, 50, 1895-1905, 2018), are advancements of the Randomized Response Technique that have provided promising results in terms of improved validity of the obtained prevalence estimates compared to estimates based on conventional direct questions. However, recent studies have raised the question as to whether these promising results might have been primarily driven by a methodological artifact in terms of random responses rather than a successful control of socially desirable responding. The current study was designed to disentangle the influence of successful control of socially desirable responding and random answer behavior on the validity of (E)CWM estimates. To this end, we orthogonally manipulated the direction of social desirability (undesirable vs. desirable) and the prevalence (high vs. low) of sensitive attributes. Our results generally support the notion that the ECWM successfully controls social desirability bias and is inconsistent with the alternative account that ECWM estimates are distorted by a substantial influence of random responding. The results do not rule out a small proportion of random answers, especially when socially undesirable attributes with high prevalence are studied, or when high randomization probabilities are applied. Our results however do rule out that random responding is a major factor that can account for the findings attesting to the improved validity of (E)CWM as compared with DQ estimates.

Overclaiming questionnaires (OCQs) were proposed as a means to counteract social desirability bias by capturing individual differences in participants’ self-enhancement tendencies in self-report assessments. Previous studies that evaluated OCQs reported mixed results. However, fit between the content of an OCQ in terms of its items and the context in which the measure is presented has not been tested systematically. In a mock application study ( N = 432), we compared different levels of content-context fit between conditions. Results show that the utility of a general knowledge OCQ varied as a function of its content fit to different application contexts. Expectedly, overclaiming was most pronounced in an application context with optimal content fit to the OCQ, followed by a context with lower fit and an honest control condition without application context. Furthermore, participants in the application conditions were shown to successfully fake on conventional personality scales while incorporating specific requirements of the application context into their faking behavior. Our results thus corroborate previous findings suggesting a high susceptibility of personality scales to deliberate faking. In contrast, when content-context fit is taken into account, OCQs may be a promising method for assessing applicant faking.

In self-reports, socially desirable responding threatens the validity of prevalence estimates for sensitive personal attitudes and behaviors. Indirect questioning techniques such as the crosswise model attempt to control for the influence of social desirability bias. The crosswise model has repeatedly been found to provide more valid prevalence estimates than direct questions. We investigated whether crosswise model estimates are also less susceptible to deliberate faking than direct questions. To this end, we investigated the effect of "fake good" instructions on responses to direct and crosswise model questions. In a sample of 1,946 university students, 12-month prevalence estimates for a sensitive road traffic behavior were higher and thus presumably more valid in the crosswise model than in a direct question. Moreover, "fake good" instructions severely impaired the validity of the direct questioning estimates, whereas the crosswise model estimates were unaffected by deliberate faking. Participants also reported higher levels of perceived confidentiality and a lower perceived ease of faking in the crosswise model compared to direct questions. Our results corroborate previous studies finding the crosswise model to be an effective tool for counteracting the detrimental effects of positive self-presentation in surveys on sensitive issues.

BACKGROUND:During the COVID-19 pandemic, billions of people have to change their behaviours to slow down the spreading of the virus. Protective measures include self-isolation, social (physical) distancing and compliance with personal hygiene rules, particularly regular and thorough hand washing. Prevalence estimates for the compliance with the COVID-19 measures are often based on direct self-reports. However, during a health crisis there is strong public pressure to comply with health and safety regulations so that people's responding in direct self-reports may be seriously compromised by social desirability.METHODS:In an online survey, an indirect questioning technique was used to test whether the prevalence of hygiene practices may be lower than in conventional surveys when confidentiality of responding is guaranteed. The Extended Crosswise Model is an indirect questioning technique that guarantees the confidentiality of responding. To the degree that direct self-reports are biased by social desirability, prevalence estimates of hygiene practices such as thorough hand washing based on the Extended Crosswise Model should be lower than those based on direct self-reports.RESULTS:We analysed data of 1434 participants. In the direct questioning group 94.5% of the participants claimed to practice proper hand hygiene; in the indirect questioning group a significantly lower estimate of only 78.1% was observed.CONCLUSIONS:These results indicate that estimates of the degree of commitment to measures designed to counter the spread of the disease may be significantly inflated by social desirability in direct self-reports. Indirect questioning techniques with higher levels of confidentiality seem helpful in obtaining more realistic estimates of the degree to which people follow the recommended personal hygiene measures. More realistic estimates of compliance can help to inform and to adjust public information campaigns on COVID-19 hygiene recommendations.

Non-randomized response techniques (NRRTs) such as the crosswise model and the triangular model (CWM and TRM; Yu et al. Metrika, 67, 251-263, 2008) have been developed to control for socially desirable responding in surveys on sensitive personal attributes. We present the first study to directly compare the validity of the CWM and TRM and contrast their performance with a conventional direct questioning (DQ) approach. In a paper-pencil survey of 1382 students, we obtained prevalence estimates for two sensitive attributes (xenophobia and rejection of further refugee admissions) and one nonsensitive control attribute with a known prevalence (the first letter of respondents' surnames). Both NRRTs yielded descriptively higher prevalence estimates for the sensitive attributes than DQ; however, only the CWM estimates were significantly higher. We attribute the higher prevalence estimates for the CWM to its response symmetry, which is lacking in the TRM. Only the CWM provides symmetric answer options, meaning that there is no "safe" alternative respondents can choose to distance themselves from being carriers of the sensitive attribute. Prevalence estimates for the nonsensitive control attribute with known prevalence confirmed that neither method suffered from method-specific bias towards over- or underestimation. Exploratory moderator analyses further suggested that the sensitive attributes were perceived as more sensitive among politically left-oriented than among politically right-oriented respondents. Based on our results, we recommend using the CWM over the TRM in future studies on sensitive personal attributes.

The crosswise model is an indirect questioning technique designed to control for socially desirable responding. Although the technique has delivered promising results in terms of improved validity in survey studies of sensitive issues, recent studies have indicated that the crosswise model may sometimes produce false positives. Hence, we investigated whether an insufficient understanding of the crosswise model instructions might be responsible for these false positives and whether ensuring a deeper understanding of the model and surveying more highly educated respondents reduces the problem of false positives. To this end, we experimentally manipulated the amount of information respondents received in the crosswise model instructions. We compared a crosswise model condition with only brief instructions and a crosswise model condition with detailed instructions and additional comprehension checks. Additionally, we compared the validity of crosswise model estimates between a higher- and a lower-educated subgroup of respondents. Our results indicate that false positives among highly educated respondents can be reduced when detailed instructions and comprehension checks are employed. Since false positives can also occur in direct questioning, they do not appear to be a specific flaw of the crosswise model, but rather a more general problem of self-reports on sensitive topics. False negatives were found to occur for all questioning techniques, but were less prevalent in the crosswise model than in the direct questioning condition. We highlight the importance of comprehension checks when applying indirect questioning and emphasize the necessity of developing instructions suitable for lower-educated respondents.

Indirect questioning techniques such as the crosswise model aim to control for socially desirable responding in surveys on sensitive personal attributes. Recently, the extended crosswise model has been proposed as an improvement over the original crosswise model. It offers all of the advantages of the original crosswise model while also enabling the detection of systematic response biases. We applied the extended crosswise model to a new sensitive attribute, campus islamophobia, and present the first experimental investigation including an extended crosswise model, and a direct questioning control condition, respectively. In a paper-pencil questionnaire, we surveyed 1,361 German university students using either a direct question or the extended crosswise model. We found that the extended crosswise model provided a good model fit, indicating no systematic response bias and allowing for a pooling of the data of both groups of the extended crosswise model. Moreover, the extended crosswise model yielded significantly higher estimates of campus Islamophobia than a direct question. This result could either indicate that the extended crosswise model was successful in controlling for social desirability, or that response biases such as false positives or careless responding have inflated the estimate, which cannot be decided on the basis of the available data. Our findings highlight the importance of detecting response biases in surveys implementing indirect questioning techniques.

To avoid social disapproval in studies on prejudice against women leaders, participants might provide socially desirable rather than truthful responses. Using the Crosswise Model, an indirect questioning technique that can be applied to control for socially desirable responding, we investigated the prevalence of prejudice against women leaders in a German university community sample of 1529 participants. Prevalence estimates that were based on an indirect question that guaranteed confidentiality of responses were higher than estimates that were based on a direct question. Prejudice against women leaders was thus shown to be more widespread than previously indicated by self-reports that were potentially biased by social desirability. Whereas women showed less prejudice against women leaders, their responses were actually found to be more biased by social desirability, as indicated by a significant interaction between questioning technique and participants’ gender. For men, prejudice estimates increased only slightly from 36% to 45% when an indirect question was used, whereas for women, prejudice estimates almost tripled from 10% to 28%. Whereas women were particularly hesitant to provide negative judgments regarding the qualities of women leaders, prejudice against women leaders was more prevalent among men even when gender differences in social desirability were controlled. Taken together, the results highlight the importance of controlling for socially desirable responding when using self-reports to investigate the prevalence of gender prejudice.

In surveys concerning sensitive behavior or attitudes, respondents often do not answer truthfully, because of social desirability bias. To elicit more honest responding, the randomized-response (RR) technique aims at increasing perceived and actual anonymity by prompting respondents to answer with a randomly modified and thus uninformative response. In the crosswise model, as a particularly promising variant of the RR, this is achieved by adding a second, nonsensitive question and by prompting respondents to answer both questions jointly. Despite increased privacy protection and empirically higher prevalence estimates of socially undesirable behaviors, evidence also suggests that some respondents might still not adhere to the instructions, in turn leading to questionable results. Herein we propose an extension of the crosswise model (ECWM) that makes it possible to detect several types of response biases with adequate power in realistic sample sizes. Importantly, the ECWM allows for testing the validity of the model's assumptions without any loss in statistical efficiency. Finally, we provide an empirical example supporting the usefulness of the ECWM.

On surveys that assess sensitive personal attributes, indirect questioning aims at increasing respondents' willingness to answer truthfully by protecting confidentiality. However, the assumption that subjects understand questioning procedures fully and trust them to protect their privacy is rarely tested. In a scenario-based design, we compared four indirect questioning procedures in terms of their comprehensibility and perceived privacy protection. All indirect questioning techniques were found to be less comprehensible by respondents than a conventional direct question used for comparison. Less-educated respondents experienced more difficulties when confronted with any indirect questioning technique. Regardless of education, the crosswise model was found to be the most comprehensible among the four indirect methods. Indirect questioning in general was perceived to increase privacy protection in comparison to a direct question. Unexpectedly, comprehension and perceived privacy protection did not correlate. We recommend assessing these factors separately in future evaluations of indirect questioning.

Socially desirable responding may cause differences between preelection polls and election outcomes. Bias-free preelection polls are, however, important because they influence election outcomes. Benefiting from a unique opportunity, we experimentally controlled social desirability using the Crosswise Model in a poll prior to the German federal election in 2013. We found that due to strategic voting, outcome expectations were related to voting intentions; the election outcome was therefore likely distorted by social desirability bias in preelection polls. We recommend using indirect questioning techniques whenever a vote for at least one of the competing parties may be perceived as socially undesirable.

Estimates of the prevalence of sensitive attributes obtained through direct questions are prone to being distorted by untruthful responding. Indirect questioning procedures such as the Randomized Response Technique (RRT) aim to control for the influence of social desirability bias. However, even on RRT surveys, some participants may disobey the instructions in an attempt to conceal their true status. In the present study, we experimentally compared the validity of two competing indirect questioning techniques that presumably offer a solution to the problem of nonadherent respondents: the Stochastic Lie Detector and the Crosswise Model. For two sensitive attributes, both techniques met the "more is better" criterion. Their application resulted in higher, and thus presumably more valid, prevalence estimates than a direct question. Only the Crosswise Model, however, adequately estimated the known prevalence of a nonsensitive control attribute.

Bacterioopsin (bO) from Halobacterium sali- narium (Halobacterium halobium) has been functionally expressed in a heterologous system, the fission yeast Schizo- saccharomyces pombe. Regeneration of bO to bacterio- rhodopsin (bR) in S. pombe has been achieved in vivo by addition of the chromophore retinal to the culture medium, as shown for a retinal-negative mutant of H. salinarium (JW5). Western blot analysis revealed that bR is more stable than bO against proteolysis in fission yeast and also in JW5. The light-driven proton pump is expressed in the eukaryotic orga- nism and incorporated into the plasma membrane. Illumina- tion of intact yeast cells leads to acidification of the external medium due to the translocation of H+ from inside to outside of the cell, indicating the same orientation of bR in the yeast plasma membrane as in H. salinarium. The kinetics of proton release into the water phase was observed with the optical pH indicator pyranine. Time-resolved absorbance changes of iso- lated plasma membrane measured by flash spectroscopy showed rise and decay of the M intermediate during the photocycle similar to those in the homologous system. Photo- currents and photovoltages were recorded with yeast plasma membrane attached to a planar lipid membrane and to a polytetrafluoroethylene (Teflon) film, respectively. Stationary currents measured in the presence of a protonophore showed continuous pumping activity of bR. The action spectrum of thse photocurrent and the kinetics of the photovoltage were ana- lyzed and compared with signals obtained from purple mem- branes. From all these different investigations we conclude that the integral membrane protein bR is correctly folded in vivo into the cytoplasmic membrane of the fission yeast S. pombe.