Keywords
factorial survey
experimental vignette
quantitive research
How to Cite
Abstract
Vignette studies have been increasingly popular in an array of social sciences. The vignette technique involves hypothetical descriptions or scenarios to investigate judgments or decision-making processes in various social topics. Currently, with the increase in migration studies, the need to discuss ethical methods and techniques in the field occured, and that brings about the widespread use of the vignette technique in migration studies. Despite the considerable interest that the vignette studies have received, the articles on the vignette technique have been scant in Turkish literature. The aim of this review is to explain the steps followed by researchers in experimental vignette studies and to discuss methodological issues that researchers should consider in each step. This study consists of three parts. In the first section, the vignette technique is described, and its general characteristics are explained. In the second section, the experimental vignette studies’ steps from designing to implementation are explained and the methodological issues in each step are discussed. Lastly, considering the critiques surrounding vignette studies, we conclude with methodological recommendations for further research. This study aims to guide researchers who plan to conduct vignette studies, shedding light into important methodological issues in experimental vignette studies in migration research.
References
Agerström, J., Björklund, F., Carlsson, R. ve Rooth, D. O. (2012). Warm and Competent Hassan=Cold and Incompetent Eric: A Harsch Equation of Real-Life Hiring Discrimination. Basic and Applied Social Psychology, 34(4), 359-366. https://doi.org/10.1080/01973533.2012.693438
Aguinis, H. ve Bradley, K. J. (2014). Best Practice Recommendations for Designing and Implementing Experimental Vignette Methodology Studies. Organizational Research Methods, 17(4), 351-371. https://doi.org/10.1177/1094428114547952
Alecu, A. I. (2020). Which doctors do we trust? A vignette experiment of how gender and ethnicity influence trust. Ethnicities, 20(5), 939–958. https://doi.org/10.1177/1468796819877737
Alexander, C. S. ve Becker, H. J. (1978). The Use of Vignettes in Survey Research. Public Opinion Quarterly, 42(1), 93-104. https://doi.org/10.1086/268432
Atzmüller, C. ve Steiner, P. M. (2010). Experimental Vignette Studies in Survey Research. Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, 6(3), 128-138. https://doi.org/10.1027/1614-2241/a000014
Auspurg, K. ve Hinz, T. (2015). Multifactorial experiments in surveys: conjoint analysis, choice experiments, and factorial surveys. T. Wolbring ve M. Keuschnigg (Ed.), Experimente in den Sozialwissenschaften. Sonderband 22 der Sozialen Welt içinde (s. 291-315). Baden-Baden: Nomos.
Auspurg, K. ve Jäckle, A. (2017). First Equals Most Important? Order Effects in Vignette-Based Measurement. Sociological Methods & Research., 46(3), 490-539. https://doi.org/10.1177/0049124115591016
Auspurg, K., Hinz, T. ve Walzenbach, S. (2019). Are Factorial Survey Experiments Prone to Survey Mode Effects? P. P. Lavrakas, M. Traugott, C. Kennedy, A. Holbrook, E. de Leeuw ve B. West (Ed.), Experimental Methods in Survey Research: Techniques that Combine Random Sampling with Random Assignment içinde (s. 371-392). Wiley & Sons. https://doi.org/10.1002/9781119083771.ch19
Aviram, H. (2012). What would you do? Conducting web-based factorial vignette surveys. Gideon, L. (Ed.), Handbook of Survey Methodology for the Social Sciences içinde (s. 463-473). New York, NY: Springer. https://doi.org/10.1007/978-1-4614-3876-2_26
Barter, C. ve Renold, E. (2000). ‘I wanna tell you a story’: exploring the application of vignettes in qualitative research with children and young people. International Journal of Social Research Methodology, 3(4), 307-323. https://doi.org/10.1080/13645570050178594
Bettor, L., Hendrick, S. S. ve Hendrick, C. (1995). Gender and sexual standards in dating relationships. Personal Relationships, 2(4), 359-369. https://doi.org/10.1111/j.1475-6811.1995.tb00098.x
Burstin, K., Doughtie, E. B. ve Raphaeli, A. (1980). Contrastive Vignette Technique: An Indirect Methodology Designed to Address Reactive Social Attitude Measurement. Journal of Applied Social Psychology, 10(2), 147-165. https://doi.org/10.1111/j.1559-1816.1980.tb00699.x
Caprariello, P. A., Cuddy, A. J. C. ve Fiske, S. T. (2009). Social Structure Shapes Cultural Stereotypes and Emotions: A Causal Test of the Stereotype Content Model. Group Processes & Intergroup Relations, 12(2), 147-155. https://doi.org/10.1177/1368430208101053
Crafter, S., de Abreu, G., Cline, T. ve O’Dell, L. (2015) Using Vignette Methodology as a Tool for Exploring Cultural Identity Positions of Language Brokers. Journal of Constructivist Psychology, 28(1), 83-96. https://doi.org/10.1080/10720537.2014.923354
Demol, K., Verschueren, K., Jame, J., Lazard, C. ve Colpin H. (2021). Student attitudes and perceptions of teacher responses to bullying: An experimental vignette study. European Journal of Developmental Psychology, 18(6), 814-830. https://doi.org/10.1080/17405629.2021.1896492
Denk, C. E., Benson, J. M., Fletcher, J. C. ve Reigel, T. M. (1997). How Do Americans Want to Die? A Factorial Vignette Survey of Public Attitudes about End-of-Life Medical Decision-Making. Social Science Research, 26, 95-120. https://doi.org/10.1006/ssre.1996.0587
Diehl, C., Hinz, T. ve Auspurg, K. (2018). Who Is Afraid of Skilled Migrants from Europe? Exploring Support for Immigration Control in Switzerland. Swiss Journal of Sociology, 44(1), 59-88. https://doi.org/10.1515/sjs-2018-0004
Dülmer, H. (2007). Experimental Plans in Factorial Surveys: Random or Quota Design?. Sociological Methods & Research, 35(3), 382-409. https://doi.org/10.1177/0049124106292367
Evans, S. C., Roberts, M. C., Keeley, J. W., Blossom, J. B., Amaro, C. M., Garcia, A. M., Stough, C. O., Canter, K. S., Robles, R. ve Reed, G. M. (2015). Vignette methodologies for studying clinicians’ decision-making: validity, utility, and application in ICD-11 field studies. International Journal of Clinical and Health Psychology, 15(2), 160-170. https://doi.org/10.1016/j.ijchp.2014.12.001
Facciani, M., Brashears, M. E. ve Zhong, J. (2020). Visual vignettes for cross-national research. International Journal of Social Research Methodology, 25, 29-43. https://doi.org/10.1080/13645579.2020.1844897
Finch, J. (1987). The vignette technique in survey research. Sociology, 21(1), 105-114. https://doi.org/10.1177/0038038587021001008
Gaertner, S. L. ve Dovidio, J. (1986). The aversive form of racism. J. Dovidio ve S. L. Gaertner (Ed.), Prejudice, discrimination, and racism içinde (s. 61 -89). San Diego, CA: Academic Press
Ganong, L. H. ve Coleman, M. (2006). Multiple Segment Factorial Vignette Designs. Journal of Marriage and Family, 68(2), 455-468. https://doi.org/10.1111/j.1741-3737.2006.00264.x
Graham, M. E. ve Cable, D. M. (2001). Consideration of the Incomplete Block Design for Policy-Capturing Research. Organizational Research Methods, 4(1), 26-45. https://doi.org/10.1177/109442810141002
Hainmuller, J., Hangartner, D. ve Yamamoto, T. (2014). Validating vignette and conjoint survey experiments against real-world behavior. Proceedings of the National Academy of Sciences, 112(8), 2395-2400. https://doi.org/10.1073/pnas.1416587112
Harrits, G. S. ve Møller, M. Ø. (2021). Qualitative Vignette Experiments: A Mixed Methods Design. Journal of Mixed Methods Research, 15(4), 526-545. https://doi.org/10.1177/1558689820977607
Hobson, C. J. ve Gibson, F. W. (1983). Policy Capturing as an Approach to Understanding and Improving Performance Appraisal: A Review of the Literature. Academy of Management Review, 8(4), 640-649. https://doi.org/10.2307/258265
Hughes, R. (1998). Considering the vignette technique and its application to a study of drug injecting and HIV risk and safer behaviour. Sociology of Health & Illness, 20(3), 381-400. https://doi.org/10.1111/1467-9566.00107
Hughes, R. ve Huby, M. (2002). The application of vignettes in social and nursing research. Journal of Advanced Nursing, 37(4), 382-386. https://doi.org/10.1046/j.1365-2648.2002.02100.x
Hughes, R. ve Huby, M. (2004). The construction and interpretation of vignettes in social research. Social Work & Social Sciences Review, 11, 36-51. https://doi.org/10.1921/17466105.11.1.36
Jenkins, N., Bloor, M., Fischer, J., Berney, L. ve Neale, J. (2010) Putting it in to context: the use of vignettes in qualitative interviewing. Qualitative Research 10(2), 175–198. https://doi.org/10.1177/1468794109356737
Johnson, J. D., Whitestone, E., Jackson, L. A. ve Gatto, L. (1995). Justice is still not colorblind: Differential racial effects of exposure to inadmissible evidence. Personality and Social Psychology Bulletin, 21(9), 893-898. https://doi.org/10.1177/0146167295219003
Kootstra, A. (2016). Deserving and Undeserving Welfare Claimants in Britain and the Netherlands: Examining the Role of Ethnicity and Migration Status Using a Vignette Experiment. European Sociological Review, 32(3), 325-338. https://doi.org/10.1093/esr/jcw010
Liebig, S., Sauer, C. ve Friedhoff, S. (2015). Using Factorial Surveys to Study Justice Perceptions: Five Methodological Problems of Attitudinal Justice Research. Social Justice Research, 28(4), 415–434. https://doi.org/10.1007/s11211-015-0256-4
Mullinix, K. J., Leeper, T. J., Druckman, J. N. ve Freese, J. (2015). The Generalizability of Survey Experiments. Journal of Experimental Political Science, 2(2), 109-138 https://doi.org/10.1017/XPS.2015.19
Murphy, K. R., Herr, B. M., Lockhart, M. C. ve Maguire, E. (1986). Evaluating the Performance of Paper People. Journal of Applied Psychology, 71(4), 654-661. https://doi.org/10.1037/0021-9010.71.4.654
O'Dell, L., Crafter, S., de Abreu, G. ve Cline, T. (2012). The problem of interpretation in vignette methodology in research with young people. Qualitative Research, 12(6), 702-714. https://doi.org/10.1177/1468794112439003
Olsen, O. K., Heesch, P., Søreide, C. ve Hystad, S. W. (2020). Trust After Just 45 Seconds? An Experimental Vignette Study of How Leader Behavior and Emotional States Influence Immediate Trust in Strangers. Frontiers in Psychology, 10:2921. https://doi.org/10.3389/fpsyg.2019.02921
Parkinson, B. ve Manstead, A. S. (1993). Making sense of emotion in stories and social life. Cognition and Emotion, 7(3-4), 295–323. https://doi.org/10.1080/02699939308409191
Passini, S. ve Villano, P. (2018). Justice and Immigration: The Effect of Moral Exclusion. International Journal of Psychological Research, 11(1), 42-49. https://doi.org/10.21500/20112084.3262
Plant, E. A. ve Devine, P. G. (1998). Internal and external motivation to respond without prejudice. Journal of Personality and Social Psychology, 75(3), 811–832. https://doi.org/10.1037/0022-3514.75.3.811
Rahman, N. (1996) Caregivers’ sensitivity to conflict: the use of vignette methodology. Journal of Elder Abuse and Neglect, 8, 35–47. https://doi.org/10.1300/J084v08n01_02
Rossi, P. H., Sampson, W. A., Bose, C. E., Jasso, G. ve Passel, J. (1974). Measuring Household Social Standing. Social Science Research, 3(3), 169-190. https://doi.org/10.1016/0049-089X(74)90011-8
Rossi, P. H., Simpson, J. E. ve Miller, J. L. (1985). Beyond Crime Seriousness: Fitting the Punishment to the Crime. Journal of Quantitative Criminology, 1(1), 59-90. https://doi.org/10.1007/BF01065249
Rucker, D. D., Polifroni, M., Tetlock, P. E. ve Scott, A. L. (2004). On the Assignment of Punishment: The Impact of General-Societal Threat and the Moderating Role of Severity. Personality and Social Psychology Bulletin, 30(6), 673-684. https://doi.org/10.1177/0146167203262849
Rungtusanatham, M., Wallin, C. ve Eckerd, S. (2011). The Vignette in a Scenario-Based Role-Playing Experiment. Journal of Supply Chain Management, 47(3), 9-14. https://doi.org/10.1111/j.1745-493X.2011.03232.x
Sauer, C., Auspurg, K. ve Hinz, T. (2020). Designing Multi-Factorial Survey Experiments: Effects of Presentation Style (Text or Table), Answering Scales, and Vignette Order. Methods, data, analyses, 14(2), 195-214. https://doi.org/10.12758/mda.2020.06
Sauer, C., Auspurg, K., Hinz, T. ve Liebig, S. (2011). The Application of Factorial Surveys in General Population Samples: The Effects of Respondent Age and Education on Response Times and Response Consistency. Survey Research Methods, 5(3), 89-102. https://doi.org/10.18148/srm/2011.v5i3.4625
Sears, D. O. (1988) Symbolic Racism. Katz P.A. ve Taylor D.A. (Ed.) Eliminating racism: Profiles in controversy içinde (s. 53-84). Plenum Press. Springer, Boston, MA. https://doi.org/10.1007/978-1-4899-0818-6_4
Sherer, P. D. ve Schwab, D. P. ve Heneman, H. G. (1987). Managerial Salary-Raise Decisions: A Policy Capturing Approach. Personnel Psychology, 40(1), 27-38. https://doi.org/10.1111/j.1744-6570.1987.tb02375.x
Sleed, M., Durrheim, K., Kriel, A., Solomon, V. ve Baxter, V. (2002). The effectiveness of the vignette methodology: A comparison of written and video vignettes in eliciting response about date rape. South African Journal of Psychology 32(3), 21–28. https://doi.org/10.1177/008124630203200304
Sommers, S. R. ve Ellsworth, P. C. (2000). Race in the Courtroom: Perceptions of Guilt and Dispositional Attributions. Personality and Social Psychology Bulletin, 26(11), 1367-1379. https://doi.org/10.1177/0146167200263005
Steiner, P. M., Atzmüller, C. ve Su, D. (2016). Designing Valid and Reliable Vignette Experiments for Survey Research: A Case Study on the Fair Gender Income Gap. Journal of Methods and Measurement in the Social Sciences, 7(2), 52-94. https://doi.org/10.2458/v7i2.20321
Swartzman, L. C. ve McDermid, A. J. (1993). The impact of contextual cues on the interpretation of and response to physical symptoms: A vignette approach. Journal of Behavioral Medicine, 16(2), 183– 198. https://doi.org/10.1007/BF00844892
Turper, S. (2016). Fearing what? Vignette experiments on anti-immigrant sentiments. Journal of Ethnic and Migration Studies, 43(11), 1792-1812. https://doi.org/10.1080/1369183X.2016.1263554
Van Prooijen, J. V. (2006). Retributive Reactions to Suspected Offenders: The Importance of Social Categorizations and Guilt Probability. Personality and Social Psychology Bulletin, 32(6), 715-726. https://doi.org/10.1177/0146167205284964.
Van Prooijen, J. V. (2010). Retributive versus compensatory justice: Observers’ preference for punishing in response to criminal offenses. European Journal of Social Psychology, 40(1), 72-85. https://doi.org/10.1002/ejsp.611
Van Prooijen, J. V. ve Lam, J. (2007). Retributive justice and social categorizations: The perceived fairness of punishment depends on intergroup status. European Journal of Social Psychology, 37(6), 1244– 1255. https://doi.org/10.1002/ejsp.421
Van Prooijen, J. V. ve Veer, E. (2010). Perceiving Pure Evil: The Influence of Cognitive Load and Prototypical Evilness on Demonization. Social Justice Research, 23(4), 259-271. https://doi.org/10.1007/s11211-010-0119-y
Walzer, A. J., Fagley, N. S. ve Shahidullah, J. D. (2020). An Experimental Vignette Study of School Psychology Students’ Attitudes Toward Transgender Youth. Contemporary School Psychology, 24(4), 457-468. https://doi.org/10.1007/s40688-020-00272-2
Weisman, J. ve Brosgole, L. (1994). Facial affect recognition in singly diagnosed mentally retarded people and normal young children: A methodological comparison. International Journal of Neuroscience, 75(1-2), 45–55. https://doi.org/10.3109/00207459408986287
Wilks, T. (2004). The Use of Vignettes in Qualitative Research into Social Work Values. Qualitative Social Work, 3(1), 78-87. https://doi.org/10.1177/1473325004041133
Wilson, J. ve While, A. E. (1998). Methodological issues surrounding the use of vignettes in qualitative research. Journal of Interpersonal Care, 12(1), 79-86. https://doi.org/10.3109/13561829809014090
Woehr, D. J. ve Lance, C. E. (1991). Paper people versus direct observation: An empirical examination of laboratory methodologies. Journal of Organizational Behavior, 12(5), 387-397. https://doi.org/10.1002/job.4030120504
Yalçın, Ö. (2014). Ahlaki İhlallere Tanıklıkta Ahlaki Geri Çekilme: Ahlaki Temel ve İç-grup/Dış-grup Durumlarında Gözlenen Farklılıklar (Yayınlanmamış Doktora Tezi) Ankara Üniversitesi.
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Copyright (c) 2022 Nesne Psikoloji Dergisi