The multiple site entry technique is a strategy that can be used in online research (also called Internet-based research, Web-based research) to target different samples via different recruitment sites and compare their data.[1][2] It is a method used in behavioral and social research to assess the presence and impact of self-selection effects. Self-selection effects can be considered a major challenge in social science research. With the invention of online research in the 1990s the multiple site entry technique became possible, because the recruitment of participants via different links (URLs) is very easy to implement. It can be assumed that there is no self-selection bias if the data sets coming from different recruitment sites do not differ systematically.[3]
Method
editSeveral links to the study are placed on different websites, in Internet forums, social media platforms, or offline media that are likely to attract different types of participants, or are mailed out to different mailing lists. In order to identify the recruitment sources, the published URLs contain source identifying information and the HTTP protocol is analyzed by different referrer information.[4] This means, a unique string of characters is appended to the URL for each recruitment source, e.g. “...index.html?source=studentlist” for a list of students. The data file will have a column („source“) containing an entry of the referring source for each participant (“studentlist“).[3]
The collected data sets can then be compared for differences in results, and also for differences in relative degree of appeal (measured via dropout), demographic data, central results, and data quality[5]
The figure illustrates the multiple site entry technique.[3]
Impact
editSeveral studies have shown that the multiple site entry technique is a useful tool to determine the presence and impact of self-selection in online research (also called Internet-based research, Web-based research).[1][2] The multiple site entry technique helps to detect potential sampling problems, which in turn ensures the quality and generalizability in the data collection over the Internet.[5] Moreover, this technique can be applied to different kinds of Internet-based studies, e.g. trauma surveys.[6][3]
Fields of Application
editThe multiple site entry technique has already been applied successfully in different research areas. For instance, Holbrook and Lavrakas[7] discussed the multiple site entry technique in the field of experimental survey research. Moreover, it can also be used in a broader research context, e.g., in sex research[8] and in health science.[9][3]
References
edit- ^ a b Reips, Ulf-Dietrich (2000), "The Web Experiment Method", Psychological Experiments on the Internet, Elsevier, pp. 89–117, doi:10.1016/b978-012099980-4/50005-8, ISBN 978-0-12-099980-4, retrieved 2022-01-24
- ^ a b Reips, Ulf-Dietrich (2002). "Standards for Internet-Based Experimenting". Experimental Psychology (in German). 49 (4): 243–256. doi:10.1026/1618-3169.49.4.243. ISSN 1618-3169. PMID 12455331. S2CID 2404134.
- ^ a b c d e Reips, Ulf-Dietrich (December 2021). "Web-Based Research in Psychology". Zeitschrift für Psychologie. 229 (4): 198–213. doi:10.1027/2151-2604/a000475. S2CID 245297753.
This article incorporates text available under the CC BY 4.0 license.
- ^ Schmidt, William C. (2000), "The Server Side of Psychology Web Experiments", Psychological Experiments on the Internet, Elsevier, pp. 285–310, doi:10.1016/b978-012099980-4/50013-7, ISBN 978-0-12-099980-4, retrieved 2022-01-24
- ^ a b Reips, Ulf-Dietrich (2002). "Internet-Based Psychological Experimenting: Five Dos and Five Don'ts". Social Science Computer Review. 20 (3): 241–249. doi:10.1177/089443930202000302. ISSN 0894-4393. S2CID 64180326.
- ^ Hiskey, Syd; Troop, Nicholas A. (2002). "Online Longitudinal Survey Research: Viability and Participation". Social Science Computer Review. 20 (3): 250–259. doi:10.1177/089443930202000303. ISSN 0894-4393. S2CID 220157952.
- ^ Holbrook, Allyson; Lavrakas, Paul J. (2019-10-15), Lavrakas, Paul; Traugott, Michael; Kennedy, Courtney; Holbrook, Allyson (eds.), "Vignette Experiments in Surveys", Experimental Methods in Survey Research (1 ed.), Wiley, pp. 369–370, doi:10.1002/9781119083771.part8, ISBN 978-1-119-08374-0, S2CID 210567004, retrieved 2022-01-24
- ^ Mustanski, Brian S. (2001). "Getting wired: Exploiting the internet for the collection of valid sexuality data". Journal of Sex Research. 38 (4): 292–301. doi:10.1080/00224490109552100. ISSN 0022-4499. S2CID 145003364.
- ^ Whitehead, Lisa Claire (2007). "Methodological and ethical issues in Internet-mediated research in the field of health: An integrated review of the literature". Social Science & Medicine. 65 (4): 782–791. doi:10.1016/j.socscimed.2007.03.005. PMID 17512105.
