An online panel (formerly called a discontinuous access panel) is a group of selected research participants who have agreed to provide information at specified intervals over an extended period of time.[1]

History and terminology

edit

Online panels are a form of access panel.[2] The ISO standard ISO 20252 defines it as "a sample database of potential respondents who declare that they will cooperate for future data collection if selected".[2] Panel members are typically recruited through an agency campaign, often with some kind of incentive, or appealing to those who simply wish to share their opinion.[1] Online panel data (OPD) is widely used in market research.[3][2] Other fields that contain prominent usage of online panel data include psychological, social, and medical research, as well as electoral studies.[2]

Online panels were first utilized in academic journals in the late 1990s, though similar ideas had been proposed in the 1980s. Usage has steadily increased since this time, with one analysis putting their prevalence at 14.3% of their dataset of the empirical articles published in 2017.[3][2] They were formerly called discontinuous access panels; the usage of the word "panel" in this context is a non-standard meaning relative to its typical survey usage (which aim to measure the same variables using the same group of people at different times).[2]

Types

edit

There are several types of online panels:

  • General population panels, which can include hundreds of thousands of participants and are typically used for studies of the general population[1][2]
  • Specialty panels, in which the participants are selected due to a specific commonality they share, like owning a specific product or being a member of a specific demographic[1]
  • Proprietary panels, a sub-type of specialty panels focused on specific companies, also called client panels or insight communities[1][2]
  • Census balanced samples, panels designed to reflect the population's demographic proportions[1]
  • Election panels, panels of those eligible to vote in political elections before and after elections[2]

An example is the German Internet Panel, which studies the economic and political attitudes of its participants. This panel is unusual in its inclusion of people who previously had little internet access.[4] Another is Amazon's MTurk, which includes as one of the tasks assigned to its crowdsourced workers OP participation.[3]

Advantages and concerns

edit

Online panels are a useful way to keep costs down but to also reach a high number of people, which makes them ideal for either pilot studies or scale development.[3] They are also used to solve a sample frame problem in surveys where e-mails would otherwise be used, where there is no otherwise complete e-mail list of the target study population.[1] The speed of data collection and sampling efficiency are also common reasons for their usage.[2]

While popular, their usage has attracted criticism. Data quality issues are a concern with online panels, including "panel conditioning" of the respondents.[5] Many studies are also ambiguous and do not clearly report if they used panel data.[3] There are also ethical concerns due to the usage of incentives in attracting the respondents, and the fact that though many OP respondents are paid workers many studies do not report their pay, or if paid far under the minimum wage.[3]

One problem with online panels is that they are not well suited for evaluating services that are offline alternatives, as the users of these services would be unlikely to be selected for an online panel.[6] One analysis found that an online panel was biased in a way that reflected Internet demographics, with women, the elderly, and the uneducated being less represented in the sample; the analysis found that this sample was biased and statistical weighting could not overcome the issue.[1]

See also

edit

References

edit
  1. ^ a b c d e f g h Gideon 2012, E-Mail Surveys.
  2. ^ a b c d e f g h i j Callegaro, Manfreda & Vehovar 2015, Online panel research: history, concepts, applications and a look at the future.
  3. ^ a b c d e f Porter, Christopher O. L. H.; Outlaw, Ryan; Gale, Jake P.; Cho, Thomas S. (January 2019). "The Use of Online Panel Data in Management Research: A Review and Recommendations". Journal of Management. 45 (1): 319–344. doi:10.1177/0149206318811569. hdl:1805/20617. ISSN 0149-2063.
  4. ^ Blom, Annelies G.; Gathmann, Christina; Krieger, Ulrich (November 2015). "Setting Up an Online Panel Representative of the General Population: The German Internet Panel". Field Methods. 27 (4): 391–408. doi:10.1177/1525822X15574494. ISSN 1525-822X.
  5. ^ Callegaro, Manfreda & Vehovar 2015, Online Panel Data Quality.
  6. ^ Poynter 2010.

Sources

edit