CIPHER 2022
As the world moves towards a new normal following the health, economic, and socio-political impact of COVID-19, one constant remains: the need for reliable, robust and timely information on individuals’ beliefs, behaviors, and situation. Population-representative probability-based online panels are more critical than ever: they enable us to understand the problems facing households and communities right now, and to study the scope, type, duration, and distribution of the effects of the pandemic in the longer term.
The annual Current Innovations in Probability-based Household Internet Panel Research (CIPHER) Conference continues to be the flagship platform for continued learning, offering an opportunity to connect with the global research community that uses this tool across a range of fields and disciplines.
Program and Presentations
The joint conference took place March 3 – 4, and was a virtual conference. CIPHER was free to attend virtually.
Videos of the CIPHER presentations
Two days of videos from March 3 – 4, 2022 Current Innovations in Probability-based Household Internet Panel Research (CIPHER) hosted by the Dornsife Center for Economic and Social Research, the National Institute on Aging and the Social Security Administration. If you have any questions, please email us [email protected].
CIPHER 2022 Keynote: Robustness in an Uncertain World (Frauke Kreuter)
Session 1: Financial literacy and long-term care insurance ownership in the Singapore Life Panel (Joelle Fong)
Session 1: Using an online panel to estimate population health risks (Alex Cook)
Session 2: Data Donation: Issues of Nonparticipation (Bella Struminskaya)
Session 2: Surveys and Financial Transaction Data: Comparisons of Different Data Collection Methodologies (Andrew Warren)
Session 2: Investigating response behavior and data quality in a mobile-first layout experiment within a well-established panel survey (Maikel Schwerdtfeger)
Session 2: Implementing Voice-Recordings in a Probability-based Panel: What we learnt so far (Katharina Meitinger)
Session 3: Trends in COVID-19 Concern and Vaccination (Debra Kalensky)
Session 3: COVID-19 and Children (Jane Manweiler)
Session 3: Economic Impacts of COVID-19 (Tess M. Yanisch)
Session 3: Covid-19 and the Explosion of Fintech (Noemi Altman)
Session 3: COVID-19 Adapting and looking forward (Karen Jaffe)
Session 4: Growing Pains: Balancing Longitudinal and Cross-Sectional Considerations for Managing and Expanding Probability Online Panels (Dana Neiger)
Session 4: From an Official Survey to a Probability-based Online Panel: the Drivers to Opt-in (Cesare A.F. Riillo)
Session 4: Why do people say they participate in probability-based online panel surveys? (Sebastian Kocar / Paul J. Lavrakas, Ph.D.)
Session 4: Benchmarking Probability-Based New England Web Panel Results in 2020-21 (Sean McKinley)
Session 4: Innovations in Hybrid Sampling Techniques – Improving Representation of Online Samples for Teens and Young Adults (Mansour Fahimi)
Session 5: Consequences of web-based consent protocols when assessing cognition in older adults (Margaret Gatz, Ph.D.)
Session 5: Barriers to administering, retrieving and interpreting online cognitive testing in an older adult cohort (Amanda Selwood)
Session 5: Self-administered web-based cognitive testing: Does environmental distraction matter? (Ying Liu)
Session 6: Are Probabilistic Online Panels Representative? A new Framework for the Analysis of Representation Bias (Michael Ochsner)
Session 6: Combining Probability and non-Probability Panel Samples to Improve Inclusion of Low-Incidence Populations (Jenny Marlar)
Session 6: Aiming for the Bullseye: Does the Use of Targeted Sample Improve Probability-based Samples? (Randall K. Thomas)
Session 6: The Effects of Attention Checks on Item Response Time and Questionnaire Completion (Ruoh-rong Yu)
Session 6: Explaining the Inaccuracy of 2016 Pre-election Poll Results from a Probability Sample Internet Panel: Base Weights, Post-stratification, and Vote Choice (Jon Krosnick)
Session 7: The Value of Working Conditions in the United States and Implications for the Structure of Wages (Kathleen J. Mullen)
Session 7: Health-Related Work Capacity at Older Ages and Labor Market Outcomes (Italo Lopez-Garcia)
Session 7: Workers’ Preferences and Expectations in the Aftermath of the Pandemic (Marco Angrisani)
Session 7: The Impact of the Pandemic on Subjective Work Probabilities at Older Ages (Francisco Perez-Arce)
Session 8: The impact of mail delays on timely research: experiences from the Healthy NYC survey panel (Leigh Reardon)
Session 8: Expansion of an Australian Probability-Based Online Panel using ABS, IVR and SMS push-to-Web: Longer-Term Performance (Benjamin Phillips / Charles Dove)
Session 8: Developing Probability-based panels in Europe (Jamie Burnett / Tanja Kimova)
Session 8: The impact of displaying cash via window envelope during mail contact when recruiting to a probability based panel (Ipek Bilgen)
Session 9: An Offer They Can’t Refuse? Evaluating Engagement Techniques Among Chronic Non-Responders in Probability Panels (Kyle Berta)
Session 9: Evaluating Data Quality in Online Panels with a Focus on Individual Respondents (Nick Bertoni)
Session 9: Beware the Trap Door: Can Online Probability Sample Data Quality be Improved Using Trap Questions? (Frances M. Barlas)
Session 10: Linking and analyzing a geographic/time specific stringency index to a probability-based longitudinal survey in Australia (Nicholas Biddle)
Session 10: School Re-openings, Educational Arrangements, and Labor Outcomes During COVID-19 (Maria Prados)
Session 10: The impact of COVID-19 on perceptions of systemic racism (Katherine Carman)
Session 10: Evolution of COVID-19 Risk Perception and Mental Models (Andrew Parker)
CIPHER Agenda
AGENDA
March 3 – March 4, 2022
Steering Committee: Arie Kapteyn, Joanne Yoong, Jill Darling, Francisco Perez-Arce, USC Center for Economic and Social Research; and Andrew Parker, RAND Corporation.
All times are in Eastern Standard Time
| SESSION 31:30 PM | Americans’ Experiences of COVID-19: Lessons from a Monthly Omnibus SurveySession Chair: Angela Hung (Robinhood) |
|---|---|
| Debra Kalensky (Consumer Reports)Trends in COVID-19 Concern and Vaccination | |
| Jane Manweiler (Consumer Reports)COVID-19 and Children | |
| Tess M. Yanisch (Consumer Reports)Economic Impacts of COVID-19 | |
| Noemi Altman (Consumer Reports)Covid-19 and the Explosion of Fintech | |
| Karen Jaffe (Consumer Reports)COVID-19 Adapting and looking forward |
| 2:30 PM | Break |
|---|---|
| SESSION 42:45 PM | Participation, Response Rates, and MeasurementsSession Chair: Marco Angrisani (USC Center for Economic and Social Research) |
| Dina Neiger (The Social Research Centre)Growing Pains: Balancing Longitudinal and Cross-Sectional Considerations for Managing and Expanding Probability Online Panels | |
| Cesare A.F. Riillo (STATEC Research)From an Official Survey to a Probability-based Online Panel: the Drivers to Opt-in | |
| Sebastian Kocar (University of Tasmania) / Paul J. Lavrakas, Ph.D. (Independent Consultant)Why do people say they participate in probability-based online panel surveys? | |
| Sean McKinley (University of the New Hampshire Survey Center)Benchmarking Probability-Based New England Web Panel Results in 2020-21 | |
| Mansour Fahimi (Ipsos)Innovations in Hybrid Sampling Techniques – Improving Representation of Online Samples for Teens and Young Adults | |
| SESSION 53:45 PM | Hurdles and recent progress in administering cognitive tests to Internet-based survey panelsSession Chair: Jill Darling (USC Center for Economic and Social Research) |
| Margaret Gatz, Ph.D. (USC Center for Economic and Social Research)Consequences of web-based consent protocols when assessing cognition in older adults | |
| Amanda Selwood (Centre for Healthy Brain Ageing, UNSW Sydney, Australia)Barriers to administering, retrieving and interpreting online cognitive testing in an older adult cohort | |
| Ying Liu (USC Center for Economic and Social Research)Self-administered web-based cognitive testing: Does environmental distraction matter? |
| 1:45 PM | Break |
|---|---|
| SESSION 92:00 PM | Data Quality in Online PanelsSession Chair: Jeremy Burke (USC Center for Economic and Social Research) |
| Kyle Berta (SSRS)An Offer They Can’t Refuse? Evaluating Engagement Techniques Among Chronic Non-Responders in Probability Panels | |
| Nick Bertoni (Pew Research Center)Evaluating Data Quality in Online Panels with a Focus on Individual Respondents | |
| Frances M. Barlas, Ph.D. (Ipsos)Beware the Trap Door: Can Online Probability Sample Data Quality be Improved Using Trap Questions? | |
| SESSION 102:45 PM | COVID-19 and Longitudinal SurveysSession Chair: Gary Mottola (FINRA Foundation) |
| Nicholas BiddleLinking and analyzing a geographic/time specific stringency index to a probability-based longitudinal survey in Australia | |
| Maria Prados (USC Center for Economic and Social Research)School Re-openings, Educational Arrangements, and Labor Outcomes During COVID-19 | |
| Katherine Carman (RAND Corporation)The impact of COVID-19 on perceptions of systemic racism | |
| Andrew Parker (RAND Corporation)Evolution of COVID-19 Risk Perception and Mental Models | |
| 3:45 PM | Closing Remarks |
Conference Organizers: Tania Gutsche and Tarra Kohli
For a full list of speakers, please see here.
CIPHER Conference
Keynote
Dr. Frauke Kreuter, Co-director of the Social Data Science Center (SoDa) and faculty member in the Joint Program in Survey Methodology (JPSM) at the University of Maryland, will present the keynote address on “Robustness in an Uncertain World.”
More Information
CIPHER’s fourth annual conference will again provide a venue for international researchers, practitioners, and policy-makers to share lessons on developing, deploying, and using probably-based internet panel research.
This year’s conference will include (but not be limited to) the following topics:
- Transparency and best practices in probability-based panel recruitment and retention practices;
- Survey methodology and practice;
- Experiments;
- Data management and linkages;
- Developments and analysis techniques;
- Applications of research;
- Combination of wearable devices data with self-reports;
- Naturally occurring data;
- Machine learning.
Sponsorship
This conference has been made possible through funding from a grant partnership between the National Institute on Aging and the Social Security Administration.
Closed Captioning will be available.