This article presents the findings of a web survey aimed at collecting new neighborhood-level information on individual and contextual health-related risk factors in Milan, Italy. The study utilized the Social Determinants of Health and Urban Health approaches to design data-driven health prevention and promotion interventions tailored to the local community. However, the survey experienced a significantly low response rate (6.2%) with a skewed representation of middle-aged, well-educated, white-collar individuals located in affluent city areas. As a result, the collected data was deemed unusable for public health and research purposes. The article discusses the rationale, structure, and development of the project and evaluates the magnitude of non-response and non-response bias due to socioeconomic characteristics. The issues of low survey participation and socioeconomic inequalities in response rates are explored in connection with sociological theories and existing empirical evidence from the literature.
Cite this paper
Consolazio, D. , Benassi, D. , Sarti, S. , Terraneo, M. , Celata, C. and Russo, A. G. (2024). Analysis and Theoretical Exploration of Low Response Rate and Socioeconomic Bias in Survey Non-Response in Milan, Italy. Open Access Library Journal, 11, e1850. doi: http://dx.doi.org/10.4236/oalib.1111850.
Marques, T.S., Ferreira, M., Saraiva, M., Forte, T. and Santinha, G. (2021) Mapping Health Vulnerabilities: Exploring Territorial Profiles to Support Health Policies. Ciência & Saúde Coletiva, 26, 2459-2470. https://doi.org/10.1590/1413-81232021266.1.40862020
Phelan, J.C., Link, B.G. and Tehranifar, P. (2010) Social Conditions as Fundamental Causes of Health Inequalities: Theory, Evidence, and Policy Implications. Journal of Health and Social Behavior, 51, S28-S40. https://doi.org/10.1177/0022146510383498
Pearce, J., Witten, K., Hiscock, R. and Blakely, T. (2008) Regional and Urban-Rural Variations in the Association of Neighbourhood Deprivation with Community Resource Access: A National Study. Environment and Planning A: Economy and Space, 40, 2469-2489. https://doi.org/10.1068/a409
Galster, G.C. (2011) The Mechanism(s) of Neighbourhood Effects: Theory, Evidence, and Policy Implications. In: van Ham, M., et al., Eds., Neighbourhood Effects Research: New Perspectives, Springer, 23-56. https://doi.org/10.1007/978-94-007-2309-2_2
Macintyre, S., Maciver, S. and Sooman, A. (1993) Area, Class and Health: Should We Be Focusing on Places or People? Journal of Social Policy, 22, 213-234. https://doi.org/10.1017/s0047279400019310
Pebley, A. and Sastry, N. (2009) Our Place: Perceived Neighborhood Size and Names in Los Angeles. UCLA CCPR Population Working Papers. http://128.97.186.17/index.php/pwp/article/view/839/222
Weiss, L., Ompad, D., Galea, S. and Vlahov, D. (2007) Defining Neighborhood Boundaries for Urban Health Research. American Journal of Preventive Medicine, 32, S154-S159. https://doi.org/10.1016/j.amepre.2007.02.034
Rosano, A., Pacelli, B., Zengarini, N., Costa, G., Cislaghi, C. and Caranci, N. (2020) Update and Review of the 2011 Italian Deprivation Index Calculated at the Census Section Level. Epidemi-ologia e Prevenzione, 44, 162-170.
Dimick, S., Stefanacci, R.G. and Gugliucci, M.R. (2022) Addressing Social Determinants of Health (SDoH) in Primary Care: A Pilot Study. Open Journal of Social Sciences, 10, 233-246. https://doi.org/10.4236/jss.2022.104017
Shih, T. and Fan, X.T. (2008) Comparing Response Rates from Web and Mail Surveys: A Meta-Analysis. Field Methods, 20, 249-271. https://doi.org/10.1177/1525822x08317085
Fan, W. and Yan, Z. (2010) Factors Affecting Response Rates of the Web Survey: A Systematic Review. Computers in Human Behavior, 26, 132-139. https://doi.org/10.1016/j.chb.2009.10.015
Edwards, P.J., Roberts, I., Clarke, M.J., DiGuiseppi, C., Wentz, R., Kwan, I., et al. (2009) Methods to Increase Response to Postal and Electronic Questionnaires. Cochrane Database of Systematic Reviews, 2009, MR000008. https://doi.org/10.1002/14651858.mr000008.pub4
Ryu, E., Couper, M.P. and Marans, R.W. (2006) Survey Incentives: Cash vs. In-Kind; Face-to-Face vs. Mail; Response Rate vs. Nonresponse Error. International Journal of Public Opinion Research, 18, 89-106. https://doi.org/10.1093/ijpor/edh089
Singer, E. and Ye, C. (2012) The Use and Effects of Incentives in Surveys. The ANNALS of the American Academy of Political and Social Science, 645, 112-141. https://doi.org/10.1177/0002716212458082
Jang, M. and Vorderstrasse, A. (2019) Socioeconomic Status and Racial or Ethnic Differences in Participation: Web-Based Survey. JMIR Research Protocols, 8, e11865. https://doi.org/10.2196/11865
Blumenberg, C., Zugna, D., Popovic, M., Pizzi, C., Barros, A.J.D. and Richiardi, L. (2018) Questionnaire Breakoff and Item Nonresponse in Web-Based Questionnaires: Multilevel Analysis of Person-Level and Item Design Factors in a Birth Cohort. Journal of Medical Internet Research, 20, e11046. https://doi.org/10.2196/11046
Couper, M.P., Kapteyn, A., Schonlau, M. and Winter, J. (2007) Noncoverage and Nonresponse in an Internet Survey. Social Science Research, 36, 131-148. https://doi.org/10.1016/j.ssresearch.2005.10.002
Ekholm, O., Gundgaard, J., Rasmussen, N.K.R. and Hansen, E.H. (2010) The Effect of Health, Socio-Economic Position, and Mode of Data Collection on Non-Response in Health Interview Surveys. Scandinavian Journal of Public Health, 38, 699-706. https://doi.org/10.1177/1403494810382474
Goyder, J., Warriner, K. and Miller, S. (2002) Evaluating Socio-Economic Status (SES) Bias in Survey Nonresponse. Journal of Official Statistics-Stockholm, 18, 1-12.
Khazaal, Y., van Singer, M., Chatton, A., Achab, S., Zullino, D., Rothen, S., et al. (2014) Does Self-Selection Affect Samples’ Representativeness in Online Surveys? An Investigation in Online Video Game Research. Journal of Medical Internet Research, 16, e164. https://doi.org/10.2196/jmir.2759
Eurostat (2021) EU Survey on the Use of Information and Communication Technologies (ICT) in Households and by Individuals. https://ec.europa.eu/eurostat/cache/metadata/en/isoc_i_esms.htm
Morris, A. and Brading, H. (2007) E-Literacy and the Grey Digital Divide: A Review with Recommendations. Journal of Information Literacy, 1, 13-28. https://doi.org/10.11645/1.3.14
Sala, E., Gaia, A. and Cerati, G. (2020) The Gray Digital Divide in Social Networking Site Use in Europe: Results from a Quantitative Study. Social Science Computer Review, 40, 328-345. https://doi.org/10.1177/0894439320909507
Israel, B.A., Schulz, A.J., Parker, E.A. and Becker, A.B. (1998) Review of Community-Based Research: Assessing Partnership Approaches to Improve Public Health. Annual Review of Public Health, 19, 173-202. https://doi.org/10.1146/annurev.publhealth.19.1.173
Jelks, N.O., Jennings, V. and Rigolon, A. (2021) Green Gentrification and Health: A Scoping Review. International Journal of Environmental Research and Public Health, 18, Article No. 907. https://doi.org/10.3390/ijerph18030907
Mehdipanah, R., Marra, G., Melis, G. and Gelormino, E. (2017) Urban Renewal, Gentrification and Health Equity: A Realist Perspective. European Journal of Public Health, 28, 243-248. https://doi.org/10.1093/eurpub/ckx202
Schnake-Mahl, A.S., Jahn, J.L., Subramanian, S.V., Waters, M.C. and Arcaya, M. (2020) Gentrification, Neighborhood Change, and Population Health: A Systematic Review. Journal of Urban Health, 97, 1-25. https://doi.org/10.1007/s11524-019-00400-1
Cole, H.V.S., Garcia Lamarca, M., Connolly, J.J.T. and Anguelovski, I. (2017) Are Green Cities Healthy and Equitable? Unpacking the Relationship between Health, Green Space and Gentrification. Journal of Epidemiology and Community Health, 71, 1118-1121. https://doi.org/10.1136/jech-2017-209201
Kawachi, I. (2010) Social Capital and Health. In: Bird, C.E., Conrad, P., Fremont, A.M. and Timmermans, S., Eds., Handbook of Medical Sociology, 6th Edition, Vanderbilt University Press, 18-32. https://doi.org/10.2307/j.ctv16h2n9s.5
Sampson, R.J., Raudenbush, S.W. and Earls, F. (1997) Neighborhoods and Violent Crime: A Multilevel Study of Collective Efficacy. Science, 277, 918-924. https://doi.org/10.1126/science.277.5328.918
George, S., Duran, N. and Norris, K. (2014) A Systematic Review of Barriers and Facilitators to Minority Research Participation among African Americans, Latinos, Asian Americans, and Pacific Islanders. American Journal of Public Health, 104, e16-e31. https://doi.org/10.2105/ajph.2013.301706
Scharff, D.P., Mathews, K.J., Jackson, P., Hoffsuemmer, J., Martin, E. and Edwards, D. (2010) More than Tuskegee: Understanding Mistrust about Research Participation. Journal of Health Care for the Poor and Underserved, 21, 879-897. https://doi.org/10.1353/hpu.0.0323
Sharrocks, K., Spicer, J., Camidge, D.R. and Papa, S. (2014) The Impact of Socioeco-nomic Status on Access to Cancer Clinical Trials. British Journal of Cancer, 111, 1684-1687. https://doi.org/10.1038/bjc.2014.108
Battiston, P., Kashyap, R. and Rotondi, V. (2021) Reliance on Scientists and Experts during an Epidemic: Evidence from the COVID-19 Outbreak in Italy. SSM-Population Health, 13, Article 100721. https://doi.org/10.1016/j.ssmph.2020.100721
Gualano, M.R., Lo Moro, G., Voglino, G., Bert, F. and Siliquini, R. (2022) Is the Pandemic Leading to a Crisis of Trust? Insights from an Italian Nationwide Study. Public Health, 202, 32-34. https://doi.org/10.1016/j.puhe.2021.10.015
Lovari, A. (2020) Spreading (Dis)trust: Covid-19 Misinformation and Gov-ernment Intervention in Italy. Media and Communication, 8, 458-461. https://doi.org/10.17645/mac.v8i2.3219
Assirelli, G. (2014) Studiare di più rende cittadini migliori? Analisi della relazione tra istruzione e civicness in Italia. Scuola Democratica, 1, 29-52.
Alessi, E.J. and Martin, J.I. (2010) Conducting an Internet-Based Survey: Benefits, Pitfalls, and Lessons Learned. Social Work Research, 34, 122-128. https://doi.org/10.1093/swr/34.2.122
Seymer, A. and Weichbold, M. (2018) Social Inequalities and the Effects of In-centives on Survey Participation: A Recruitment Experiment. Österreichische Zeitschrift für Politikwissenschaft, 47, 5-20. https://doi.org/10.15203/ozp.2393.vol47iss2
Toepoel, V. and Schonlau, M. (2017) Dealing with Nonresponse: Strategies to Increase Participation and Methods for Postsurvey Adjustments. Mathematical Population Studies, 24, 79-83. https://doi.org/10.1080/08898480.2017.1299988
Groves, R.M., Cialdini, R.B. and Couper, M.P. (1992) Understanding the Decision to Participate in a Survey. Public Opinion Quarterly, 56, 475-495. https://doi.org/10.1086/269338
Marpsat, M. and Razafindratsima, N. (2010) Survey Methods for Hard-to-Reach Popu-lations: Introduction to the Special Issue. Methodological Innovations Online, 5, 3-16. https://doi.org/10.4256/mio.2010.0014