A Novel Mixed Methods Approach for Integrating Not-for-Profit Service Data via Qualitative Geographic Information System to Explore Authentic Experiences of Ill-Health: A Case Study of Rural Mental Health
Abstract
Meeting the mental health needs of rural populations is challenging internationally, with few methods and scarce data available to inform site-specific planning. We developed a mixed methods approach that integrates Not-for-profit (NFP) organization data in a Geographic Information System (GIS) to explore interrelated understandings of mental health experiences in rural places. Integrating qualitative experience data from online forums with quantitative data from service search and emergency pickup locations via GIS demonstrates how NFP health service data can be ethically sourced, reused, integrated, analyzed, and ground-truthed to explore how mental health is experienced in rural places. This article contributes to the mixed methods literature an ethical approach that utilizes NFP health service datasets to inform research in contexts of data scarcity.
References
Australian Bureau of Statistics. (2011). Australian population grid 2011. https://www.abs.gov.au/ausstats/abs@.nsf/mf/1270.0.55.007
Australian Bureau of Statistics. (2015). National health survey 2014-15. https://www.abs.gov.au/AUSSTATS/abs@.nsf/DetailsPage/4364.0.55.0012014-15
Australian Bureau of Statistics. (2016). Census of population and housing. https://www.abs.gov.au/statistics/people/aboriginal-and-torres-strait-islander-peoples/census-population-and-housing-counts-aboriginal-and-torres-strait-islander-australians/latest-release
Australian Bureau of Statistics. (2018). The Australian statistical geography standard (ASGS) remoteness structure. https://www.abs.gov.au/websitedbs/d3310114.nsf/home/australian+statistical+geography+standard+(asgs
Bain S. F., Munoz S.-A. (2020). 9 Rural mental health and global ethical perspectives. Mental Health and Wellbeing in Rural Regions: International Perspectives, 150.
Barbieri S., Jorm L. (2019). Travel times to hospitals in Australia. Scientific Data, 6, 248. https://doi.org/10.1038/s41597-019-0266-4
Bauer R., Bauer M., Spiessl H., Kagerbauer T. (2013). Cyber-support: An analysis of online self-help forums (online self-help forums in bipolar disorder). Nordic Journal of Psychiatry, 67(3), 185–190. https://doi.org/10.3109/08039488.2012.700734
Boslaugh S. (2007). Encyclopedia of epidemiology. Sage Publications.
Byrne L., Roper C., Happell B., Reid-Searl K. (2019). The stigma of identifying as having a lived experience runs before me: Challenges for lived experience roles. Journal of Mental Health, 28(3), 260–266. https://doi.org/10.1080/09638237.2016.1244715
Carbon S., Champieux R., McMurry J. A., Winfree L., Wyatt L. R., Haendel M. A. (2019). An analysis and metric of reusable data licensing practices for biomedical resources. Plos One, 14(3), Article e0213090. https://doi.org/10.1371/journal.pone.0213090
Citrin D., Mehanni S., Acharya B., Wong L., Nirola I., Sherchan R., Gauchan B., Karki K. B., Singh D. R., Shamasunder S., Le P., Schwarz D., Schwarz R., Dangal B., Dhungana S. K., Maru S., Mahar R., Thapa P., Raut A., Maru D. (2017). Power, potential, and pitfalls in global health academic partnerships: Review and reflections on an approach in Nepal. Global Health Action, 10(1), 1367161. https://doi.org/10.1080/16549716.2017.1367161
Cope M., Elwood S. (2009). Qualitative GIS: A mixed methods approach. Sage.
Cresswell-Smith J., Macintyre A. K., Wahlbeck K. (2021). Untapped potential? Action by non-governmental organisations on the social determinants of mental health in high-income countries: An integrative review. Voluntary Sector Review.
Creswell J. W. (1994). Research design. Sage.
Creswell J. W., Plano Clark V. L. (2017). Designing and conducting mixed methods research. Sage publications.
de Las Casas L., Gyateng T., Pritchard D. (2013). The power of data: Is the charity sector ready to plug in.
DeLyser D., Herbert S., Aitken S., Crang M., McDowell L. (2009). The SAGE handbook of qualitative geography. Sage.
D’Ignazio C., Klein L. F. (2016). Feminist data visualization. Workshop on visualization for the digital humanities (VIS4DH). IEEE,
D'Ignazio C., Klein L. F. (2020). Data feminism. Mit Press.
Elwood S. (2008). Volunteered geographic information: Future research directions motivated by critical, participatory, and feminist GIS. GeoJournal, 72(3), 173–183. https://doi.org/10.1007/s10708-008-9186-0
Elwood S. (2010). Mixed methods: Thinking, doing, and asking in multiple ways (Vol. 1). Sage.
Fernandez A., Gillespie J. A., Smith-Merry J., Feng X., Astell-Burt T., Maas C., Salvador-Carulla L. (2017). Integrated mental health atlas of the Western Sydney local health district: Gaps and recommendations. Australian Health Review, 41(1), 38–44. https://doi.org/10.1071/AH15154
Fetters M. D., Curry L. A., Creswell J. W. (2013). Achieving integration in mixed methods designs—Principles and practices. Health Services Research, 48(6 Pt 2), 2134–2156. https://doi.org/10.1111/1475-6773.12117
Fetters M. D., Freshwater D. (2015). The 1 + 1= 3 integration challenge. Journal of Mixed Methods Research, 9(2), 115–117. https://doi.org/10.1177/1558689815581222
Fielding N., Cisneros-Puebla C. A. (2009). CAQDAS-GIS convergence: Toward a new integrated mixed method research practice? Journal of Mixed Methods Research, 3(4), 349–370. https://doi.org/10.1177/1558689809344973
Ford E., Boyd A., Bowles J., Havard A., Aldridge R., Curcin V., Greiver M., Harron K., Katikireddi V., Rodgers S., Sperrin M. 2019). Our data, our society, our health: A vision for inclusive and transparent health data science in the United Kingdom and beyond. Learning Health Systems, 3(3), Article e10191. https://doi.org/10.1002/lrh2.10191
Gardiner F. W., Coleman M., Teoh N., Harwood A., Coffee N. T., Gale L., Bishop L., Laverty M. (2019). Aeromedical retrievals of people for mental health care and the low level of clinical support in rural and remote Australia. Medical Journal of Australia, 211(8), 351–356. https://doi.org/10.5694/mja2.50272
General Data Protection Regulation. (2018). Guide to general data protection regulation. https://www.gov.uk/government/publications/guide-to-the-general-data-protection-regulation
Gooding K. (2017). The role of NGOs’ service delivery experience in developing relevant research agendas: Experience and challenges among NGOs in Malawi. Health Research Policy and Systems, 15(1), 1–14. https://doi.org/10.1186/s12961-017-0199-3
Guetterman T. C., Fetters M. D., Creswell J. W. (2015). Integrating quantitative and qualitative results in health science mixed methods research through joint displays. The Annals of Family Medicine, 13(6), 554–561. https://doi.org/10.1370/afm.1865
Harris L. M. (2015). Deconstructing the map after 25 years: Furthering engagements with social theory. Cartographica: The International Journal for Geographic Information and Geovisualization, 50(1), 50–53. https://doi.org/10.3138/carto.50.1.10
Hawthorne T. L., Solís P., Terry B., Price M., Atchison C. L. (2015). Critical reflection mapping as a hybrid methodology for examining sociospatial perceptions of new research sites. Annals of the Association of American Geographers, 105(1), 22–47. https://doi.org/10.1080/00045608.2014.960041
Henderson J., Dawson S., Fuller J., O'Kane D., Gerace A., Oster C., Cochrane E. M. (2018). Regional responses to the challenge of delivering integrated care to older people with mental health problems in rural Australia. Aging & Mental Health, 22(8), 1025–1031. https://doi.org/10.1080/13607863.2017.1320702
Hickie I. B., Davenport T. A., Burns J. M., Milton A. C., Ospina-Pinillos L., Whittle L., Ricci C. S., McLoughlin L. T., Mendoza J., Cross S. P., Piper S. E., Iorfino F., LaMonica H. M. (2019). Project Synergy: Co‐designing technology‐enabled solutions for Australian mental health services reform. Medical Journal of Australia, 211(Suppl 7), S3–S39. https://doi.org/10.5694/mja2.50349
Hou Y., Wang D. (2017). Hacking with NPOs: Collaborative analytics and broker roles in civic data hackathons. Proceedings of the ACM on Human-Computer Interaction, 1(CSCW), 1–16. https://doi.org/10.1145/3134688
Ivankova N., Creswell J., Stick S. (2006). Using mixed-methods sequential explanatory design: From theory to practice. Field Methods, 18(1), 3–20. https://doi.org/10.1177/1525822x05282260
Ivankova N., Kawamura Y. (2010). Ev designs in the social, behavioral and health sciences. In A. Tashakkori & C. Teddlie (Eds.), The Sage handbook of mixed methods in social and behavioral research (2nd ed., pp. 581-611). London, England: SAGE.
Jung J. K., Elwood S. (2010). Extending the qualitative capabilities of GIS: Computer‐aided qualitative GIS. Transactions in GIS, 14(1), 63–87. https://doi.org/10.1111/j.1467-9671.2009.01182.x
Kamstra P., Cook B., Kennedy M. D., Brennan-Horley C. (2019). Qualitative GIS to relate perceptions with behaviors among Fishers on risky, rocky coasts. The Professional Geographer, 71(3), 491–506. https://doi.org/10.1080/00330124.2018.1559656
Knigge L., Cope M. (2006). Grounded visualization: Integrating the analysis of qualitative and quantitative data through grounded theory and visualization. Environment and Planning A, 38(11), 2021–2037. https://doi.org/10.1068/a37327
Kwan M.-P. (2002). Feminist visualization: Re-Envisioning GIS as a method in feminist geographic research. Annals of the Association of American Geographers, 92(4), 645–661. https://doi.org/10.1111/1467-8306.00309
Kwan M.-P., Ding G. (2008). Geo-Narrative: Extending geographic information systems for narrative analysis in qualitative and mixed-method research. The Professional Geographer, 60(4), 443–465. https://doi.org/10.1080/00330120802211752
Kwan M.-P., Knigge L. (2006). Doing qualitative research using GIS: An oxymoronic endeavor? Environment and Planning A, 38(11), 1999–2002. https://doi.org/10.1068/a38462
Lupton D. (2014). The commodification of patient opinion: The digital patient experience economy in the age of big data. Sociology of Health & Illness, 36(6), 856–869. https://doi.org/10.1111/1467-9566.12109
Mamykina L., Smaldone A., Bakken S. (2015). Adopting the sensemaking perspective for chronic disease self-management. Journal of Biomedical Informatics, 56, 406–417. https://doi.org/10.1016/j.jbi.2015.06.006
Masefield S. C., Megaw A., Barlow M., White P. C., Altink H., Grugel J. (2020). Repurposing NGO data for better research outcomes: A scoping review of the use and secondary analysis of NGO data in health policy and systems research. Health Research Policy and Systems, 18(1), 1–22. https://doi.org/10.1186/s12961-020-00577-x
Maxwell J. A. (2016). Expanding the history and range of mixed methods research. Journal of Mixed Methods Research, 10(1), 12–27. https://doi.org/10.1177/1558689815571132
Mennis J., Mason M. J., Cao Y. (2013). Qualitative GIS and the visualization of narrative activity space data. International Journal of Geographical Information Science, 27(2), 267–291. https://doi.org/10.1080/13658816.2012.678362
Moessner M., Feldhege J., Wolf M., Bauer S. (2018). Analyzing big data in social media: Text and network analyses of an eating disorder forum. International Journal of Eating Disorders, 51(7), 656–667. https://doi.org/10.1002/eat.22878
Nimrod G. (2013). Online depression communities: Members' interests and perceived benefits. Health Communication, 28(5), 425-434. https://doi.org/10.1080/10410236.2012.691068
O'Cathain A., Murphy E., Nicholl J. (2007). Integration and publications as indicators of" yield" from mixed methods studies. Journal of Mixed Methods Research, 1(2), 147–163. https://doi.org/10.1177/1558689806299094
O’Sullivan D. (2006). Geographical information science: Critical GIS. Progress in human geography, 30(6), 783–791. https://doi.org/10.1177/0309132506071528
Parliament of Australia. (2018). Senate Inquiry into Accessibility and quality of mental health services in rural and remote Australia. https://www.aph.gov.au/Parliamentary_Business/Committees/Senate/Community_Affairs/MentalHealthServices/Report
Pavlovskaya M. E. (2002). Mapping urban change and changing GIS: Other views of economic restructuring. Gender, Place and Culture: A Journal of Feminist Geography, 9(3), 281–289. https://doi.org/10.1080/0966369022000003897
Pickles J. (1995). Ground truth: The social implications of geographic information systems. Guilford Press.
Pierce C. S., Scherra E. (2012). The challenges of data collection in rural dwelling samples. Online Journal of Rural Nursing and Health Care, 4(2), 25–30.
Plano Clark V. L. (2010). The adoption and practice of mixed methods: US trends in federally funded health-related research. Qualitative Inquiry, 16(6), 428–440. https://doi.org/10.1177/1077800410364609
Poorthuis A., Zook M. (2015). Small stories in big data: Gaining insights from large spatial point pattern datasets. Cityscape, 17(1), 151–160. http://www.jstor.org/stable/26326929
Productivity Commission. (2020). Mental health (95). https://www.pc.gov.au/inquiries/completed/mental-health/report
Saunders T., Mulgan G. (2017). Governing with collective intelligence. Nesta.
Schuurman N. (2000). Trouble in the heartland: GIS and its critics in the 1990s. Progress in human geography, 24(4), 569-590. https://doi.org/10.1191/030913200100189111
Schuurman N. (2006). Formalization matters: Critical GIS and ontology research. Annals of the Association of American Geographers, 96(4), 726–739. https://doi.org/10.1111/j.1467-8306.2006.00513.x
Schuurman N., Kwan M.-P. (2004). Guest editorial: Taking a walk on the social side of GIS. Cartographica: The International Journal for Geographic Information and Geovisualization, 39(1), 1–3. https://doi.org/10.3138/k3j7-6171-j4k0-868j
Schuurman N., Leszczynski A. (2006). Ontology‐based metadata. Transactions in GIS, 10(5), 709–726. https://doi.org/10.1111/j.1467-9671.2006.01024.x
Sheppard E. (2005). Knowledge production through critical GIS: Genealogy and prospects. Cartographica: The International Journal for Geographic Information and Geovisualization, 40(4), 5–21. https://doi.org/10.3138/gh27-1847-qp71-7tp7
Stake R. E. (1995). The art of case study research. SAGE.
Sui D., Goodchild M. (2011). The convergence of GIS and social media: Challenges for GIScience. International Journal of Geographical Information Science, 25(11), 1737–1748. https://doi.org/10.1080/13658816.2011.604636
Susha I., Grönlund Å., Van Tulder R. (2019). Data driven social partnerships: Exploring an emergent trend in search of research challenges and questions. Government Information Quarterly, 36(1), 112–128. https://doi.org/10.1016/j.giq.2018.11.002
Susha I., Janssen M., Verhulst S. (2017). Data collaboratives as a new frontier of cross-sector partnerships in the age of open data: Taxonomy development. https://doi.org/10.24251/hicss.2017.325
Teddlie C., Yu F. (2007). Mixed methods sampling: A typology with examples. Journal of Mixed Methods Research, 1(1), 77–100. https://doi.org/10.1177/1558689806292430
Tripp W., Gage D., Williams H. (2020). Addressing the data analytics gap: A community-university partnership to enhance analytics capabilities in the non-profit sector. Collaborations: A Journal of Community-Based Research and Practice, 3(1). https://doi.org/10.33596/coll.58
Tucker I., Goodings L. (2018). Medicated bodies: Mental distress, social media and affect. new Media & Society, 20(2), 549–563. https://doi.org/10.1177/1461444816664347
Tucker I. M., Goodings L. (2017). Digital atmospheres: Affective practices of care in elefriends. Sociology of Health & Illness, 39(4), 629–642. https://doi.org/10.1111/1467-9566.12545
Urban Institute. (2020). In search of “good” rural data. https://www.urban.org/research/publication/search-good-rural-data
Van Dijck J., Poell T. (2016). Understanding the promises and premises of online health platforms. Big Data & Society, 3(1), 2053951716654173. https://doi.org/10.1177/2053951716654173
van Spijker B. A., Salinas-Perez J. A., Mendoza J., Bell T., Bagheri N., Furst M. A., Reynolds J., Rock D., Harvey A., Rosen A., Salvador-Carulla L. (2019). Service availability and capacity in rural mental health in Australia: Analysing gaps using an Integrated Mental Health Atlas. Australian & New Zealand Journal of Psychiatry, 53(10), 1000–1012. https://doi.org/10.1177/0004867419857809
Verhulst S., Young A. (2017). The potential of social media—Intelligence to improve people’s lives: Social media data for good. The GovLab Report, September.
Victoria State Government. (2020). Productivity commission mental health inquiry. https://www.pc.gov.au/inquiries/completed/mental-health#report
Voida A., Harmon E., Al-Ani B. (2011). Homebrew databases: Complexities of everyday information management in nonprofit organizations. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems.
Watkins D. C. (2022). Secondary data in mixed methods research. SAGE PUBN. https://books.google.com.au/books?id=btG-zgEACAAJ
Williams S. (2020). Data action: Using data for public good. MIT Press.
Yin R. K. (2014). Case study research: Design and methods (5th ed., Vol. 5). SAGE.
Zook M., Barocas S., Boyd D., Crawford K., Keller E., Gangadharan S., Goodman A., Hollander R., Koenig B., Metcalf J., Narayanan A, Nelson A, Pasquale F. (2017). Ten simple rules for responsible big data research. PLOS Computational Biology, 13(3), Article e1005399. https://doi.org/10.1371/journal.pcbi.1005399
Cite article
Cite article
Cite article
OR
Download to reference manager
If you have citation software installed, you can download article citation data to the citation manager of your choice
Information, rights and permissions
Information
Published In
Article first published online: October 21, 2022
Issue published: October 2023
Keywords
Authors
Metrics and citations
Metrics
Journals metrics
This article was published in Journal of Mixed Methods Research.
View All Journal MetricsArticle usage*
Total views and downloads: 1183
*Article usage tracking started in December 2016
Articles citing this one
Receive email alerts when this article is cited
Web of Science: 6 view articles Opens in new tab
Crossref: 4
- In This Issue: Tribute to Michael Fetters, Queer Approaches to Mixed M...
- Moderating mental health: Addressing the human–machine alignment probl...
- Community transformed? Exploring the interaction between online suppor...
- Online Mental Health Forums and Rural Resilience: Mixed Methods Study ...
- Wellness Impacts of Social Capital Built in Online Peer Support Forums
Figures and tables
Figures & Media
Figures
Media
Tables
View Options
Get access
Access options
If you have access to journal content via a personal subscription, university, library, employer or society, select from the options below:
I am signed in as:
View my profileSign out
I can access personal subscriptions, purchases, paired institutional access and free tools such as favourite journals, email alerts and saved searches.
Access journal content via a university, library or employer subscription.
AES and MMIRA members can access this journal content using society membership credentials.
Alternatively, view purchase options below:
Purchase 24 hour online access to view and download content.
Access journal content via a DeepDyve subscription or find out more about this option.
