Delphi methods as an approach in architecture research: Opportunities and pitfalls

Anisza Ratnasari; Yohanes Basuki Dwisusanto; Sahid

doi:10.30822/arteks.v11i1.4616

Authors

Anisza Ratnasari Parahyangan Catholic University , Pradita University
Yohanes Basuki Dwisusanto Parahyangan Catholic University
Sahid Parahyangan Catholic University

DOI:

https://doi.org/10.30822/arteks.v11i1.4616

Keywords:

Architectural research, Delphi methods, Expert consensus, Integrative literature review, Participatory approach

Abstract

Participatory approaches hold significant relevance within complex architectural research, serving as a vital link between theoretical inquiry and practical implementation. Among the prominent methods within this paradigm is the Delphi method, a systematic and iterative procedure that employs anonymous expert insights to cultivate collective agreement. While it has long been acknowledged for its strength in producing consensus, forecasting emerging tendencies, filtering conceptual propositions, and assessing issues that demand informed collective judgment, its utilization in architectural research remains comparatively limited. This study seeks to examine the Delphi method’s capabilities, delineate its strengths and constraints, and underscore its prospective contributions to architectural research practices. Employing a qualitative strategy through an integrative review of literature, data were gathered from 54 selected publications issued between 2000 and 2025. These data were subsequently interpreted using thematic content analysis. The results affirmed the Delphi method’s proficiency in generating impartial, multidisciplinary concurrence, its versatility in synthesizing diverse bodies of knowledge, and its particular relevance for navigating complex and future-oriented architectural challenges. Nevertheless, it also encounters obstacles such as participant withdrawal, the possibility of producing manufactured consensus, and inherent limitations in representing real-time social interactions. The methodological potential of the Delphi technique to broaden the boundaries of architectural research becomes even more substantial when combined with approaches such as the Analytic Hierarchy Process, Focus Group Discussions, or Q-Methodology.

Downloads

Download data is not yet available.

References

Afiyanti, Yati. 2008. “Focus Group Discussion (Diskusi Kelompok Terfokus) Sebagai Metode Pengumpulan Data Penelitian Kualitatif.” Jurnal Keperawatan Indonesia 12 (1): 58–62. https://doi.org/10.7454/jki.v12i1.201.

ALwaer, H., and D.J. Clements-Croome. 2010. “Key Performance Indicators (KPIs) and Priority Setting in Using the Multi-Attribute Approach for Assessing Sustainable Intelligent Buildings.” Building and Environment 45 (4): 799–807. https://doi.org/10.1016/j.buildenv.2009.08.019.

Arisman, Arman, Iwan Sudradjat, and Indah Widiastuti. 2024. “The Application of the Delphi Method in Architectural Research.” ARTEKS : Jurnal Teknik Arsitektur 9 (1): 29–36. https://doi.org/10.30822/arteks.v9i1.2556.

Bolger, Fergus, and George Wright. 2011. “Improving the Delphi Process: Lessons from Social Psychological Research.” Technological Forecasting and Social Change 78 (9): 1500–1513. https://doi.org/10.1016/j.techfore.2011.07.007.

Boulkedid, Rym, Hendy Abdoul, Marine Loustau, Olivier Sibony, and Corinne Alberti. 2011. “Using and Reporting the Delphi Method for Selecting Healthcare Quality Indicators: A Systematic Review.” Edited by James M. Wright. PLoS ONE 6 (6): e20476. https://doi.org/10.1371/journal.pone.0020476.

Brown, Timothy A. 2015. “Uses of Confirmatory Factor Analysis.” In Confirmatory Factor Analysis for Applied Research, 2nd ed., 1–9. New York: Guilford Publications.

Cameron, Bobby Thomas, and Clinton Hynes. 2024. “Expert Panels in Evaluation: An Update From the Field Using the DATA Model.” Canadian Journal of Program Evaluation 39 (1): 117–43. https://doi.org/10.3138/cjpe-2023-0047.

Chan, Puthearath. 2022. “An Empirical Study on Data Validation Methods of Delphi and General Consensus.” Data 7 (2): 18. https://doi.org/10.3390/data7020018.

Charlton, Helen. 2018. “Using Consensus Workshop in the Classroom: Promoting Participation and Collaboration in Large Group Settings.” Management Teaching Review 3 (4): 346–53. https://doi.org/10.1177/2379298117746044.

Damio, Siti Maftuhah. 2016. “Q Methodology: An Overview and Steps to Implementation.” Asian Journal of University Education 7:106–22.

Dinnesen, Megan Schneider, Arnold Olszewski, Allison Breit-Smith, and Ying Guo. 2020. “Collaborating With an Expert Panel to Establish the Content Validity of an Intervention for Preschoolers With Language Impairment.” Communication Disorders Quarterly 41 (2): 86–99. https://doi.org/10.1177/1525740118795158.

Dixon, Jane, and Mark Lazenby. 2023. “Expert Panel Content Validation for Evidence-Based Projects: Adaptation of the Content Validity Index.” https://doi.org/10.2139/ssrn.4360675.

Donohoe, Holly, Michael Stellefson, and Bethany Tennant. 2012. “Advantages and Limitations of the E-Delphi Technique.” American Journal of Health Education 43 (1): 38–46. https://doi.org/10.1080/19325037.2012.10599216.

Fang, Chen, and Liwen Chen. 2018. “Q-Methodology.” EURASIA Journal of Mathematics, Science and Technology Education 14 (6). https://doi.org/10.29333/ejmste/90555.

Goodman, Claire M. 1987. “The Delphi Technique: A Critique.” Journal of Advanced Nursing 12 (6): 729–34. https://doi.org/10.1111/j.1365-2648.1987.tb01376.x.

Gordon, Theodore Jay. 1994. “The Delphi Method.” Futures Research Methodology 1 (1): 1–33.

Green, Ravonne A. 2014. “The Delphi Technique in Educational Research.” Sage Open 4 (2). https://doi.org/10.1177/2158244014529773.

Groat, Linda N., and David Wang. 2013. Architectural Research Methods. 2nd ed. New Jersey: John Wiley & Sons, Inc.

Hsu, C., and B. A. Sandford. 2007. “The Delphi Technique: Making Sense of Consensus.” Practical Assessment, Research, and Evaluation 12 (10): 1–8.

Islam, Rafikul. 2010. “Group Decision Making through Nominal Group Technique: An Empirical Study.” J. for International Business and Entrepreneurship Development 5 (2): 134. https://doi.org/10.1504/JIBED.2010.036998.

J. Skulmoski, Gregory, Francis T. Hartman, and Jennifer Krahn. 2007. “The Delphi Method for Graduate Research.” Journal of Information Technology Education: Research 6:001–021. https://doi.org/10.28945/199.

Keeney, Sinead, Felicity Hasson, and Hugh McKenna. 2011. The Delphi Technique in Nursing and Health Research. Wiley. https://doi.org/10.1002/9781444392029.

Kindon, Sara, Rachel Pain, and Mike Kesby. 2007. Participatory Action Research Approaches and Methods. 1st ed. London: Routledge.

KOZAK, Anna, and Aldona FRĄCZKIEWICZ-WRONKA. 2023. “Practical Application of The Delphi Method to Identify Key Factors of Social Change Implementation.” Scientific Papers of Silesian University of Technology. Organization and Management Series 2023 (177): 339–50. https://doi.org/10.29119/1641-3466.2023.177.19.

Landeta, Jon. 2006. “Current Validity of the Delphi Method in Social Sciences.” Technological Forecasting and Social Change 73 (5): 467–82. https://doi.org/10.1016/j.techfore.2005.09.002.

Linstone, Harold A., and Murray Turoff. 2002. “The Delphi Method Techniques and Applications.” In The Social And Health Sciences: Concepts, Applications and Case Studies, 1st ed. Boston: Addison-Wesley.

Melnikovas, Aleksandras. 2018. “Towards an Explicit Research Methodology: Adapting Research Onion Model for Futures Studies.” Journal of Futures Studies 23 (2): 29–44.

Meyrick, Julian de. 2003. “The Delphi Method and Health Research.” Health Education 103 (1): 7–16. https://doi.org/10.1108/09654280310459112.

Mohamed Yusoff, Ahmad Fkrudin, Azmil Hashim, Norhisham Muhamad, and Wan Norina Wan Hamat. 2021. “Application of Fuzzy Delphi Technique Towards Designing and Developing the Elements for the E-PBM PI-Poli Module.” Asian Journal of University Education 17 (1): 292. https://doi.org/10.24191/ajue.v17i1.12625.

Mukherjee, Nibedita, Jean Hugé, William J. Sutherland, Jeffrey McNeill, Maarten Van Opstal, Farid Dahdouh‐Guebas, and Nico Koedam. 2015. “The Delphi Technique in Ecology and Biological Conservation: Applications and Guidelines.” Edited by Barbara Anderson. Methods in Ecology and Evolution 6 (9): 1097–1109. https://doi.org/10.1111/2041-210X.12387.

Musa, Haruna Danladi, Mohd Rusli Yacob, Ahmad Makmom Abdullah, and Mohd Yusoff Ishak. 2015. “Delphi Method of Developing Environmental Well-Being Indicators for the Evaluation of Urban Sustainability in Malaysia.” Procedia Environmental Sciences 30:244–49. https://doi.org/10.1016/j.proenv.2015.10.044.

Niederberger, Marlen, Julia Schifano, Stefanie Deckert, Julian Hirt, Angelika Homberg, Stefan Köberich, Rainer Kuhn, Alexander Rommel, and Marco Sonnberger. 2024. “Delphi Studies in Social and Health Sciences—Recommendations for an Interdisciplinary Standardized Reporting (DELPHISTAR). Results of a Delphi Study.” Edited by Monica Duarte Correia de Oliveira. PLOS ONE 19 (8): e0304651. https://doi.org/10.1371/journal.pone.0304651.

Okoli, Chitu, and Suzanne D. Pawlowski. 2004. “The Delphi Method as a Research Tool: An Example, Design Considerations and Applications.” Information & Management 42 (1): 15–29. https://doi.org/10.1016/j.im.2003.11.002.

Powell, Catherine. 2003. “The Delphi Technique: Myths and Realities.” Journal of Advanced Nursing 41 (4): 376–82. https://doi.org/10.1046/j.1365-2648.2003.02537.x.

Puri, Gobinda. 2023. “Participatory Action Research in Social Sciences and Education.” Journal of NELTA Gandaki 6 (1–2): 66–77. https://doi.org/10.3126/jong.v6i1-2.59713.

Rahmat, Abdul, and Mira Mirnawati. 2020. “Model Participation Action Research Dalam Pemberdayaan Masyarakat.” Aksara: Jurnal Ilmu Pendidikan Nonformal 6 (1): 62. https://doi.org/10.37905/aksara.6.1.62-71.2020.

Rowe, Gene, George Wright, and Fergus Bolger. 1991. “Delphi: A Reevaluation of Research and Theory.” Technological Forecasting and Social Change 39 (3): 235–51. https://doi.org/10.1016/0040-1625(91)90039-I.

Saaty, Thomas L. 2008. “Decision Making with the Analytic Hierarchy Process.” International Journal of Services Sciences 1 (1): 83. https://doi.org/10.1504/IJSSCI.2008.017590.

Saaty, Thomas L., and Luis G. Vargas. 2012. Models, Methods, Concepts & Applications of the Analytic Hierarchy Process. Vol. 175. International Series in Operations Research & Management Science. Boston, MA: Springer US. https://doi.org/10.1007/978-1-4614-3597-6.

Salura, Purnama, and Stephanie Clarissa. 2024. ‘Re-Interpreting the Case Study Approach in Architectural Research’. ARTEKS : Jurnal Teknik Arsitektur 9 (1): 109–20. https://doi.org/10.30822/arteks.v9i1.3195.

———. 2025. ‘Formulating Architectural Ethnosemantics as a New Research Method’. ARTEKS : Jurnal Teknik Arsitektur 9 (3): 477–90. https://doi.org/10.30822/arteks.v9i3.3809.

Sanoff, Henry. 2000. Community Participation Methods in Design and Planning. 1st ed. New York: Wiley and Sons, Inc.

Shabina, Sachdeva, Tamrakar Kumar Amit, and Perwez Eram. 2024. “Focus Group Discussion: An Emerging Qualitative Tool for Educational Research.” International Journal of Research and Review 11 (9): 302–8. https://doi.org/10.52403/ijrr.20240932.

Shang, Zhida. 2023. “Use of Delphi in Health Sciences Research: A Narrative Review.” Medicine 102 (7): e32829. https://doi.org/10.1097/MD.0000000000032829.

Sossa, Jhon Wilder Zartha, Jorge Alonso Manrique Henao, Juan Manuel, Montes Hincapie, Juan Carlos Palacio Piedrahita, Gina Lia Orozco, and Mendoza. 2020. “Delphi Method in Emerging Technologies.” International Journal of Innovation, Creativity and Change 14 (10): 1210–30.

Sudradjat, Iwan. 2020. ‘Theory in Architectural Research’. ARTEKS : Jurnal Teknik Arsitektur 5 (1): i–vi. https://doi.org/10.30822/arteks.v5i1.378.

Vahedian-Shahroodi, Mohammad, Azam Mansourzadeh, Sedigheh Shariat Moghani, and Masumeh Saeidi. 2023. “Using the Nominal Group Technique in Group Decision-Making: A Review.” Medicine Education Bulletin 4 (14): 837–45.

Wang, Xiaoman, John Hampton, Albert D. Ritzhaupt, and Kara Dawson. 2022. “Trends and Priorities of Educational Technology Research: A Delphi Study.” Contemporary Educational Technology 14 (4): ep383. https://doi.org/10.30935/cedtech/12317.

Watts, Simon, and Paul Stenner. 2012. Doing Q Methodological Research: Theory, Method and Interpretation. 1 Oliver’s Yard, 55 City Road, London EC1Y 1SP United Kingdom: SAGE Publications Ltd. https://doi.org/10.4135/9781446251911.

Weimer-Jehle, Wolfgang. 2006. “Cross-Impact Balances: A System-Theoretical Approach to Cross-Impact Analysis.” Technological Forecasting and Social Change 73 (4): 334–61. https://doi.org/10.1016/j.techfore.2005.06.005.

Widodo, Johannes. 2019. ‘Human, Nature, And Architecture’. ARTEKS : Jurnal Teknik Arsitektur 3 (2): 145–48. https://doi.org/10.30822/arteks.v3i2.65.

Yu, Dejian, and Xiyue Hong. 2022. “A Theme Evolution and Knowledge Trajectory Study in AHP Using Science Mapping and Main Path Analysis.” Expert Systems with Applications 205 (November):117675. https://doi.org/10.1016/j.eswa.2022.117675.