A MULTIDIMENSIONAL FRAMEWORK FOR EVALUATING ARTIFICIAL INTELLIGENCE IN HEALTHCARE GOVERNANCE
##plugins.themes.bootstrap3.article.main##
##plugins.themes.bootstrap3.article.sidebar##
Abstract
Artificial intelligence (AI) is increasingly used to support healthcare governance by improving planning, resource allocation, policy development, and organizational decision-making. However, existing approaches to AI evaluation remain largely focused on technical performance and clinical effectiveness, providing limited guidance for assessing AI systems used in healthcare management and public administration. This study aims to develop a multidimensional framework for evaluating the effectiveness of AI in healthcare governance. The study is based on a narrative review and synthesis of contemporary scientific literature, international guidelines, health technology assessment frameworks, and AI governance recommendations. The proposed framework integrates six complementary evaluation dimensions: technical, clinical, organizational, economic, governance, and ethical. For each dimension, key evaluation objectives and recommended indicators are identified based on evidence from international methodological frameworks and recent research. The framework is intended to support healthcare managers, policymakers, researchers, and healthcare organizations in conducting comprehensive assessments of AI systems throughout their lifecycle. Unlike existing approaches that typically evaluate individual aspects of AI implementation, the proposed framework combines multiple evaluation perspectives into a unified model specifically tailored to healthcare governance. The findings contribute to the development of standardized approaches for evaluating AI-enabled decision support systems and may facilitate more evidence-informed adoption of AI technologies in healthcare management.
How to Cite
##plugins.themes.bootstrap3.article.details##
artificial intelligence; healthcare governance; healthcare management; eval- uation framework; digital health; decision-making; public administration.
2. Boverhof, B. J., Redekop, W. K., Visser, J. J., Uylde Groot, C. A., & Ruttenvan Mölken, M. P. (2024). Broadening the HTA of medical AI: a review of the literature to inform a tailored approach. Health Policy and Technology, 13(2), 100868. https://doi.org/10.1016/j.tech- soc.2024.102481
3. Cresswell, K., Williams, R., Dungey, S., Anderson, S., Bernabeu, M. O., Mozaffar, H., … & Eason, S. (2025). A mixed methods formative evaluation of the United Kingdom National Health Service Artificial Intelligence Lab. npj Digital Medicine, 8(1), 448. https://doi.org/10.1038/ s41746-025-01805-w
4. Di Bidino, R., Daugbjerg, S., Papavero, S. C., Haraldsen, I. H., Cicchetti, A., & Sacchini, D. (2024). Health technology assessment framework for artificial intelligence-based technol- ogies. International journal of technology assessment in health care, 40(1), e61. https://doi. org/10.1017/S0266462324000308
5. Duggan, M. J., Gervase, J., Schoenbaum, A., Hanson, W., Howell III, J. T., Sheinberg, M., & Johnson, K. B. (2025). Clinician experiences with ambient scribe technology to assist with documentation burden and efficiency. JAMA Network Open, 8(2), e2460637. https://doi. org/10.1001/jamanetworkopen.2024.60637
6. El Arab, R. A., & Al Moosa, O. A. (2025). Systematic review of cost effectiveness and budget impact of artificial intelligence in healthcare. NPJ Digital Medicine, 8(1), 548. https://doi. org/10.1038/s41746-025-01722-y
7. European Union. Artificial Intelligence Act (Regulation (EU) 2024/1689). https://eur-lex. europa.eu/legal-content/EN/TXT/?uri=CELEX%3A32024R1689
8. Habehh, H., & Gohel, S. (2021). Machine learning in healthcare. Current genomics, 22(4), 291-300. https://doi.org/10.2174/1389202922666210705124359
9. Hirani, R., Noruzi, K., Khuram, H., Hussaini, A. S., Aifuwa, E. I., Ely, K. E., Lewis, J. M., Gabr, A. E., Smiley, A., Tiwari, R. K., & Etienne, M. (2024). Artificial Intelligence and Healthcare: A Journey through History, Present Innovations, and Future Possibilities. Life, 14(5), 557. https://doi.org/10.3390/life14050557
10. Lekadir, K., Frangi, A. F., Porras, A. R., Glocker, B., Cintas, C., Langlotz, C. P., … & Starmans, M. P. (2025). FUTURE-AI: international consensus guideline for trustworthy and deployable artificial intelligence in healthcare. bmj, 388. https://doi.org/10.1136/bmj-2024-081554
11. Morley, J., Morton, C., Karpathakis, K., Taddeo, M., & Floridi, L. (2021). Towards a framework for evaluating the safety, acceptability and efficacy of AI systems for health: an initial synthesis. arXiv preprint arXiv:2104.06910. https://doi.org/10.48550/arXiv.2104.06910
12. National Institute of Standards and Technology. (2023). Artificial Intelligence Risk Management Framework (AI RMF 1.0). https://nvlpubs.nist.gov/nistpubs/ai/nist.ai.100-1.pdf
13. OECD. (2021). State of implementation of the OECD AI Principles: Insights from national AI policies (OECD Digital Economy Papers No. 311). OECD Publishing. https://doi. org/10.1787/1cd40c44-en
14. Qian, Z., Alaa, A. M., & van der Schaar, M. (2021). CPAS: the UK’s national machine learning-based hospital capacity planning system for COVID-19. Machine Learning, 110(1), 15-35.
15. Quigley, A., Honeyman, M. D., Stone, M. H., Dawson, R., & MacIntyre, C. R. (2025). EPI- WATCH, an artificial intelligence early-warning system as a valuable tool in outbreak surveillance. International Journal of Infectious Diseases, 152, 107579.
16. Sounderajah, V., Guni, A., Liu, X., Collins, G. S., Karthikesalingam, A., Markar, S. R., … & Ashrafian, H. (2025). The STARD-AI reporting guideline for diagnostic accuracy studies using artificial intelligence. Nature medicine, 31(10), 3283-3289. https://doi.org/10.1038/ s41591-025-03953-8
17. Vasey, B., Nagendran, M., Campbell, B., Clifton, D. A., Collins, G. S., Denaxas, S., … & McCulloch, P. (2022). Reporting guideline for the early stage clinical evaluation of decision support systems driven by artificial intelligence: DECIDE-AI. bmj, 377. https://doi.org/10.1136/ bmj-2022-070904
18. Wells, B. J., Nguyen, H. M., McWilliams, A., Pallini, M., Bovi, A., Kuzma, A., … & Isreal, M. (2025). A practical framework for appropriate implementation and review of artificial intelligence (FAIR-AI) in healthcare. NPJ Digital Medicine, 8(1), 514. https://doi.org/10.1038/ s41746-025-01900-y
19. Williams, G. S., Koua, E. L., Abdelmalik, P., Kambale, F., Kibangou, E., Nguna, J., … & Gueye, A. S. (2025). Evaluation of the epidemic intelligence from open sources (EIOS) system for the early detection of outbreaks and health emergencies in the African region. BMC Public Health, 25(1), 857.
20. World Health Organization. (2021). Ethics and governance of artificial intelligence for health. World Health Organization. https://www.who.int/publications/i/item/9789240029200
21. World Health Organization. (2023). Regulatory considerations on artificial intelligence for health. World Health Organization. https://www.who.int/publications/i/item/9789240078871