The need to strengthen the evaluation of the impact of Artificial Intelligence-based decision support systems on healthcare provision
Cresswell, Kathrin; Rigby, Michael; Magrabi, Farah; Scott, Philip; Brender, Jytte; Craven, Catherine K.; Wong, Zoie Shui Yee; Kukhareva, Polina; Ammenwerth, Elske; Georgiou, Andrew; Medlock, Stephanie; De Keizer, Nicolette F.; Nykänen, Pirkko; Prgomet, Mirela; Williams, Robin (2023-10)
Cresswell, Kathrin
Rigby, Michael
Magrabi, Farah
Scott, Philip
Brender, Jytte
Craven, Catherine K.
Wong, Zoie Shui Yee
Kukhareva, Polina
Ammenwerth, Elske
Georgiou, Andrew
Medlock, Stephanie
De Keizer, Nicolette F.
Nykänen, Pirkko
Prgomet, Mirela
Williams, Robin
10 / 2023
104889
Julkaisun pysyvä osoite on
https://urn.fi/URN:NBN:fi:tuni-202309278489
https://urn.fi/URN:NBN:fi:tuni-202309278489
Kuvaus
Non peer reviewed
Tiivistelmä
Despite the renewed interest in Artificial Intelligence-based clinical decision support systems (AI-CDS), there is still a lack of empirical evidence supporting their effectiveness. This underscores the need for rigorous and continuous evaluation and monitoring of processes and outcomes associated with the introduction of health information technology. We illustrate how the emergence of AI-CDS has helped to bring to the fore the critical importance of evaluation principles and action regarding all health information technology applications, as these hitherto have received limited attention. Key aspects include assessment of design, implementation and adoption contexts; ensuring systems support and optimise human performance (which in turn requires understanding clinical and system logics); and ensuring that design of systems prioritises ethics, equity, effectiveness, and outcomes. Going forward, information technology strategy, implementation and assessment need to actively incorporate these dimensions. International policy makers, regulators and strategic decision makers in implementing organisations therefore need to be cognisant of these aspects and incorporate them in decision-making and in prioritising investment. In particular, the emphasis needs to be on stronger and more evidence-based evaluation surrounding system limitations and risks as well as optimisation of outcomes, whilst ensuring learning and contextual review. Otherwise, there is a risk that applications will be sub-optimally embodied in health systems with unintended consequences and without yielding intended benefits.
Kokoelmat
- TUNICRIS-julkaisut [19288]