The integration of AI into decision-making processes offers substantial benefits, particularly in enhancing accuracy and efficiency. However, long-term consequences, such as over-reliance, skill erosion, and loss of human agency, present significant challenges. This study investigates various human-AI collaboration protocols – traditional, inhibition, displacement, and replacement – across multiple medical settings, including radiological imaging, ECG, and endoscopy. We introduce a novel framework that includes a choice nomogram and qualitative assessment tool, designed to optimize both decision accuracy and socio-technical impacts. Our findings reveal that the displacement protocol consistently outperformed others in several contexts, achieving 87% accuracy in MRI analysis, 89% in x-ray reading and 85% in endoscopy; conversely, the traditional protocol was most effective only in ECG analysis, with 82% accuracy. These results demonstrate that no single protocol is universally optimal, highlighting the need for context-specific selection to ensure effective and sustainable AI-supported decision-making, with a focus on balancing short-term performance with long-term human factors.

Cabitza, F., Campagner, A., Fregosi, C., Cameli, M., Gallazzi, E., Sconfienza, L., et al. (2025). Five Degrees of Separation: Investigating the Unexpected Potential of Displaced Human-AI Collaboration Protocols for Apter AI Support. PROCEEDINGS OF THE ACM ON HUMAN-COMPUTER INTERACTION, 9(7), 1-28 [10.1145/3757601].

Five Degrees of Separation: Investigating the Unexpected Potential of Displaced Human-AI Collaboration Protocols for Apter AI Support

Cabitza F.
Co-primo
;
Campagner A.
Co-primo
;
Fregosi C.;
2025

Abstract

The integration of AI into decision-making processes offers substantial benefits, particularly in enhancing accuracy and efficiency. However, long-term consequences, such as over-reliance, skill erosion, and loss of human agency, present significant challenges. This study investigates various human-AI collaboration protocols – traditional, inhibition, displacement, and replacement – across multiple medical settings, including radiological imaging, ECG, and endoscopy. We introduce a novel framework that includes a choice nomogram and qualitative assessment tool, designed to optimize both decision accuracy and socio-technical impacts. Our findings reveal that the displacement protocol consistently outperformed others in several contexts, achieving 87% accuracy in MRI analysis, 89% in x-ray reading and 85% in endoscopy; conversely, the traditional protocol was most effective only in ECG analysis, with 82% accuracy. These results demonstrate that no single protocol is universally optimal, highlighting the need for context-specific selection to ensure effective and sustainable AI-supported decision-making, with a focus on balancing short-term performance with long-term human factors.
Articolo in rivista - Articolo scientifico
Decision making; Evidence-based design; Human-AI collaboration protocols; Human-AI interaction;
English
16-ott-2025
2025
9
7
1
28
CSCW420
open
Cabitza, F., Campagner, A., Fregosi, C., Cameli, M., Gallazzi, E., Sconfienza, L., et al. (2025). Five Degrees of Separation: Investigating the Unexpected Potential of Displaced Human-AI Collaboration Protocols for Apter AI Support. PROCEEDINGS OF THE ACM ON HUMAN-COMPUTER INTERACTION, 9(7), 1-28 [10.1145/3757601].
File in questo prodotto:
File Dimensione Formato  
Cabitza et al-2025-ACM on Human-Computer Interaction-VoR.pdf

accesso aperto

Descrizione: This work is licensed under a Creative Commons Attribution 4.0 International License. © 2025 Copyright held by the owner/author(s).
Tipologia di allegato: Publisher’s Version (Version of Record, VoR)
Licenza: Creative Commons
Dimensione 4.18 MB
Formato Adobe PDF
4.18 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/576022
Citazioni
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
Social impact