Optimising strategies for artificial intelligence-assisted classification of viral pneumonias on CT imaging : a comparative study of selective and default approaches

2025
journal article
article
dc.abstract.enPurpose: To evaluate how different artificial intelligence (AI)-powered approaches affect human performance in a demanding chest computed tomography (CT) task, such as distinguishing between viral pneumonias. Material and methods: Three radiologists blindly evaluated 220 chest CT scans of viral pneumonia cases (n = 151 COVID-19; n = 69 other viruses), classifying them with a probabilistic scoring system (COVID-19 Reporting and Data System – CO-RADS) in 2 phases: before (S1) and after (S2) receiving AI classifier results. Two S2 scenarios were investigated: a default approach, with AI predictions available for all cases, and a selective approach, with AI limited to equivocal S1 cases (CO-RADS = 3). Inter-reader agreement (Gwet’s AC2) and diagnostic performance were analysed. Results: Radiologists demonstrated good-to-excellent agreement across all scenarios (AC2 = 0.77-0.81). Evaluation changes between S1 and S2 occurred in 18% of cases, with 29% of cases initially classified as CO-RADS = 3. In these equivocal cases, AI led to an average correct classification rate of 85%. Conversely, when radiologists were confident in their S1 diagnoses (CO-RADS ≠ 3), classification changes in S2 occurred in 7% of cases, preventing incorrect diagnoses in 45% of patients but resulting in missed correct classifications in 55%. Regarding diagnostic performance, S1 accuracy was 78%, with 15% of CO-RADS = 3 cases. In S2, under the default approach, accuracy increased to 81%, with 16% of CO-RADS = 3 cases, whereas the selective approach achieved 79% accuracy with only 10% of CO-RADS = 3 cases. Only the selective approach significantly reduced the proportion of equivocal cases (p < 0.009). Conclusions: A selective AI approach effectively reduces diagnostic uncertainty without introducing unnecessary complexity, emphasising its potential to optimise radiological workflows in challenging diagnostic scenarios.
dc.contributor.authorRizzetto, Francesco
dc.contributor.authorBerta, Luca
dc.contributor.authorZorzi, Giulia
dc.contributor.authorTravaglini, Francesca
dc.contributor.authorArtioli, Diana
dc.contributor.authorCarbonaro, Luca Alessandro
dc.contributor.authorNerini Molteni, Silvia
dc.contributor.authorVismara, Chiara
dc.contributor.authorTorresin, Alberto
dc.contributor.authorColombo, Paola Enrica
dc.contributor.authorVanzulli, Angelo
dc.date.accessioned2025-08-29T06:25:21Z
dc.date.available2025-08-29T06:25:21Z
dc.date.createdat2025-08-29T06:25:21Zen
dc.date.issued2025
dc.date.openaccess0
dc.description.accesstimew momencie opublikowania
dc.description.additionalBibliogr. s. e392-e393
dc.description.physicale384-e393
dc.description.versionostateczna wersja wydawcy
dc.description.volume90
dc.identifier.doi10.5114/pjr/205344
dc.identifier.issn1733-134X
dc.identifier.projectDRC AI
dc.identifier.urihttps://ruj.uj.edu.pl/handle/item/559412
dc.languageeng
dc.language.containereng
dc.rightsUdzielam licencji. Uznanie autorstwa - Użycie niekomercyjne - Bez utworów zależnych 4.0 Międzynarodowa
dc.rights.licenceCC-BY-NC-ND
dc.rights.urihttp://creativecommons.org/licenses/by-nc-nd/4.0/legalcode.pl
dc.share.typeotwarte czasopismo
dc.subject.enartificial intelligence
dc.subject.enlung
dc.subject.enchest CT
dc.subject.enclassification
dc.subject.enviral pneumonia
dc.subtypeArticle
dc.titleOptimising strategies for artificial intelligence-assisted classification of viral pneumonias on CT imaging : a comparative study of selective and default approaches
dc.title.journalPolish Journal of Radiology
dc.typeJournalArticle
dspace.entity.typePublicationen
dc.abstract.en
Purpose: To evaluate how different artificial intelligence (AI)-powered approaches affect human performance in a demanding chest computed tomography (CT) task, such as distinguishing between viral pneumonias. Material and methods: Three radiologists blindly evaluated 220 chest CT scans of viral pneumonia cases (n = 151 COVID-19; n = 69 other viruses), classifying them with a probabilistic scoring system (COVID-19 Reporting and Data System – CO-RADS) in 2 phases: before (S1) and after (S2) receiving AI classifier results. Two S2 scenarios were investigated: a default approach, with AI predictions available for all cases, and a selective approach, with AI limited to equivocal S1 cases (CO-RADS = 3). Inter-reader agreement (Gwet’s AC2) and diagnostic performance were analysed. Results: Radiologists demonstrated good-to-excellent agreement across all scenarios (AC2 = 0.77-0.81). Evaluation changes between S1 and S2 occurred in 18% of cases, with 29% of cases initially classified as CO-RADS = 3. In these equivocal cases, AI led to an average correct classification rate of 85%. Conversely, when radiologists were confident in their S1 diagnoses (CO-RADS ≠ 3), classification changes in S2 occurred in 7% of cases, preventing incorrect diagnoses in 45% of patients but resulting in missed correct classifications in 55%. Regarding diagnostic performance, S1 accuracy was 78%, with 15% of CO-RADS = 3 cases. In S2, under the default approach, accuracy increased to 81%, with 16% of CO-RADS = 3 cases, whereas the selective approach achieved 79% accuracy with only 10% of CO-RADS = 3 cases. Only the selective approach significantly reduced the proportion of equivocal cases (p < 0.009). Conclusions: A selective AI approach effectively reduces diagnostic uncertainty without introducing unnecessary complexity, emphasising its potential to optimise radiological workflows in challenging diagnostic scenarios.
dc.contributor.author
Rizzetto, Francesco
dc.contributor.author
Berta, Luca
dc.contributor.author
Zorzi, Giulia
dc.contributor.author
Travaglini, Francesca
dc.contributor.author
Artioli, Diana
dc.contributor.author
Carbonaro, Luca Alessandro
dc.contributor.author
Nerini Molteni, Silvia
dc.contributor.author
Vismara, Chiara
dc.contributor.author
Torresin, Alberto
dc.contributor.author
Colombo, Paola Enrica
dc.contributor.author
Vanzulli, Angelo
dc.date.accessioned
2025-08-29T06:25:21Z
dc.date.available
2025-08-29T06:25:21Z
dc.date.createdaten
2025-08-29T06:25:21Z
dc.date.issued
2025
dc.date.openaccess
0
dc.description.accesstime
w momencie opublikowania
dc.description.additional
Bibliogr. s. e392-e393
dc.description.physical
e384-e393
dc.description.version
ostateczna wersja wydawcy
dc.description.volume
90
dc.identifier.doi
10.5114/pjr/205344
dc.identifier.issn
1733-134X
dc.identifier.project
DRC AI
dc.identifier.uri
https://ruj.uj.edu.pl/handle/item/559412
dc.language
eng
dc.language.container
eng
dc.rights
Udzielam licencji. Uznanie autorstwa - Użycie niekomercyjne - Bez utworów zależnych 4.0 Międzynarodowa
dc.rights.licence
CC-BY-NC-ND
dc.rights.uri
http://creativecommons.org/licenses/by-nc-nd/4.0/legalcode.pl
dc.share.type
otwarte czasopismo
dc.subject.en
artificial intelligence
dc.subject.en
lung
dc.subject.en
chest CT
dc.subject.en
classification
dc.subject.en
viral pneumonia
dc.subtype
Article
dc.title
Optimising strategies for artificial intelligence-assisted classification of viral pneumonias on CT imaging : a comparative study of selective and default approaches
dc.title.journal
Polish Journal of Radiology
dc.type
JournalArticle
dspace.entity.typeen
Publication
Affiliations

* The migration of download and view statistics prior to the date of April 8, 2024 is in progress.

Views
6
Views per month
Views per city
Krakow
5
Perth
1
Downloads
rizzetto_et-al_optimising_strategies_for_artificial_2025.pdf
5