Simple view
Full metadata view
Authors
Statistics
Optimising strategies for artificial intelligence-assisted classification of viral pneumonias on CT imaging : a comparative study of selective and default approaches
artificial intelligence
lung
chest CT
classification
viral pneumonia
Bibliogr. s. e392-e393
Purpose: To evaluate how different artificial intelligence (AI)-powered approaches affect human performance in a demanding chest computed tomography (CT) task, such as distinguishing between viral pneumonias. Material and methods: Three radiologists blindly evaluated 220 chest CT scans of viral pneumonia cases (n = 151 COVID-19; n = 69 other viruses), classifying them with a probabilistic scoring system (COVID-19 Reporting and Data System – CO-RADS) in 2 phases: before (S1) and after (S2) receiving AI classifier results. Two S2 scenarios were investigated: a default approach, with AI predictions available for all cases, and a selective approach, with AI limited to equivocal S1 cases (CO-RADS = 3). Inter-reader agreement (Gwet’s AC2) and diagnostic performance were analysed. Results: Radiologists demonstrated good-to-excellent agreement across all scenarios (AC2 = 0.77-0.81). Evaluation changes between S1 and S2 occurred in 18% of cases, with 29% of cases initially classified as CO-RADS = 3. In these equivocal cases, AI led to an average correct classification rate of 85%. Conversely, when radiologists were confident in their S1 diagnoses (CO-RADS ≠ 3), classification changes in S2 occurred in 7% of cases, preventing incorrect diagnoses in 45% of patients but resulting in missed correct classifications in 55%. Regarding diagnostic performance, S1 accuracy was 78%, with 15% of CO-RADS = 3 cases. In S2, under the default approach, accuracy increased to 81%, with 16% of CO-RADS = 3 cases, whereas the selective approach achieved 79% accuracy with only 10% of CO-RADS = 3 cases. Only the selective approach significantly reduced the proportion of equivocal cases (p < 0.009). Conclusions: A selective AI approach effectively reduces diagnostic uncertainty without introducing unnecessary complexity, emphasising its potential to optimise radiological workflows in challenging diagnostic scenarios.
dc.abstract.en | Purpose: To evaluate how different artificial intelligence (AI)-powered approaches affect human performance in a demanding chest computed tomography (CT) task, such as distinguishing between viral pneumonias. Material and methods: Three radiologists blindly evaluated 220 chest CT scans of viral pneumonia cases (n = 151 COVID-19; n = 69 other viruses), classifying them with a probabilistic scoring system (COVID-19 Reporting and Data System – CO-RADS) in 2 phases: before (S1) and after (S2) receiving AI classifier results. Two S2 scenarios were investigated: a default approach, with AI predictions available for all cases, and a selective approach, with AI limited to equivocal S1 cases (CO-RADS = 3). Inter-reader agreement (Gwet’s AC2) and diagnostic performance were analysed. Results: Radiologists demonstrated good-to-excellent agreement across all scenarios (AC2 = 0.77-0.81). Evaluation changes between S1 and S2 occurred in 18% of cases, with 29% of cases initially classified as CO-RADS = 3. In these equivocal cases, AI led to an average correct classification rate of 85%. Conversely, when radiologists were confident in their S1 diagnoses (CO-RADS ≠ 3), classification changes in S2 occurred in 7% of cases, preventing incorrect diagnoses in 45% of patients but resulting in missed correct classifications in 55%. Regarding diagnostic performance, S1 accuracy was 78%, with 15% of CO-RADS = 3 cases. In S2, under the default approach, accuracy increased to 81%, with 16% of CO-RADS = 3 cases, whereas the selective approach achieved 79% accuracy with only 10% of CO-RADS = 3 cases. Only the selective approach significantly reduced the proportion of equivocal cases (p < 0.009). Conclusions: A selective AI approach effectively reduces diagnostic uncertainty without introducing unnecessary complexity, emphasising its potential to optimise radiological workflows in challenging diagnostic scenarios. | |
dc.contributor.author | Rizzetto, Francesco | |
dc.contributor.author | Berta, Luca | |
dc.contributor.author | Zorzi, Giulia | |
dc.contributor.author | Travaglini, Francesca | |
dc.contributor.author | Artioli, Diana | |
dc.contributor.author | Carbonaro, Luca Alessandro | |
dc.contributor.author | Nerini Molteni, Silvia | |
dc.contributor.author | Vismara, Chiara | |
dc.contributor.author | Torresin, Alberto | |
dc.contributor.author | Colombo, Paola Enrica | |
dc.contributor.author | Vanzulli, Angelo | |
dc.date.accessioned | 2025-08-29T06:25:21Z | |
dc.date.available | 2025-08-29T06:25:21Z | |
dc.date.createdat | 2025-08-29T06:25:21Z | en |
dc.date.issued | 2025 | |
dc.date.openaccess | 0 | |
dc.description.accesstime | w momencie opublikowania | |
dc.description.additional | Bibliogr. s. e392-e393 | |
dc.description.physical | e384-e393 | |
dc.description.version | ostateczna wersja wydawcy | |
dc.description.volume | 90 | |
dc.identifier.doi | 10.5114/pjr/205344 | |
dc.identifier.issn | 1733-134X | |
dc.identifier.project | DRC AI | |
dc.identifier.uri | https://ruj.uj.edu.pl/handle/item/559412 | |
dc.language | eng | |
dc.language.container | eng | |
dc.rights | Udzielam licencji. Uznanie autorstwa - Użycie niekomercyjne - Bez utworów zależnych 4.0 Międzynarodowa | |
dc.rights.licence | CC-BY-NC-ND | |
dc.rights.uri | http://creativecommons.org/licenses/by-nc-nd/4.0/legalcode.pl | |
dc.share.type | otwarte czasopismo | |
dc.subject.en | artificial intelligence | |
dc.subject.en | lung | |
dc.subject.en | chest CT | |
dc.subject.en | classification | |
dc.subject.en | viral pneumonia | |
dc.subtype | Article | |
dc.title | Optimising strategies for artificial intelligence-assisted classification of viral pneumonias on CT imaging : a comparative study of selective and default approaches | |
dc.title.journal | Polish Journal of Radiology | |
dc.type | JournalArticle | |
dspace.entity.type | Publication | en |
* The migration of download and view statistics prior to the date of April 8, 2024 is in progress.
Views
6
Views per month
Views per city
Downloads
Open Access