The influence of negative training set size on machine learning-based virtual screening

2014
journal article
article
75
cris.lastimport.wos2024-04-09T20:45:24Z
dc.abstract.enBackground. The paper presents a thorough analysis of the influence of the number of negative training examples on the performance of machine learning methods. Results. The impact of this rather neglected aspect of machine learning methods application was examined for sets containing a fixed number of positive and a varying number of negative examples randomly selected from the ZINC database. An increase in the ratio of positive to negative training instances was found to greatly influence most of the investigated evaluating parameters of ML methods in simulated virtual screening experiments. In a majority of cases, substantial increases in precision and MCC were observed in conjunction with some decreases in hit recall. The analysis of dynamics of those variations let us recommend an optimal composition of training data. The study was performed on several protein targets, 5 machine learning algorithms (SMO, Naïve Bayes, Ibk, J48 and Random Forest) and 2 types of molecular fingerprints (MACCS and CDK FP). The most effective classification was provided by the combination of CDK FP with SMO or Random Forest algorithms. The Naïve Bayes models appeared to be hardly sensitive to changes in the number of negative instances in the training set. Conclusions. In conclusion, the ratio of positive to negative training instances should be taken into account during the preparation of machine learning experiments, as it might significantly influence the performance of particular classifier. What is more, the optimization of negative training set size can be applied as a boosting-like approach in machine learning-based virtual screening.pl
dc.affiliationWydział Chemiipl
dc.contributor.authorKurczab, Rafałpl
dc.contributor.authorPodlewska, Sabina - 149058 pl
dc.contributor.authorBojarski, Andrzej J.pl
dc.date.accession2019-03-28pl
dc.date.accessioned2015-07-28T08:24:58Z
dc.date.available2015-07-28T08:24:58Z
dc.date.issued2014pl
dc.date.openaccess0
dc.description.accesstimew momencie opublikowania
dc.description.additionalNa publikacji autorka Podlewska Sabina podpisana jako Smusz Sabina.pl
dc.description.versionostateczna wersja wydawcy
dc.description.volume6pl
dc.identifier.articleid32pl
dc.identifier.doi10.1186/1758-2946-6-32pl
dc.identifier.eissn1758-2946pl
dc.identifier.projectROD UJ / Ppl
dc.identifier.urihttp://ruj.uj.edu.pl/xmlui/handle/item/14113
dc.identifier.weblinkhttps://jcheminf.biomedcentral.com/track/pdf/10.1186/1758-2946-6-32pl
dc.languageengpl
dc.language.containerengpl
dc.rightsUdzielam licencji. Uznanie autorstwa 2.0*
dc.rights.licenceCC-BY
dc.rights.urihttp://creativecommons.org/licenses/by/2.0/pl/legalcode*
dc.share.typeotwarte czasopismo
dc.source.integratorfalse
dc.subtypeArticlepl
dc.titleThe influence of negative training set size on machine learning-based virtual screeningpl
dc.title.journalJournal of Cheminformaticspl
dc.typeJournalArticlepl
dspace.entity.typePublication
cris.lastimport.wos
2024-04-09T20:45:24Z
dc.abstract.enpl
Background. The paper presents a thorough analysis of the influence of the number of negative training examples on the performance of machine learning methods. Results. The impact of this rather neglected aspect of machine learning methods application was examined for sets containing a fixed number of positive and a varying number of negative examples randomly selected from the ZINC database. An increase in the ratio of positive to negative training instances was found to greatly influence most of the investigated evaluating parameters of ML methods in simulated virtual screening experiments. In a majority of cases, substantial increases in precision and MCC were observed in conjunction with some decreases in hit recall. The analysis of dynamics of those variations let us recommend an optimal composition of training data. The study was performed on several protein targets, 5 machine learning algorithms (SMO, Naïve Bayes, Ibk, J48 and Random Forest) and 2 types of molecular fingerprints (MACCS and CDK FP). The most effective classification was provided by the combination of CDK FP with SMO or Random Forest algorithms. The Naïve Bayes models appeared to be hardly sensitive to changes in the number of negative instances in the training set. Conclusions. In conclusion, the ratio of positive to negative training instances should be taken into account during the preparation of machine learning experiments, as it might significantly influence the performance of particular classifier. What is more, the optimization of negative training set size can be applied as a boosting-like approach in machine learning-based virtual screening.
dc.affiliationpl
Wydział Chemii
dc.contributor.authorpl
Kurczab, Rafał
dc.contributor.authorpl
Podlewska, Sabina - 149058
dc.contributor.authorpl
Bojarski, Andrzej J.
dc.date.accessionpl
2019-03-28
dc.date.accessioned
2015-07-28T08:24:58Z
dc.date.available
2015-07-28T08:24:58Z
dc.date.issuedpl
2014
dc.date.openaccess
0
dc.description.accesstime
w momencie opublikowania
dc.description.additionalpl
Na publikacji autorka Podlewska Sabina podpisana jako Smusz Sabina.
dc.description.version
ostateczna wersja wydawcy
dc.description.volumepl
6
dc.identifier.articleidpl
32
dc.identifier.doipl
10.1186/1758-2946-6-32
dc.identifier.eissnpl
1758-2946
dc.identifier.projectpl
ROD UJ / P
dc.identifier.uri
http://ruj.uj.edu.pl/xmlui/handle/item/14113
dc.identifier.weblinkpl
https://jcheminf.biomedcentral.com/track/pdf/10.1186/1758-2946-6-32
dc.languagepl
eng
dc.language.containerpl
eng
dc.rights*
Udzielam licencji. Uznanie autorstwa 2.0
dc.rights.licence
CC-BY
dc.rights.uri*
http://creativecommons.org/licenses/by/2.0/pl/legalcode
dc.share.type
otwarte czasopismo
dc.source.integrator
false
dc.subtypepl
Article
dc.titlepl
The influence of negative training set size on machine learning-based virtual screening
dc.title.journalpl
Journal of Cheminformatics
dc.typepl
JournalArticle
dspace.entity.type
Publication
Affiliations

* The migration of download and view statistics prior to the date of April 8, 2024 is in progress.

Views
19
Views per month
Views per city
Ashburn
2
Chandler
2
Wroclaw
2
Beijing
1
Des Moines
1
Dublin
1
Singapore
1
Downloads
kurczab_smusz_bojarski_the_influence_of_negative_2014.odt
36
kurczab_smusz_bojarski_the_influence_of_negative_2014.pdf
35